video-ia.net
Video-IA.net
Back
G

LiteLLM: OpenAI‑Compatible LLM Gateway & SDK - Video-IA.net

LiteLLM is a Python SDK and proxy (LLM Gateway) to call 100+ LLM providers with an OpenAI‑style interface, plus routing, budgets and rate limits.

Visit Tool
About this tool

LiteLLM — OpenAI‑Compatible LLM Gateway & SDK

LiteLLM lets you call 100+ LLM APIs (OpenAI, Azure, Vertex, Bedrock, Cohere, Anthropic, HuggingFace, Replicate, Groq, etc.) with a single OpenAI‑style interface. It includes a production proxy (LLM Gateway) with routing/fallback, budgets, rate‑limits, logging callbacks and a dashboard. Features include streaming, async, embeddings and image generation with consistent response shapes. Docs provide quick starts, proxy setup, key management and provider‑specific guides.

Key Features
Call 100+ LLM APIs using OpenAI‑compatible format
Proxy server (LLM Gateway) with routing, budgets, rate limits
Streaming, async, embeddings, images; consistent OpenAI responses
Observability callbacks; enterprise tier; extensive provider support
Follow this tool
DiscordGithubLinkedinTwitter
Tool Information

Category

No category

Status

PUBLISHED
Related Tools
B
Blunge: AI Graphic Style Packs - Video-IA.net

Blunge offers curated style packs to turn ideas into graphics in minutes—start free and explore models.

T
Test Tool: API Testing Tool - Video-IA.net

This is a test tool for API testing

0
Zero (0.email) – AI Email Client - Video-IA.net

Zero (0.email) is an AI‑driven email client with a modern PWA frontend.

2
2Captcha: Automated CAPTCHA Solving Service - Video-IA.net

Automated CAPTCHA solving service with API, browser extensions, and SDKs for developers.