LiteLLM
LiteLLM is an open-source Python SDK and proxy server providing a unified OpenAI-compatible interface to 100+ LLM providers.
LiteLLM publishes 14 APIs on the APIs.io network, including Assistants API, Audio API, Batches API, and 11 more. Tagged areas include Gateways.
LiteLLM’s developer surface includes developer portal, documentation, getting-started guide, engineering blog, changelog, release notes, support, and 18 more developer resources.
Kin Score
APIs 33
Individual APIs this provider publishes, each with its own machine-readable definition.
LiteLLM Completions API
Provides an OpenAI-compatible /completions endpoint for text completion requests routed through the LiteLLM proxy to supported LLM providers.
LiteLLM Responses API
Provides an OpenAI-compatible /responses endpoint supporting the Responses API specification, including conversation history compression via /responses/compact.
LiteLLM Embeddings API
Provides an OpenAI-compatible /embeddings endpoint for generating text embeddings across multiple providers including OpenAI, Cohere, HuggingFace, and Bedrock with unified forma...
LiteLLM Image Generation API
Provides OpenAI-compatible /images/generations, /images/edits, and /images/variations endpoints for image generation and manipulation routed through the LiteLLM proxy.
LiteLLM Audio API
Provides OpenAI-compatible /audio/transcriptions and /audio/speech endpoints for audio transcription and text-to-speech conversion across supported providers.
LiteLLM Moderations API
Provides an OpenAI-compatible /moderations endpoint for content moderation across supported providers through the LiteLLM proxy.
LiteLLM Batches API
Provides an OpenAI-compatible /batches endpoint for batch processing operations, enabling bulk request handling across LLM providers.
LiteLLM Files API
Provides an OpenAI-compatible /files endpoint for file management operations used in conjunction with fine-tuning and batch processing.
LiteLLM Fine-Tuning API
Provides an OpenAI-compatible /fine_tuning endpoint for model fine-tuning operations across supported providers through the LiteLLM proxy.
LiteLLM Rerank API
Provides a /rerank endpoint for document reranking operations, supporting providers like Cohere through the LiteLLM proxy with a unified interface.
LiteLLM Vector Stores API
Provides /vector_stores endpoints for creating and managing vector stores, file operations within vector stores, and search functionality for retrieval-augmented generation (RAG...
LiteLLM Anthropic Messages API
Provides Anthropic-compatible /v1/messages and /v1/messages/count_tokens endpoints for native Anthropic API format support through the LiteLLM proxy.
LiteLLM Realtime API
Provides /realtime WebSocket endpoints for real-time model interactions with load balancing and guardrails support across providers.
LiteLLM MCP API
Provides /mcp endpoints for Model Context Protocol (MCP) integration, enabling LLMs to interact with external tools and APIs through OpenAPI specifications.
LiteLLM OCR API
Provides an /ocr endpoint for optical character recognition, enabling text extraction from images through supported providers via the LiteLLM proxy.
LiteLLM Guardrails API
Provides /guardrails/apply_guardrail endpoint for applying configured content filtering and safety guardrails to LLM requests and responses.
LiteLLM Evals API
Provides /evals endpoints for the Evaluations API, enabling measurement and benchmarking of model performance through the LiteLLM proxy.
LiteLLM A2A Agent Gateway API
Provides /a2a endpoints for the Agent-to-Agent (A2A) gateway, enabling agent registration, publishing, and inter-agent communication.
LiteLLM Videos API
Provides /videos endpoints for video generation and handling through supported providers like RunwayML via the LiteLLM proxy.
LiteLLM Assistants API
The Assistants API from LiteLLM — 1 operation(s) for assistants.
LiteLLM Audio API
The Audio API from LiteLLM — 2 operation(s) for audio.
LiteLLM Batches API
The Batches API from LiteLLM — 1 operation(s) for batches.
LiteLLM Chat API
The Chat API from LiteLLM — 1 operation(s) for chat.
LiteLLM Completions API
The Completions API from LiteLLM — 1 operation(s) for completions.
LiteLLM Embeddings API
The Embeddings API from LiteLLM — 1 operation(s) for embeddings.
LiteLLM Fine Tuning API
The Fine Tuning API from LiteLLM — 1 operation(s) for fine tuning.
LiteLLM Images API
The Images API from LiteLLM — 3 operation(s) for images.
LiteLLM Messages API
The Messages API from LiteLLM — 2 operation(s) for messages.
LiteLLM Moderations API
The Moderations API from LiteLLM — 1 operation(s) for moderations.
LiteLLM Ocr API
The Ocr API from LiteLLM — 1 operation(s) for ocr.
LiteLLM Rag API
The Rag API from LiteLLM — 2 operation(s) for rag.
LiteLLM Rerank API
The Rerank API from LiteLLM — 1 operation(s) for rerank.
LiteLLM Vector Stores API
The Vector Stores API from LiteLLM — 2 operation(s) for vector stores.
Scroll for all 33
Open Collections 1
Open, tool-agnostic API collections (OpenAPI-derived and Bruno).
LiteLLM Proxy API
OPEN COLLECTIONPricing Plans 1
Published pricing tiers and plan structures.
Rate Limits 1
Documented rate limits and quota policies.
Litellm Rate Limits
RATE LIMITSFinOps 1
Cost, billing, and metering signals for API financial operations.
Litellm Finops
FINOPSSecurity Posture 1
Authentication, domain security, vulnerability disclosure, and trust-center signals.
Agentic Access 1
Recommended x-agentic-access execution contracts for AI agents.
Resources
Get Started 2
Portal, sign-up, and the first successful call
Documentation 1
Reference material describing how the API behaves
Agent Surfaces 2
MCP servers, agent skills, and machine-readable catalogs
Build 1
SDKs, sample code, and the tooling you integrate with
Access & Security 2
Authentication, authorization, and security posture
Operate 5
Status, limits, changes, and where to get help
Commercial 1
Pricing, plans, and the legal terms of use
Company 2
The organization behind the API
Other 9
Properties that don't map to a standard resource type
Scroll for all 9