# LiteLLM

**Canonical:** https://apis.io/providers/litellm/  
**Website:** https://www.litellm.ai/  
**APIs profiled:** 33

LiteLLM is an open-source Python SDK and proxy server providing a unified OpenAI-compatible interface to 100+ LLM providers.

## Kin Score — 33.7 / 100 (thin)

Scored 2026-08-25 under rubric 0.14.0. Trend: flat (+0.0 from 33.7).

| Facet | Score |
|---|---|
| Discoverability | 53.7 |
| Contract Quality | 37.4 |
| Governance | 0.0 |
| Contract Governance | 0.0 |
| Operational Transparency | 28.9 |
| Developer Ergonomics | 50.0 |
| Commercial Clarity | 26.3 |
| Access Clarity | 26.3 |

## Agent readiness — 19.8 (agent-aware)

| Dimension | Value |
|---|---|
| Spec Presence | yes |
| Agentic Access | derived |
| Reversibility Documented | no |
| MCP Server | no |
| Auth Clarity | bearer |
| Idempotency | no |
| Error Semantics | no |
| OpenAPI Examples | no |
| Rate Limit Signal | documented |
| Event Surface Described | no |
| Agent Skills | no |
| Well Known Catalog | no |
| Consent Identity | no |
| Agent Card | no |
| Dry Run Mode | no |
| Delegated Identity | no |
| Protected Resource Metadata | no |
| Dynamic Client Registration | no |
| Agentic Commerce | no |

## Access

Freemium — onboarding: unknown, pricing: freemium, trial: no (confidence: medium).

## APIs (33)

- **LiteLLM Completions API** — Provides an OpenAI-compatible /completions endpoint for text completion requests routed through the LiteLLM proxy to supported LLM providers.
- **LiteLLM Responses API** — Provides an OpenAI-compatible /responses endpoint supporting the Responses API specification, including conversation history compression via /responses/compact.
- **LiteLLM Embeddings API** — Provides an OpenAI-compatible /embeddings endpoint for generating text embeddings across multiple providers including OpenAI, Cohere, HuggingFace, and Bedrock with unified forma...
- **LiteLLM Image Generation API** — Provides OpenAI-compatible /images/generations, /images/edits, and /images/variations endpoints for image generation and manipulation routed through the LiteLLM proxy.
- **LiteLLM Audio API** — Provides OpenAI-compatible /audio/transcriptions and /audio/speech endpoints for audio transcription and text-to-speech conversion across supported providers.
- **LiteLLM Moderations API** — Provides an OpenAI-compatible /moderations endpoint for content moderation across supported providers through the LiteLLM proxy.
- **LiteLLM Batches API** — Provides an OpenAI-compatible /batches endpoint for batch processing operations, enabling bulk request handling across LLM providers.
- **LiteLLM Files API** — Provides an OpenAI-compatible /files endpoint for file management operations used in conjunction with fine-tuning and batch processing.
- **LiteLLM Fine-Tuning API** — Provides an OpenAI-compatible /fine_tuning endpoint for model fine-tuning operations across supported providers through the LiteLLM proxy.
- **LiteLLM Rerank API** — Provides a /rerank endpoint for document reranking operations, supporting providers like Cohere through the LiteLLM proxy with a unified interface.
- **LiteLLM Vector Stores API** — Provides /vector_stores endpoints for creating and managing vector stores, file operations within vector stores, and search functionality for retrieval-augmented generation (RAG...
- **LiteLLM Anthropic Messages API** — Provides Anthropic-compatible /v1/messages and /v1/messages/count_tokens endpoints for native Anthropic API format support through the LiteLLM proxy.
- **LiteLLM Realtime API** — Provides /realtime WebSocket endpoints for real-time model interactions with load balancing and guardrails support across providers.
- **LiteLLM MCP API** — Provides /mcp endpoints for Model Context Protocol (MCP) integration, enabling LLMs to interact with external tools and APIs through OpenAPI specifications.
- **LiteLLM OCR API** — Provides an /ocr endpoint for optical character recognition, enabling text extraction from images through supported providers via the LiteLLM proxy.
- **LiteLLM Guardrails API** — Provides /guardrails/apply_guardrail endpoint for applying configured content filtering and safety guardrails to LLM requests and responses.
- **LiteLLM Evals API** — Provides /evals endpoints for the Evaluations API, enabling measurement and benchmarking of model performance through the LiteLLM proxy.
- **LiteLLM A2A Agent Gateway API** — Provides /a2a endpoints for the Agent-to-Agent (A2A) gateway, enabling agent registration, publishing, and inter-agent communication.
- **LiteLLM Videos API** — Provides /videos endpoints for video generation and handling through supported providers like RunwayML via the LiteLLM proxy.
- **LiteLLM Assistants API** — The Assistants API from LiteLLM — 1 operation(s) for assistants.
- **LiteLLM Audio API** — The Audio API from LiteLLM — 2 operation(s) for audio.
- **LiteLLM Batches API** — The Batches API from LiteLLM — 1 operation(s) for batches.
- **LiteLLM Chat API** — The Chat API from LiteLLM — 1 operation(s) for chat.
- **LiteLLM Completions API** — The Completions API from LiteLLM — 1 operation(s) for completions.
- **LiteLLM Embeddings API** — The Embeddings API from LiteLLM — 1 operation(s) for embeddings.
- **LiteLLM Fine Tuning API** — The Fine Tuning API from LiteLLM — 1 operation(s) for fine tuning.
- **LiteLLM Images API** — The Images API from LiteLLM — 3 operation(s) for images.
- **LiteLLM Messages API** — The Messages API from LiteLLM — 2 operation(s) for messages.
- **LiteLLM Moderations API** — The Moderations API from LiteLLM — 1 operation(s) for moderations.
- **LiteLLM Ocr API** — The Ocr API from LiteLLM — 1 operation(s) for ocr.
- **LiteLLM Rag API** — The Rag API from LiteLLM — 2 operation(s) for rag.
- **LiteLLM Rerank API** — The Rerank API from LiteLLM — 1 operation(s) for rerank.
- **LiteLLM Vector Stores API** — The Vector Stores API from LiteLLM — 2 operation(s) for vector stores.

## Agentic access (1)

- **Litellm Agentic Access** — 20 operations · 20 acting

## Security (1)

- **Litellm Domain Security** — TLSv1.3 · HSTS · DMARC

## Plans (1)

- **Litellm Plans Pricing**

## Tags

Gateways

---

Profiled by [API Evangelist](https://apievangelist.com) and published on [APIs.io](https://apis.io/providers/litellm/). Scores are computed from the provider's own public artifacts under a published rubric.
