# AI Gateway **Canonical:** https://apis.io/providers/ai-gateway/ **APIs profiled:** 38 An API Evangelist landscape index of AI gateways — the LLM routers, prompt firewalls, model fallback proxies, cost-control planes, and policy engines that sit between applications and AI providers. AI gateways unify access across OpenAI, Anthropic, Google, AWS Bedrock, Azure OpenAI, and self-hosted models behind a common interface and apply caching, routing, guardrails, observability, rate limiting, budgets, RBAC, and audit controls. This index catalogs commercial SaaS gateways, open-source projects, API gateway AI plugins, and cloud-provider AI proxies, with a shared schema and vocabulary for describing model routes, fallbacks, guardrails, and budgets across vendors. ## Kin Score — 31.5 / 100 (thin) Scored 2026-08-20 under rubric 0.12.0. Trend: flat (+0.0 from 31.5). | Facet | Score | |---|---| | Discoverability | 64.8 | | Contract Quality | 57.3 | | Governance | 25.0 | | Contract Governance | 25.0 | | Operational Transparency | 26.3 | | Developer Ergonomics | 21.4 | | Commercial Clarity | 0.0 | | Access Clarity | 0.0 | ## Agent readiness — 27.6 (agent-aware) | Dimension | Value | |---|---| | Spec Presence | yes | | Agentic Access | derived | | Reversibility Documented | no | | MCP Server | no | | Auth Clarity | yes | | Idempotency | no | | Error Semantics | no | | OpenAPI Examples | documented | | Rate Limit Signal | no | | Event Surface Described | no | | Agent Skills | no | | Well Known Catalog | no | | Consent Identity | no | | Agent Card | no | | Dry Run Mode | no | ## Access Self-serve signup — onboarding: self-serve, pricing: unknown, trial: no (confidence: medium). ## APIs (38) - **Portkey** — Portkey is a production-grade AI gateway and control plane that fronts 1,600+ LLMs with unified routing, fallbacks, semantic caching, guardrails, cost attribution, and prompt ma... - **OpenRouter** — OpenRouter is a unified inference marketplace exposing 400+ models from 60+ providers behind one OpenAI-compatible API, with automatic provider fallback, pay-as-you-go credits, ... - **LiteLLM** — LiteLLM (BerriAI) is an open-source LLM gateway that exposes 100+ LLM providers — OpenAI, Anthropic, Azure, Bedrock, Gemini — through a single OpenAI-compatible API. The LiteLLM... - **Helicone** — Helicone is an open-source AI observability and routing platform centered on requests, sessions, prompts, datasets, rate limits, and alerts. Integrates with OpenAI, Anthropic, G... - **Cloudflare AI Gateway** — Cloudflare AI Gateway is an edge-deployed proxy that fronts AI providers — Workers AI, Anthropic, Google Gemini, OpenAI, Replicate, and more — with caching, rate limiting, analy... - **Kong AI Gateway** — The Kong AI Gateway is delivered as the AI Proxy plugin for Kong Gateway, transforming and proxying requests across 16+ providers including OpenAI, Azure OpenAI, Anthropic, Amaz... - **Apache APISIX AI Proxy** — The Apache APISIX ai-proxy plugin streamlines integration with LLMs by converting plugin settings into the appropriate request format for OpenAI, DeepSeek, Azure OpenAI, Anthrop... - **Tetrate Agent Router Service** — Tetrate Agent Router Service is an Envoy AI Gateway-as-a-service from the creators of Envoy, providing an approved LLM catalog, unified model access, automatic fallback, cost ma... - **NVIDIA NIM** — NVIDIA NIM is a set of inference microservices for streamlined AI model deployment, prebuilt and optimized for low-latency, high-throughput inference on NVIDIA-accelerated infra... - **Traefik AI Gateway** — Traefik AI Gateway is an enterprise, self-hosted, Kubernetes-native AI gateway with safety and governance (NVIDIA Safety NIMs, jailbreak detection, content filtering across 22+ ... - **Together AI** — Together AI is a full-stack AI Native Cloud for inference, fine-tuning, and GPU clusters powered by research, exposing serverless inference, batch processing, dedicated model an... - **Anyscale** — Anyscale is the production-scale AI platform built on Ray by the creators of Ray, supporting LLM inference and other data-intensive AI workloads across distributed GPU clusters.... - **LangDB** — LangDB is an enterprise AI gateway for routing and governing LLM traffic across providers, with observability, cost tracking, and policy enforcement. Public homepage was unreach... - **Envoy AI Gateway** — Envoy AI Gateway is an open-source extension to Envoy Proxy and Envoy Gateway, providing a Kubernetes-native AI traffic plane for routing, governing, and observing LLM calls acr... - **Gentrace** — Gentrace was an AI evaluation and observability product; the company has shut down and its codebase is now MIT-licensed open source on GitHub. Included here for historical compl... - **AI Gateway Analytics API** — The Analytics API from AI Gateway — 2 operation(s) for analytics. - **AI Gateway APIKeys API** — The APIKeys API from AI Gateway — 1 operation(s) for apikeys. - **AI Gateway Assistants API** — The Assistants API from AI Gateway — 1 operation(s) for assistants. - **AI Gateway Audio API** — The Audio API from AI Gateway — 3 operation(s) for audio. - **AI Gateway Batches API** — The Batches API from AI Gateway — 2 operation(s) for batches. - **AI Gateway Chat API** — The Chat API from AI Gateway — 1 operation(s) for chat. - **AI Gateway Completions API** — The Completions API from AI Gateway — 1 operation(s) for completions. - **AI Gateway Configs API** — The Configs API from AI Gateway — 1 operation(s) for configs. - **AI Gateway Embeddings API** — The Embeddings API from AI Gateway — 2 operation(s) for embeddings. - **AI Gateway Feedback API** — The Feedback API from AI Gateway — 1 operation(s) for feedback. - **AI Gateway Files API** — The Files API from AI Gateway — 2 operation(s) for files. - **AI Gateway FineTuning API** — The FineTuning API from AI Gateway — 2 operation(s) for finetuning. - **AI Gateway Guardrails API** — The Guardrails API from AI Gateway — 1 operation(s) for guardrails. - **AI Gateway Images API** — The Images API from AI Gateway — 1 operation(s) for images. - **AI Gateway Integrations API** — The Integrations API from AI Gateway — 2 operation(s) for integrations. - **AI Gateway Logs API** — The Logs API from AI Gateway — 2 operation(s) for logs. - **AI Gateway MCP API** — The MCP API from AI Gateway — 2 operation(s) for mcp. - **AI Gateway Policies API** — The Policies API from AI Gateway — 2 operation(s) for policies. - **AI Gateway Prompts API** — The Prompts API from AI Gateway — 6 operation(s) for prompts. - **AI Gateway Responses API** — The Responses API from AI Gateway — 1 operation(s) for responses. - **AI Gateway Threads API** — The Threads API from AI Gateway — 3 operation(s) for threads. - **AI Gateway VirtualKeys API** — The VirtualKeys API from AI Gateway — 1 operation(s) for virtualkeys. - **AI Gateway Workspaces API** — The Workspaces API from AI Gateway — 4 operation(s) for workspaces. ## Agentic access (1) - **Ai Gateway Agentic Access** — 60 operations · 32 acting ## Security (2) - **Ai Gateway Authentication** — apiKey · 2 schemes - **Ai Gateway Domain Security** — TLSv1.3 · HSTS · DNSSEC · DMARC ## Use cases (6) - **Provider-Agnostic LLM Access** — Front many LLM providers behind one API so application teams can switch models without changing client code. - **Cost Containment for AI** — Apply caching, routing to cheaper models, and per-team budgets to keep generative-AI spend predictable. - **Reliability and Failover** — Survive single-provider outages by automatically failing over to backup models when the primary degrades. - **Centralized AI Governance** — Enforce content, PII, and policy controls in one place for every AI request leaving the organization. - **Observability and FinOps** — Attribute cost and latency to teams, projects, and users; expose token-level metrics to FinOps and SRE. - **Multi-Tenant AI Platforms** — Build internal AI platforms where each product team gets its own virtual keys, budgets, and logs. ## Tags AI Gateway, LLM Router, LLM Proxy, Model Routing, Prompt Firewall, Guardrails, AI Observability, Cost Controls, AI Governance, API Gateway --- Profiled by [API Evangelist](https://apievangelist.com) and published on [APIs.io](https://apis.io/providers/ai-gateway/). Scores are computed from the provider's own public artifacts under a published rubric.