Traefik Labs

Traefik AI Gateway

Self-hosted Kubernetes-native gateway for LLM traffic. OpenAI-compatible unified API in front of OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Cohere, Gemini, Mistral, Ollama, and self-hosted models. Built-in jailbreak detection (NVIDIA Safety NIMs), PII redaction (Presidio, 35+ recognizers), 22+ content-filter categories, semantic caching (vendor-claimed 40-70% cost reduction), identity-based routing, and OpenTelemetry token/cost metrics.

Documentation GitHub

Other Resources

🔗

Solution Page

https://traefik.io/solutions/ai-gateway/

🔗

KubernetesCRD

https://raw.githubusercontent.com/api-evangelist/traefik/refs/heads/main/crd/hub-aiservice.yaml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this

find_apisBrowse and filter every API in the catalog.
get_api_artifactsOne API's artifacts, grouped by type.
get_openapiThe primary OpenAPI for this API.
find_similar_apisAPIs that look like this one.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools

Call it yourself

curl for this page

This API

curl "https://apis.io/api/v1/apis/traefik-ai-gateway"

All apis

curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

API entry from apis.yml

aid: traefik:traefik-ai-gateway
name: Traefik AI Gateway
description: Self-hosted Kubernetes-native gateway for LLM traffic. OpenAI-compatible unified API in front
  of OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Cohere, Gemini, Mistral, Ollama, and self-hosted models.
  Built-in jailbreak detection (NVIDIA Safety NIMs), PII redaction (Presidio, 35+ recognizers), 22+ content-filter
  categories, semantic caching (vendor-claimed 40-70% cost reduction), identity-based routing, and OpenTelemetry
  token/cost metrics.
humanURL: https://traefik.io/solutions/ai-gateway/
tags:
- AI Gateway
- LLM
- Guardrails
- Observability
- Enterprise
properties:
- type: Solution Page
  url: https://traefik.io/solutions/ai-gateway/
- type: KubernetesCRD
  url: crd/hub-aiservice.yaml