Kong AI Gateway

AI Proxy Advanced Plugin

The AI Proxy Advanced plugin extends AI Proxy with load balancing, weighted distribution, and fallback across multiple providers and models simultaneously.

GitHub

Documentation

📖
Documentation
https://developer.konghq.com/plugins/ai-proxy-advanced/

API entry from apis.yml

apis.yml Raw ↑ 
aid: kong-ai-gateway:ai-proxy-advanced-plugin
name: AI Proxy Advanced Plugin
description: The AI Proxy Advanced plugin extends AI Proxy with load balancing, weighted distribution,
  and fallback across multiple providers and models simultaneously.
humanURL: https://developer.konghq.com/plugins/ai-proxy-advanced/
tags:
- Plugin
- Load Balancing
- LLM
properties:
- type: Documentation
  url: https://developer.konghq.com/plugins/ai-proxy-advanced/