AgentGateway · Schema

LLMBackend

Configuration for an LLM provider backend in AgentGateway, defining the target model, authentication, and routing parameters.

AI GatewayAPI GatewayMCPLLMAgent-to-AgentOpen SourceCNCFObservabilitySecurity

Name	Type	Description
name	string	Unique name for this LLM backend.
provider	string	The LLM provider for this backend.
model	string	The model identifier to use for requests.
alias	string	Optional alias exposed to clients instead of the actual model name.
baseUrl	string	Base URL for the LLM provider API endpoint.
authentication	object	Authentication configuration for this backend.
weight	integer	Load balancing weight for this backend (higher means more traffic).
priority	integer	Failover priority, lower values have higher priority.