Agenta

Agenta Gateway: LLM API

The Gateway: LLM API from Agenta — 4 operation(s) for gateway: llm.

GitHub OpenAPI

Operations 7

POST /gateways/llms/resolve Resolve Agent Connection #
GET /gateways/llms/endpoints/ List Endpoints #
POST /gateways/llms/endpoints/ Create Endpoint #
POST /gateways/llms/endpoints/query Query Endpoints #
GET /gateways/llms/endpoints/{endpoint_id} Fetch Endpoint #
PUT /gateways/llms/endpoints/{endpoint_id} Edit Endpoint #
DELETE /gateways/llms/endpoints/{endpoint_id} Delete Endpoint #

Documentation

📖
Documentation
https://docs.agenta.ai/prompt-engineering/overview
📖
APIReference
https://docs.agenta.ai/reference/api/list-api-endpoints
📖
Documentation
https://docs.agenta.ai/prompt-engineering/integrating-prompts/fetch-prompt-programatically
📖
APIReference
https://docs.agenta.ai/reference/sdk/configuration-management
📖
Documentation
https://docs.agenta.ai/evaluation/overview
📖
APIReference
https://docs.agenta.ai/reference/api/evaluations
📖
Documentation
https://docs.agenta.ai/evaluation/create-test-sets
📖
APIReference
https://docs.agenta.ai/reference/api/testsets
📖
Documentation
https://docs.agenta.ai/observability/overview
📖
APIReference
https://docs.agenta.ai/reference/api/traces

Specifications

⚙
OpenAPI
https://artifacts.apis.io/agenta/openapi/agenta-gateway-llm-api-openapi.yml

Other Resources

🔗
PostmanCollection
https://artifacts.apis.io/agenta/collections/agenta.postman_collection.json
🔗
OpenCollection
https://artifacts.apis.io/agenta/collections/agenta.opencollection.json

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/agenta:agenta-gateway-llm-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

agenta-gateway-llm-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: 'Agenta Gateway: LLM API'
  description: Agenta API
  contact:
    name: Agenta
    url: https://agenta.ai/
    email: team@agenta.ai
  version: 0.1.0
servers:
- url: /api
- url: https://eu.cloud.agenta.ai/api
security:
- APIKeyHeader: []
tags:
- name: 'Gateway: LLM'
paths:
  /gateways/llms/resolve:
    post:
      tags:
      - 'Gateway: LLM'
      summary: Resolve Agent Connection
      description: Resolve an agent's gateway target without exposing a vault secret.
      operationId: resolve_llm_gateway_connection
      requestBody:
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/LLMGatewayConnectionResolveRequest'
        required: true
      responses:
        '200':
          description: Successful Response
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/LLMGatewayConnectionResolveResponse'
        '422':
          description: Validation Error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/HTTPValidationError'
  /gateways/llms/endpoints/:
    get:
      tags:
      - 'Gateway: LLM'
      summary: List Endpoints
      operationId: list_llm_endpoints
      responses:
        '200':
          description: Successful Response
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/LLMEndpointsResponse'
    post:
      tags:
      - 'Gateway: LLM'
      summary: Create Endpoint
      operationId: create_llm_endpoint
      requestBody:
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/LLMEndpointCreateRequest'
        required: true
      responses:
        '200':
          description: Successful Response
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/LLMEndpointResponse'
        '422':
          description: Validation Error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/HTTPValidationError'
  /gateways/llms/endpoints/query:
    post:
      tags:
      - 'Gateway: LLM'
      summary: Query Endpoints
      operationId: query_llm_endpoints
      requestBody:
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/LLMEndpointQueryRequest'
        required: true
      responses:
        '200':
          description: Successful Response
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/LLMEndpointsResponse'
        '422':
          description: Validation Error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/HTTPValidationError'
  /gateways/llms/endpoints/{endpoint_id}:
    get:
      tags:
      - 'Gateway: LLM'
      summary: Fetch Endpoint
      operationId: fetch_llm_endpoint
      parameters:
      - name: endpoint_id
        in: path
        required: true
        schema:
          type: string
          format: uuid
          title: Endpoint Id
      responses:
        '200':
          description: Successful Response
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/LLMEndpointResponse'
        '422':
          description: Validation Error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/HTTPValidationError'
    put:
      tags:
      - 'Gateway: LLM'
      summary: Edit Endpoint
      operationId: edit_llm_endpoint
      parameters:
      - name: endpoint_id
        in: path
        required: true
        schema:
          type: string
          format: uuid
          title: Endpoint Id
      requestBody:
        required: true
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/LLMEndpointEditRequest'
      responses:
        '200':
          description: Successful Response
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/LLMEndpointResponse'
        '422':
          description: Validation Error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/HTTPValidationError'
    delete:
      tags:
      - 'Gateway: LLM'
      summary: Delete Endpoint
      operationId: delete_llm_endpoint
      parameters:
      - name: endpoint_id
        in: path
        required: true
        schema:
          type: string
          format: uuid
          title: Endpoint Id
      responses:
        '204':
          description: Successful Response
        '422':
          description: Validation Error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/HTTPValidationError'
components:
  schemas:
    LLMEndpoint:
      properties:
        flags:
          $ref: '#/components/schemas/LLMEndpointFlags'
        tags:
          anyOf:
          - additionalProperties:
              $ref: '#/components/schemas/LabelJson-Output'
            type: object
          - type: 'null'
          title: Tags
        meta:
          anyOf:
          - additionalProperties:
              $ref: '#/components/schemas/FullJson-Output'
            type: object
          - type: 'null'
          title: Meta
        created_at:
          anyOf:
          - type: string
            format: date-time
          - type: 'null'
          title: Created At
        updated_at:
          anyOf:
          - type: string
            format: date-time
          - type: 'null'
          title: Updated At
        deleted_at:
          anyOf:
          - type: string
            format: date-time
          - type: 'null'
          title: Deleted At
        created_by_id:
          anyOf:
          - type: string
            format: uuid
          - type: 'null'
          title: Created By Id
        updated_by_id:
          anyOf:
          - type: string
            format: uuid
          - type: 'null'
          title: Updated By Id
        deleted_by_id:
          anyOf:
          - type: string
            format: uuid
          - type: 'null'
          title: Deleted By Id
        name:
          anyOf:
          - type: string
          - type: 'null'
          title: Name
        description:
          anyOf:
          - type: string
          - type: 'null'
          title: Description
        slug:
          anyOf:
          - type: string
          - type: 'null'
          title: Slug
        id:
          anyOf:
          - type: string
            format: uuid
          - type: 'null'
          title: Id
        provider_key:
          anyOf:
          - type: string
          - type: 'null'
          title: Provider Key
        deployment_kind:
          $ref: '#/components/schemas/LLMDeploymentKind'
        namespace:
          $ref: '#/components/schemas/GatewayEndpointNamespace'
          default: custom
        secret_id:
          anyOf:
          - type: string
            format: uuid
          - type: 'null'
          title: Secret Id
        data:
          $ref: '#/components/schemas/LLMEndpointData'
        status:
          anyOf:
          - $ref: '#/components/schemas/Status'
          - type: 'null'
      type: object
      required:
      - deployment_kind
      title: LLMEndpoint
    LLMEndpointRoute:
      properties:
        base_url:
          anyOf:
          - type: string
          - type: 'null'
          title: Base Url
        headers:
          anyOf:
          - additionalProperties:
              type: string
            type: object
          - type: 'null'
          title: Headers
        api_version:
          anyOf:
          - type: string
          - type: 'null'
          title: Api Version
        region:
          anyOf:
          - type: string
          - type: 'null'
          title: Region
        extras:
          anyOf:
          - additionalProperties: true
            type: object
          - type: 'null'
          title: Extras
      type: object
      title: LLMEndpointRoute
      description: Provider-specific route fields.
    GatewayEndpointNamespace:
      type: string
      enum:
      - builtin
      - standard
      - custom
      title: GatewayEndpointNamespace
      description: Gateway route namespace.
    LabelJson-Output:
      anyOf:
      - type: boolean
      - type: string
      - additionalProperties:
          $ref: '#/components/schemas/LabelJson-Output'
        type: object
    LLMEndpointResponse:
      properties:
        count:
          type: integer
          title: Count
          default: 0
        endpoint:
          anyOf:
          - $ref: '#/components/schemas/LLMEndpoint'
          - type: 'null'
      type: object
      title: LLMEndpointResponse
    LLMEndpointData:
      properties:
        route:
          $ref: '#/components/schemas/LLMEndpointRoute'
        models:
          $ref: '#/components/schemas/GatewayEndpointFilter'
        settings:
          $ref: '#/components/schemas/LLMEndpointSettings'
      type: object
      title: LLMEndpointData
    LLMGatewayConnectionResolveRequest:
      properties:
        model:
          type: string
          title: Model
        provider_key:
          anyOf:
          - type: string
          - type: 'null'
          title: Provider Key
        connection_slug:
          anyOf:
          - type: string
          - type: 'null'
          title: Connection Slug
        connection_namespace:
          anyOf:
          - $ref: '#/components/schemas/GatewayEndpointNamespace'
          - type: 'null'
      type: object
      required:
      - model
      title: LLMGatewayConnectionResolveRequest
    Windowing:
      properties:
        newest:
          anyOf:
          - type: string
            format: date-time
          - type: 'null'
          title: Newest
        oldest:
          anyOf:
          - type: string
            format: date-time
          - type: 'null'
          title: Oldest
        next:
          anyOf:
          - type: string
            format: uuid
          - type: 'null'
          title: Next
        limit:
          anyOf:
          - type: integer
          - type: 'null'
          title: Limit
        order:
          anyOf:
          - type: string
            enum:
            - ascending
            - descending
          - type: 'null'
          title: Order
        interval:
          anyOf:
          - type: integer
          - type: 'null'
          title: Interval
        rate:
          anyOf:
          - type: number
          - type: 'null'
          title: Rate
      type: object
      title: Windowing
    FullJson-Input:
      anyOf:
      - type: string
      - type: integer
      - type: number
      - type: boolean
      - additionalProperties:
          $ref: '#/components/schemas/FullJson-Input'
        type: object
      - items:
          $ref: '#/components/schemas/FullJson-Input'
        type: array
      - type: 'null'
    Status:
      properties:
        timestamp:
          type: string
          format: date-time
          title: Timestamp
        type:
          anyOf:
          - type: string
          - type: 'null'
          title: Type
        code:
          anyOf:
          - type: string
          - type: 'null'
          title: Code
        message:
          anyOf:
          - type: string
          - type: 'null'
          title: Message
        stacktrace:
          anyOf:
          - type: string
          - type: 'null'
          title: Stacktrace
      type: object
      title: Status
    HTTPValidationError:
      properties:
        detail:
          items:
            $ref: '#/components/schemas/ValidationError'
          type: array
          title: Detail
      type: object
      title: HTTPValidationError
    LLMGatewayConnectionResolution:
      properties:
        namespace:
          $ref: '#/components/schemas/GatewayEndpointNamespace'
        name:
          type: string
          title: Name
        provider_key:
          type: string
          title: Provider Key
        deployment_kind:
          $ref: '#/components/schemas/LLMDeploymentKind'
        model:
          type: string
          title: Model
      type: object
      required:
      - namespace
      - name
      - provider_key
      - deployment_kind
      - model
      title: LLMGatewayConnectionResolution
      description: 'Non-secret result of resolving one agent model connection.


        The API core chooses and validates the endpoint while it has vault access.  The service

        process receives this route metadata only; provider-key material never crosses that

        boundary.'
    LLMDeploymentKind:
      type: string
      enum:
      - direct
      - custom
      - azure
      - bedrock
      - sagemaker
      - vertex_ai
      - mock
      title: LLMDeploymentKind
      description: How an upstream model deployment is reached.
    LabelJson-Input:
      anyOf:
      - type: boolean
      - type: string
      - additionalProperties:
          $ref: '#/components/schemas/LabelJson-Input'
        type: object
    FullJson-Output:
      anyOf:
      - type: string
      - type: integer
      - type: number
      - type: boolean
      - additionalProperties:
          $ref: '#/components/schemas/FullJson-Output'
        type: object
      - items:
          $ref: '#/components/schemas/FullJson-Output'
        type: array
      - type: 'null'
    LLMEndpointsResponse:
      properties:
        count:
          type: integer
          title: Count
          default: 0
        endpoints:
          items:
            $ref: '#/components/schemas/LLMEndpoint'
          type: array
          title: Endpoints
      type: object
      title: LLMEndpointsResponse
    GatewayEndpointFilter:
      properties:
        allowlist:
          anyOf:
          - items:
              type: string
            type: array
          - type: 'null'
          title: Allowlist
        denylist:
          anyOf:
          - items:
              type: string
            type: array
          - type: 'null'
          title: Denylist
      type: object
      title: GatewayEndpointFilter
      description: Allowlist and denylist filter for models or tools.
    LLMEndpointEditRequest:
      properties:
        endpoint:
          $ref: '#/components/schemas/LLMEndpointEdit'
      type: object
      required:
      - endpoint
      title: LLMEndpointEditRequest
    LLMEndpointCreateRequest:
      properties:
        endpoint:
          $ref: '#/components/schemas/LLMEndpointCreate'
      type: object
      required:
      - endpoint
      title: LLMEndpointCreateRequest
    LLMEndpointEdit:
      properties:
        flags:
          $ref: '#/components/schemas/LLMEndpointFlags'
        tags:
          anyOf:
          - additionalProperties:
              $ref: '#/components/schemas/LabelJson-Input'
            type: object
          - type: 'null'
          title: Tags
        meta:
          anyOf:
          - additionalProperties:
              $ref: '#/components/schemas/FullJson-Input'
            type: object
          - type: 'null'
          title: Meta
        name:
          anyOf:
          - type: string
          - type: 'null'
          title: Name
        description:
          anyOf:
          - type: string
          - type: 'null'
          title: Description
        id:
          anyOf:
          - type: string
            format: uuid
          - type: 'null'
          title: Id
        provider_key:
          anyOf:
          - type: string
          - type: 'null'
          title: Provider Key
        secret_id:
          anyOf:
          - type: string
            format: uuid
          - type: 'null'
          title: Secret Id
        data:
          $ref: '#/components/schemas/LLMEndpointData'
      type: object
      title: LLMEndpointEdit
    LLMEndpointSettings:
      properties:
        timeout_seconds:
          anyOf:
          - type: number
          - type: 'null'
          title: Timeout Seconds
        max_output_tokens:
          anyOf:
          - type: integer
          - type: 'null'
          title: Max Output Tokens
      type: object
      title: LLMEndpointSettings
    LLMEndpointQueryRequest:
      properties:
        endpoint:
          anyOf:
          - $ref: '#/components/schemas/LLMEndpointQuery'
          - type: 'null'
        windowing:
          anyOf:
          - $ref: '#/components/schemas/Windowing'
          - type: 'null'
      type: object
      title: LLMEndpointQueryRequest
    LLMGatewayConnectionResolveResponse:
      properties:
        connection:
          $ref: '#/components/schemas/LLMGatewayConnectionResolution'
      type: object
      required:
      - connection
      title: LLMGatewayConnectionResolveResponse
    ValidationError:
      properties:
        loc:
          items:
            anyOf:
            - type: string
            - type: integer
          type: array
          title: Location
        msg:
          type: string
          title: Message
        type:
          type: string
          title: Error Type
        input:
          title: Input
        ctx:
          type: object
          title: Context
      type: object
      required:
      - loc
      - msg
      - type
      title: ValidationError
    LLMEndpointQuery:
      properties:
        provider_key:
          anyOf:
          - type: string
          - type: 'null'
          title: Provider Key
        deployment_kind:
          anyOf:
          - $ref: '#/components/schemas/LLMDeploymentKind'
          - type: 'null'
        slug:
          anyOf:
          - type: string
          - type: 'null'
          title: Slug
      type: object
      title: LLMEndpointQuery
    LLMEndpointFlags:
      properties:
        is_active:
          type: boolean
          title: Is Active
          default: true
      type: object
      title: LLMEndpointFlags
    LLMEndpointCreate:
      properties:
        flags:
          $ref: '#/components/schemas/LLMEndpointFlags'
        tags:
          anyOf:
          - additionalProperties:
              $ref: '#/components/schemas/LabelJson-Input'
            type: object
          - type: 'null'
          title: Tags
        meta:
          anyOf:
          - additionalProperties:
              $ref: '#/components/schemas/FullJson-Input'
            type: object
          - type: 'null'
          title: Meta
        name:
          anyOf:
          - type: string
          - type: 'null'
          title: Name
        description:
          anyOf:
          - type: string
          - type: 'null'
          title: Description
        slug:
          anyOf:
          - type: string
          - type: 'null'
          title: Slug
        provider_key:
          anyOf:
          - type: string
          - type: 'null'
          title: Provider Key
        deployment_kind:
          $ref: '#/components/schemas/LLMDeploymentKind'
        secret_id:
          anyOf:
          - type: string
            format: uuid
          - type: 'null'
          title: Secret Id
        data:
          $ref: '#/components/schemas/LLMEndpointData'
      type: object
      required:
      - deployment_kind
      title: LLMEndpointCreate
  securitySchemes:
    APIKeyHeader:
      type: apiKey
      name: Authorization
      in: header