Agenta

Agenta Evaluators API

Configure evaluators used to score variants.

GitHub OpenAPI
Business capability
Artificial Intelligence Management BC-610.60

Operations 36

GET /evaluators/catalog/types/ List Evaluator Catalog Types #
GET /evaluators/catalog/templates/ List Evaluator Catalog Templates #
GET /evaluators/catalog/templates/{template_key} Fetch Evaluator Catalog Template #
GET /evaluators/catalog/templates/{template_key}/presets/ List Evaluator Catalog Presets #
GET /evaluators/catalog/templates/{template_key}/presets/{preset_key} Fetch Evaluator Catalog Preset #
POST /evaluators/ Create Evaluator #
GET /evaluators/{evaluator_id} Fetch Evaluator #
PUT /evaluators/{evaluator_id} Edit Evaluator #
POST /evaluators/{evaluator_id}/archive Archive Evaluator #
POST /evaluators/{evaluator_id}/unarchive Unarchive Evaluator #
POST /evaluators/query Query Evaluators #
POST /evaluators/variants/ Create Evaluator Variant #
GET /evaluators/variants/{evaluator_variant_id} Fetch Evaluator Variant #
PUT /evaluators/variants/{evaluator_variant_id} Edit Evaluator Variant #
POST /evaluators/variants/{evaluator_variant_id}/archive Archive Evaluator Variant #
POST /evaluators/variants/{evaluator_variant_id}/unarchive Unarchive Evaluator Variant #
POST /evaluators/variants/query Query Evaluator Variants #
POST /evaluators/variants/fork Fork Evaluator Variant #
POST /evaluators/revisions/retrieve Retrieve Evaluator Revision #
POST /evaluators/revisions/deploy Deploy Evaluator Revision #
POST /evaluators/revisions/ Create Evaluator Revision #
GET /evaluators/revisions/{evaluator_revision_id} Fetch Evaluator Revision #
PUT /evaluators/revisions/{evaluator_revision_id} Edit Evaluator Revision #
POST /evaluators/revisions/{evaluator_revision_id}/archive Archive Evaluator Revision #
POST /evaluators/revisions/{evaluator_revision_id}/unarchive Unarchive Evaluator Revision #
POST /evaluators/revisions/query Query Evaluator Revisions #
POST /evaluators/revisions/commit Commit Evaluator Revision #
POST /evaluators/revisions/log Log Evaluator Revisions #
POST /evaluators/revisions/resolve Resolve Evaluator Revision #
POST /simple/evaluators/ Create Simple Evaluator #
GET /simple/evaluators/templates List Evaluator Templates #
GET /simple/evaluators/{evaluator_id} Fetch Simple Evaluator #
PUT /simple/evaluators/{evaluator_id} Edit Simple Evaluator #
POST /simple/evaluators/{evaluator_id}/archive Archive Simple Evaluator #
POST /simple/evaluators/{evaluator_id}/unarchive Unarchive Simple Evaluator #
POST /simple/evaluators/query Query Simple Evaluators #

Documentation

📖
Documentation
https://docs.agenta.ai/prompt-engineering/overview
📖
APIReference
https://docs.agenta.ai/reference/api/list-api-endpoints
📖
Documentation
https://docs.agenta.ai/prompt-engineering/integrating-prompts/fetch-prompt-programatically
📖
APIReference
https://docs.agenta.ai/reference/sdk/configuration-management
📖
Documentation
https://docs.agenta.ai/evaluation/overview
📖
APIReference
https://docs.agenta.ai/reference/api/evaluations
📖
Documentation
https://docs.agenta.ai/evaluation/create-test-sets
📖
APIReference
https://docs.agenta.ai/reference/api/testsets
📖
Documentation
https://docs.agenta.ai/observability/overview
📖
APIReference
https://docs.agenta.ai/reference/api/traces

Specifications

⚙
OpenAPI
https://artifacts.apis.io/agenta/openapi/agenta-evaluators-api-openapi.yml

Other Resources

🔗
PostmanCollection
https://artifacts.apis.io/agenta/collections/agenta.postman_collection.json
🔗
OpenCollection
https://artifacts.apis.io/agenta/collections/agenta.opencollection.json

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/agenta:agenta-evaluators-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

agenta-evaluators-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Agenta Evaluators API
  description: Agenta API
  contact:
    name: Agenta
    url: https://agenta.ai/
    email: team@agenta.ai
  version: 0.1.0
servers:
- url: /api
- url: https://eu.cloud.agenta.ai/api
security:
- APIKeyHeader: []
tags:


# --- truncated at 32 KB (129 KB total) ---
# Full source: https://artifacts.apis.io/agenta/openapi/agenta-evaluators-api-openapi.yml