Airia

Airia Agent Evaluation API

The AgentEvaluation API from Airia — 17 operation(s) for agentevaluation.

GitHub OpenAPI
Business capability
Artificial Intelligence Management BC-610.60

Operations 23

GET /v1/AgentEvaluation/{id} Agent evaluation get #
DELETE /v1/AgentEvaluation/{id} Agent evaluation delete agent evaluation #
GET /v1/AgentEvaluation/airia-evaluators Agent evaluation list airia evaluators #
POST /v1/AgentEvaluation/Clone/{id} Agent evaluation clone #
GET /v1/AgentEvaluation/Results Agent evaluation get evaluations result #
GET /v1/AgentEvaluation/target-summary Agent evaluation get evaluation target summary #
GET /v1/AgentEvaluation/AggregatedResults/{evaluationJobId} Agent evaluation get aggregated results #
GET /v1/AgentEvaluation/DetailedResults/{evaluationJobId}/{agentVersionId} Agent evaluation get detailed results #
GET /v1/AgentEvaluation/DetailedResults/{evaluationJobId}/{agentVersionId}/export/csv Agent evaluation export detailed results as csv #
GET /v1/AgentEvaluation/ComparisonResults/{evaluationJobId} Agent evaluation get comparison results #
POST /v1/AgentEvaluation Agent evaluation create #
GET /v1/AgentEvaluation/Dataset/{evaluationId} Agent evaluation get dataset #
POST /v1/AgentEvaluation/{evaluationId}/Schedule Agent evaluation create schedule #
GET /v1/AgentEvaluation/{evaluationId}/Schedule Agent evaluation get schedule #
PUT /v1/AgentEvaluation/{evaluationId}/Schedule Agent evaluation update schedule #
DELETE /v1/AgentEvaluation/{evaluationId}/Schedule Agent evaluation delete schedule #
GET /v1/AgentEvaluation/{evaluationId}/Thresholds Agent evaluation get thresholds #
PUT /v1/AgentEvaluation/{evaluationId}/Thresholds Agent evaluation upsert thresholds #
DELETE /v1/AgentEvaluation/{evaluationId}/Thresholds Agent evaluation delete thresholds #
POST /v1/AgentEvaluation/{id}/run Agent evaluation run #
GET /v1/AgentEvaluation/{id}/evaluator-runs Agent evaluation get evaluator runs #
GET /v1/AgentEvaluation/{id}/evaluator-runs/comparison Agent evaluation get evaluator runs comparison #
GET /v1/AgentEvaluation/evaluation-limit Agent evaluation check evaluation limit #

Documentation

📖
APIReference
https://api.airia.ai/docs/
📖
Documentation
https://airia.ai/docs/build/interface-options/api-deployment
📖
Authentication
https://raw.githubusercontent.com/api-evangelist/airia/refs/heads/main/authentication/airia-authentication.yml

Specifications

⚙
OpenAPI
https://raw.githubusercontent.com/api-evangelist/airia/refs/heads/main/openapi/airia-agentevaluation-api-openapi.yml

Other Resources

🔗
ErrorCatalog
https://raw.githubusercontent.com/api-evangelist/airia/refs/heads/main/errors/airia-problem-types.yml
🔗
Conventions
https://raw.githubusercontent.com/api-evangelist/airia/refs/heads/main/conventions/airia-conventions.yml
🔗
DataModel
https://raw.githubusercontent.com/api-evangelist/airia/refs/heads/main/data-model/airia-data-model.yml
🔗
Webhooks
https://raw.githubusercontent.com/api-evangelist/airia/refs/heads/main/asyncapi/airia-webhooks.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/airia:airia-agentevaluation-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

airia-agentevaluation-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Airia Web Agent Evaluation API
  version: 1.0.0
servers:
- url: https://api.airia.ai
tags:


# --- truncated at 32 KB (82 KB total) ---
# Full source: https://raw.githubusercontent.com/api-evangelist/airia/refs/heads/main/openapi/airia-agentevaluation-api-openapi.yml