Altimate AI

Altimate AI EVALS API

The EVALS API from Altimate AI — 18 operation(s) for evals.

GitHub OpenAPI

Operations 23

GET /evals/test-cases List Test Cases #
POST /evals/test-cases Create Test Case #
GET /evals/test-cases/{test_case_id} Get Test Case #
DELETE /evals/test-cases/{test_case_id} Delete Test Case #
POST /evals/test-cases/{test_case_id}/update Update Test Case #
POST /evals/run Run Eval #
POST /evals/batch-run Batch Run Eval #
GET /evals/results List Results #
GET /evals/results/{result_id} Get Result #
DELETE /evals/results/{result_id} Delete Result #
GET /evals/criterions List Criterions #
POST /evals/criterions Create Criterion #
GET /evals/criterions/{criterion_id} Get Criterion #
DELETE /evals/criterions/{criterion_id} Delete Criterion #
POST /evals/criterions/{criterion_id}/update Update Criterion #
GET /evals/agents Get Playground Agents #
GET /evals/agents/{agent_name} Get Playground Agent Details #
POST /evals/agents/{agent_name}/update Update Playground Agent #
GET /evals/agents/{agent_name}/versions Get Agent Versions #
GET /evals/agents/{agent_name}/versions/{version} Get Agent Version #
GET /evals/models Get Available Models #
POST /evals/evaluate Run Batch Evaluation #
GET /evals/jobs/{job_id}/status Get Job Status #

Documentation

📖
Documentation
https://help.altimate.ai/
📖
APIReference
https://api.myaltimate.com/docs

Specifications

⚙
OpenAPI
https://raw.githubusercontent.com/api-evangelist/altimate-ai/refs/heads/main/openapi/altimate-ai-evals-api-openapi.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/altimate-ai-evals-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

altimate-ai-evals-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Fast EVALS API
  version: 0.1.0
tags:


# --- truncated at 32 KB (41 KB total) ---
# Full source: https://raw.githubusercontent.com/api-evangelist/altimate-ai/refs/heads/main/openapi/altimate-ai-evals-api-openapi.yml