ArthurAI

ArthurAI Continuous Evals API

The Continuous Evals API from ArthurAI — 6 operation(s) for continuous evals.

GitHub OpenAPI
Business capability
Artificial Intelligence Management BC-610.60

Operations 9

GET /api/v1/continuous_evals/{eval_id} Get a continuous eval by id #
PATCH /api/v1/continuous_evals/{eval_id} Update a continuous eval #
DELETE /api/v1/continuous_evals/{eval_id} Delete a continuous eval #
GET /api/v1/tasks/{task_id}/continuous_evals Get all continuous evals for a specific task #
POST /api/v1/tasks/{task_id}/continuous_evals Create a continuous eval #
GET /api/v1/tasks/{task_id}/continuous_evals/results Get all continuous eval run results for a specific task #
GET /api/v1/tasks/{task_id}/continuous_evals/transforms/{transform_id}/llm_evals/{eval_name}/versions/{eval_version}/variables Get all variables and mappings for a continuous eval #
POST /api/v1/continuous_evals/results/{run_id}/rerun Rerun a failed continuous eval #
GET /api/v1/tasks/{task_id}/continuous_evals/analytics/daily Get daily aggregated analytics for agentic annotations #

Specifications

⚙
OpenAPI
https://raw.githubusercontent.com/api-evangelist/arthurai/refs/heads/main/openapi/arthurai-continuous-evals-api-openapi.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/arthurai:arthurai-continuous-evals-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

arthurai-continuous-evals-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Arthur GenAI Engine Continuous Evals API
  version: 2.1.688
tags:


# --- truncated at 32 KB (33 KB total) ---
# Full source: https://raw.githubusercontent.com/api-evangelist/arthurai/refs/heads/main/openapi/arthurai-continuous-evals-api-openapi.yml