Okareo

Okareo Test Runs & Evaluations API

Run, submit, compare, and inspect evaluation Runs.

GitHub OpenAPI

Operations 17

POST /v0/find_test_runs Find Test Run #
GET /v0/test_runs/{test_run_id} Get Test Run #
PUT /v0/test_runs/{test_run_id} Update Test Run #
GET /v0/test_runs/{test_run_id}/trace_metrics Get Test Run Trace Metrics #
POST /v0/test_runs/compare Compare Test Runs #
DELETE /v0/test_runs Delete Test Run #
POST /v0/test_run Run Test #
POST /v0/test_run/submit Submit Test #
POST /v0/evaluate Evaluate #
POST /v0/test_runs/{test_run_id}/re_evaluate Re Evaluate #
POST /v0/test_runs/{test_run_id}/calibrate_check Calibrate Check #
POST /v0/test_run/create_failure_scenario/{test_run_id} Create Failure Scenario #
POST /v0/test_data_point Add Test Data Point #
GET /v0/test_data_points/{test_data_point_id} Get Test Data Point #
POST /v0/find_test_data_points Find Test Data Points #
POST /v0/update_test_data_point Update Test Data Point #
POST /v0/test_custom_endpoint Test Custom Endpoint #

Specifications

⚙
OpenAPI
https://raw.githubusercontent.com/api-evangelist/okareo/refs/heads/main/openapi/okareo-test-runs-evaluations-api-openapi.yml

Schemas & Data

📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/okareo/refs/heads/main/json-schema/okareo-datapoint-list-item-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/okareo/refs/heads/main/json-schema/okareo-scenario-set-generate-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/okareo/refs/heads/main/json-schema/okareo-datapoint-filter-item-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/okareo/refs/heads/main/json-schema/okareo-driver-model-schema-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/okareo/refs/heads/main/json-schema/okareo-test-run-item-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/okareo/refs/heads/main/json-schema/okareo-test-run-payload-v2-schema.json

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/okareo:okareo-test-runs-evaluations-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

okareo-test-runs-evaluations-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Okareo Test Runs & Evaluations API
  version: 0.1.0
  description: Run, submit, compare, and inspect evaluation Runs.
servers:
- url: https://api.okareo.com
tags:


# --- truncated at 32 KB (67 KB total) ---
# Full source: https://raw.githubusercontent.com/api-evangelist/okareo/refs/heads/main/openapi/okareo-test-runs-evaluations-api-openapi.yml