Scale AI

Scale AI Evaluations API

The Evaluations API from Scale AI — 25 operation(s) for evaluations.

Documentation GitHub OpenAPI

Business capability

Artificial Intelligence Management BC-610.60

Operations 33

PATCH /v4/evaluations/{evaluation_id}/tasks/batch-assign Batch assign tasks to user #

POST /v4/evaluations/{evaluation_id}/test-case-results/batch Batch Create Test Case Results #

POST /v4/evaluations/{evaluation_id}/claim-task Claim Evaluation Task #

POST /v4/evaluations Create Evaluation #

GET /v4/evaluations List Evaluations #

POST /v4/evaluations/{evaluation_id}/test-case-results Create Test Case Result #

GET /v4/evaluations/{evaluation_id}/test-case-results List Test Case Results #

DELETE /v4/evaluations/{evaluation_id} Delete Evaluation #

GET /v4/evaluations/{evaluation_id} Get Evaluation #

PATCH /v4/evaluations/{evaluation_id} Update Evaluation #

GET /v4/evaluations/{evaluation_id}/test-case-results/{test_case_result_id}/history Get All Versions of Test Case Result #

GET /v4/evaluations/{evaluation_id}/contributor-metrics/{contributor_id} Get Contributor Metrics #

GET /v4/evaluations/{evaluation_id}/evaluation-metrics Get Evaluation Metrics #

GET /v4/evaluations/{evaluation_id}/test-case-results/{test_case_result_id}/history/{num} Get Historical Test Case Result #

GET /v4/evaluations/{evaluation_id}/hybrid-eval-metrics Get Hybrid Evaluation Metrics #

GET /v4/evaluations/{evaluation_id}/test-case-results/{test_case_result_id} Get Test Case Result #

PATCH /v4/evaluations/{evaluation_id}/test-case-results/{test_case_result_id} Update Test Case Result #

GET /v4/evaluations/{evaluation_id}/contributor-metrics List Contributor Metrics #

GET /v4/evaluations/{evaluation_id}/test-case-results/history/{num} List Historical Test Case Results #

PATCH /v4/evaluations/{evaluation_id}/tasks/{task_id} Update Evaluation Task #

POST /v5/evaluations/{evaluation_id}/tasks Add Test Criteria to Evaluation #

DELETE /v5/evaluations/{evaluation_id} Archive Evaluation #

GET /v5/evaluations/{evaluation_id} Get Evaluation #

PATCH /v5/evaluations/{evaluation_id} Update or Restore Evaluation #

POST /v5/evaluations Create Evaluation #

GET /v5/evaluations List Evaluations #

POST /v5/evaluations/tasks/dry-run Dry-run a custom-function evaluation task #

POST /v5/evaluations/filter Filter Evaluations #

GET /v5/evaluations/statuses Get Available Evaluation Statuses #

GET /v5/evaluations/metadata-keys Get Available Metadata Keys #

GET /v5/evaluations/{evaluation_id}/schema Get Evaluation Data Schema #

GET /v5/evaluations/{evaluation_id}/taxonomy Get Evaluation Taxonomy #

PATCH /v5/evaluations/{evaluation_id}/tasks/{alias} Update Test Criteria Configuration #

Documentation

https://docs.gp.scale.com/

https://scale.com/docs/

Specifications

https://artifacts.apis.io/scale-ai/openapi/scale-ai-evaluations-api-openapi.yml

SDKs

GitHubRepository

https://github.com/scaleapi/scale-agentex

GitHubRepository

https://github.com/scaleapi/llm-engine

Schemas & Data

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-response-object-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-chat-completion-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-spans-export-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-response-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-spans-by-span-metrics-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-spans-metrics-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-egp-api-backend-server-api-apps-public-routers-inference-inference-model-models-chat-completion-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-chat-completion-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-egp-api-backend-server-utils-model-schemas-completions-chat-completion-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-completion-request-v2-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-execute-agent-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-legacy-evaluation-response-with-views-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-agent-run-schedule-response-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-register-agent-response-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-update-agent-run-schedule-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-agent-run-schedule-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-span-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-span-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-research-job-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-job-entity-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-data-source-entity-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-parse-result-entity-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-file-entity-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-sgpvector-store-create-request-base-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-chat-completion-v2-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-completion-v2-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-model-endpoint-v1-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-update-model-endpoint-v1-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-batch-completions-v2-request-schema.json

https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-batch-completions-v1-request-schema.json

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this

find_apisBrowse and filter every API in the catalog.
get_api_artifactsOne API's artifacts, grouped by type.
get_openapiThe primary OpenAPI for this API.
find_similar_apisAPIs that look like this one.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This API

curl "https://apis.io/api/v1/apis/scale-ai:scale-ai-evaluations-api"

All apis

curl "https://apis.io/api/v1/apis?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

openapi: 3.2.0
info:
  title: Scale Ai Evaluations API
  version: 0.1.0
  contact:
    name: Scale Generative AI Platform
    url: https://scale.com/genai-platform
  description: 'Operations tagged Evaluations across 2 of this provider''s published API definitions: scale-ai-sgp-v4-openapi.json, scale-ai-sgp-v5-openapi.json. Each path carries the servers of the definition it was published in.'
servers:
- url: https://api.egp.scale.com
security: []
tags:


# --- truncated at 32 KB (236 KB total) ---
# Full source: https://artifacts.apis.io/scale-ai/openapi/scale-ai-evaluations-api-openapi.yml