Scale AI

Scale AI Evaluation Datasets API

The Evaluation Datasets API from Scale AI — 19 operation(s) for evaluation datasets.

GitHub OpenAPI
Business capability
Artificial Intelligence Management BC-610.60

Operations 31

POST /v4/evaluation-datasets/{evaluation_dataset_id}/approve-batch Approve Auto Generated Test Cases Batch #
POST /v4/evaluation-datasets/{evaluation_dataset_id}/autogenerated-draft-test-cases/{autogenerated_draft_test_case_id}/approve Approve Autogenerated Draft Test Case #
POST /v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/batch Batch Create Test Cases #
POST /v4/evaluation-datasets/{evaluation_dataset_id}/generation-jobs/{generation_job_id}/cancel Cancel Evaluation Dataset Generation Job #
POST /v4/evaluation-datasets/{evaluation_dataset_id}/autogenerated-draft-test-cases Create Autogenerated Draft Test Case #
GET /v4/evaluation-datasets/{evaluation_dataset_id}/autogenerated-draft-test-cases List Autogenerated Draft Test Cases #
POST /v4/evaluation-datasets/{evaluation_dataset_id}/generation-jobs Create Evaluation Dataset Generation Job #
GET /v4/evaluation-datasets/{evaluation_dataset_id}/generation-jobs Get Evaluation Dataset Generation Jobs #
POST /v4/evaluation-datasets/{evaluation_dataset_id}/evaluation-dataset-versions Create Evaluation Dataset Version #
GET /v4/evaluation-datasets/{evaluation_dataset_id}/evaluation-dataset-versions List Evaluation Dataset Versions #
POST /v4/evaluation-datasets Create Evaluation Dataset #
GET /v4/evaluation-datasets List Evaluation Datasets #
POST /v4/evaluation-datasets/{evaluation_dataset_id}/test-cases Create Test Case #
GET /v4/evaluation-datasets/{evaluation_dataset_id}/test-cases List Test Cases #
DELETE /v4/evaluation-datasets/{evaluation_dataset_id}/autogenerated-draft-test-cases/{autogenerated_draft_test_case_id} Delete Autogenerated Draft Test Case #
GET /v4/evaluation-datasets/{evaluation_dataset_id}/autogenerated-draft-test-cases/{autogenerated_draft_test_case_id} Get Autogenerated Draft Test Case #
PATCH /v4/evaluation-datasets/{evaluation_dataset_id}/autogenerated-draft-test-cases/{autogenerated_draft_test_case_id} Update Autogenerated Draft Test Case #
DELETE /v4/evaluation-datasets/{evaluation_dataset_id} Delete Evaluation Dataset #
GET /v4/evaluation-datasets/{evaluation_dataset_id} Get Evaluation Dataset #
PATCH /v4/evaluation-datasets/{evaluation_dataset_id} Update Evaluation Dataset #
DELETE /v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/{test_case_id} Delete Test Case #
GET /v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/{test_case_id} Get Test Case #
PATCH /v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/{test_case_id} Update Test Case #
GET /v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/{test_case_id}/history Get All Versions of Test Case #
DELETE /v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/{test_case_id}/history Wipe Full History of Test Cases #
GET /v4/evaluation-datasets/{evaluation_dataset_id}/generation-jobs/{generation_job_id} Get Evaluation Dataset Generation Job #
GET /v4/evaluation-datasets/{evaluation_dataset_id}/evaluation-dataset-versions/{evaluation_dataset_version_id} Get Evaluation Dataset Version #
GET /v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/{test_case_id}/history/{num} Get Historical Test Case #
GET /v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/history/{num} List Historical Test Cases #
POST /v4/evaluation-datasets/{evaluation_dataset_id}/evaluation-dataset-versions/{evaluation_dataset_version_id}/publish Publish Evaluation Dataset Version #
POST /v4/evaluation-datasets/{evaluation_dataset_id}/publish Publish Latest Evaluation Dataset Version #

Documentation

📖
Documentation
https://docs.gp.scale.com/
📖
Documentation
https://scale.com/docs/

Specifications

⚙
OpenAPI
https://artifacts.apis.io/scale-ai/openapi/scale-ai-evaluation-datasets-api-openapi.yml

SDKs

📦
GitHubRepository
https://github.com/scaleapi/scale-agentex
📦
GitHubRepository
https://github.com/scaleapi/llm-engine

Schemas & Data

📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-response-object-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-chat-completion-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-spans-export-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-response-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-spans-by-span-metrics-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-spans-metrics-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-egp-api-backend-server-api-apps-public-routers-inference-inference-model-models-chat-completion-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-chat-completion-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-egp-api-backend-server-utils-model-schemas-completions-chat-completion-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-completion-request-v2-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-execute-agent-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-legacy-evaluation-response-with-views-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-agent-run-schedule-response-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-register-agent-response-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-update-agent-run-schedule-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-agent-run-schedule-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-span-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-span-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-research-job-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-job-entity-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-data-source-entity-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-parse-result-entity-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-file-entity-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-sgpvector-store-create-request-base-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-chat-completion-v2-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-completion-v2-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-model-endpoint-v1-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-update-model-endpoint-v1-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-batch-completions-v2-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-batch-completions-v1-request-schema.json

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/scale-ai:scale-ai-evaluation-datasets-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

scale-ai-evaluation-datasets-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: EGP API V4 Evaluation Datasets API
  description: This is the parent API for all EGP APIs. If you are looking for the EGP API, please go to https://api.egp.scale.com/docs.
  contact:
    name: Scale Generative AI Platform
    url: https://scale.com/genai-platform
  version: 0.1.0
servers:
- url: https://api.egp.scale.com
security: []
tags:


# --- truncated at 32 KB (95 KB total) ---
# Full source: https://artifacts.apis.io/scale-ai/openapi/scale-ai-evaluation-datasets-api-openapi.yml