# Scale AI Evaluation Datasets API **Canonical:** https://apis.io/apis/scale-ai/scale-ai-evaluation-datasets-api/ **Provider:** Scale AI — https://apis.io/providers/scale-ai/ **Base URL:** https://api.egp.scale.com **Documentation:** https://api-reference.scale.com Scale AI Evaluation Datasets API is one of 94 APIs that [Scale AI](https://apis.io/providers/scale-ai/) publishes on the [APIs.io](https://apis.io/) network, described by a machine-readable OpenAPI specification. This API exposes 30 JSON Schema definitions. Tagged areas include Evaluation Datasets. The published artifact set on APIs.io includes an OpenAPI specification, API documentation, a GitHub repository, and 30 JSON Schemas. The Evaluation Datasets API from Scale AI — 19 operation(s) for evaluation datasets. ## Operations (31) | Method | Path | Summary | |---|---|---| | POST | `/v4/evaluation-datasets/{evaluation_dataset_id}/approve-batch` | Approve Auto Generated Test Cases Batch | | POST | `/v4/evaluation-datasets/{evaluation_dataset_id}/autogenerated-draft-test-cases/{autogenerated_draft_test_case_id}/approve` | Approve Autogenerated Draft Test Case | | POST | `/v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/batch` | Batch Create Test Cases | | POST | `/v4/evaluation-datasets/{evaluation_dataset_id}/generation-jobs/{generation_job_id}/cancel` | Cancel Evaluation Dataset Generation Job | | POST | `/v4/evaluation-datasets/{evaluation_dataset_id}/autogenerated-draft-test-cases` | Create Autogenerated Draft Test Case | | GET | `/v4/evaluation-datasets/{evaluation_dataset_id}/autogenerated-draft-test-cases` | List Autogenerated Draft Test Cases | | POST | `/v4/evaluation-datasets/{evaluation_dataset_id}/generation-jobs` | Create Evaluation Dataset Generation Job | | GET | `/v4/evaluation-datasets/{evaluation_dataset_id}/generation-jobs` | Get Evaluation Dataset Generation Jobs | | POST | `/v4/evaluation-datasets/{evaluation_dataset_id}/evaluation-dataset-versions` | Create Evaluation Dataset Version | | GET | `/v4/evaluation-datasets/{evaluation_dataset_id}/evaluation-dataset-versions` | List Evaluation Dataset Versions | | POST | `/v4/evaluation-datasets` | Create Evaluation Dataset | | GET | `/v4/evaluation-datasets` | List Evaluation Datasets | | POST | `/v4/evaluation-datasets/{evaluation_dataset_id}/test-cases` | Create Test Case | | GET | `/v4/evaluation-datasets/{evaluation_dataset_id}/test-cases` | List Test Cases | | DELETE | `/v4/evaluation-datasets/{evaluation_dataset_id}/autogenerated-draft-test-cases/{autogenerated_draft_test_case_id}` | Delete Autogenerated Draft Test Case | | GET | `/v4/evaluation-datasets/{evaluation_dataset_id}/autogenerated-draft-test-cases/{autogenerated_draft_test_case_id}` | Get Autogenerated Draft Test Case | | PATCH | `/v4/evaluation-datasets/{evaluation_dataset_id}/autogenerated-draft-test-cases/{autogenerated_draft_test_case_id}` | Update Autogenerated Draft Test Case | | DELETE | `/v4/evaluation-datasets/{evaluation_dataset_id}` | Delete Evaluation Dataset | | GET | `/v4/evaluation-datasets/{evaluation_dataset_id}` | Get Evaluation Dataset | | PATCH | `/v4/evaluation-datasets/{evaluation_dataset_id}` | Update Evaluation Dataset | | DELETE | `/v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/{test_case_id}` | Delete Test Case | | GET | `/v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/{test_case_id}` | Get Test Case | | PATCH | `/v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/{test_case_id}` | Update Test Case | | GET | `/v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/{test_case_id}/history` | Get All Versions of Test Case | | DELETE | `/v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/{test_case_id}/history` | Wipe Full History of Test Cases | | GET | `/v4/evaluation-datasets/{evaluation_dataset_id}/generation-jobs/{generation_job_id}` | Get Evaluation Dataset Generation Job | | GET | `/v4/evaluation-datasets/{evaluation_dataset_id}/evaluation-dataset-versions/{evaluation_dataset_version_id}` | Get Evaluation Dataset Version | | GET | `/v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/{test_case_id}/history/{num}` | Get Historical Test Case | | GET | `/v4/evaluation-datasets/{evaluation_dataset_id}/test-cases/history/{num}` | List Historical Test Cases | | POST | `/v4/evaluation-datasets/{evaluation_dataset_id}/evaluation-dataset-versions/{evaluation_dataset_version_id}/publish` | Publish Evaluation Dataset Version | | POST | `/v4/evaluation-datasets/{evaluation_dataset_id}/publish` | Publish Latest Evaluation Dataset Version | ## Machine-readable artifacts (35) - **OpenAPI** — https://artifacts.apis.io/scale-ai/openapi/scale-ai-evaluation-datasets-api-openapi.yml - **Documentation** — https://docs.gp.scale.com/ - **Documentation** — https://scale.com/docs/ - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-response-object-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-chat-completion-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-spans-export-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-response-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-spans-by-span-metrics-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-spans-metrics-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-egp-api-backend-server-api-apps-public-routers-inference-inference-model-models-chat-completion-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-chat-completion-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-egp-api-backend-server-utils-model-schemas-completions-chat-completion-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-completion-request-v2-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-execute-agent-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-legacy-evaluation-response-with-views-schema.json - **GitHubRepository** — https://github.com/scaleapi/scale-agentex - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-agent-run-schedule-response-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-register-agent-response-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-update-agent-run-schedule-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-agent-run-schedule-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-span-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-span-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-research-job-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-job-entity-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-data-source-entity-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-parse-result-entity-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-file-entity-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-sgpvector-store-create-request-base-schema.json - **GitHubRepository** — https://github.com/scaleapi/llm-engine - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-chat-completion-v2-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-completion-v2-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-model-endpoint-v1-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-update-model-endpoint-v1-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-batch-completions-v2-request-schema.json - **JSONSchema** — https://artifacts.apis.io/scale-ai/json-schema/scale-ai-create-batch-completions-v1-request-schema.json ## Other Scale AI APIs (12) - [Scale REST API](https://apis.io/apis/scale-ai/scale-rest-api/) - [Scale GenAI Data Engine](https://apis.io/apis/scale-ai/scale-genai-data-engine/) - [Scale Automotive Data Engine](https://apis.io/apis/scale-ai/scale-automotive-data-engine/) - [Scale Nucleus](https://apis.io/apis/scale-ai/scale-nucleus/) - [Scale Donovan](https://apis.io/apis/scale-ai/scale-donovan/) - [Scale AI Batches API](https://apis.io/apis/scale-ai/scale-ai-batches-api/) - [Scale AI Projects API](https://apis.io/apis/scale-ai/scale-ai-projects-api/) - [Scale AI Tasks API](https://apis.io/apis/scale-ai/scale-ai-tasks-api/) - [Scale AI account groups API](https://apis.io/apis/scale-ai/scale-ai-account-groups-api/) - [Scale AI Accounts API](https://apis.io/apis/scale-ai/scale-ai-accounts-api/) - [Scale AI Agent APIKeys API](https://apis.io/apis/scale-ai/scale-ai-agent-apikeys-api/) - [Scale AI Agent Configs API](https://apis.io/apis/scale-ai/scale-ai-agent-configs-api/) ## Tags Evaluation Datasets --- Profiled by [API Evangelist](https://apievangelist.com) and published on [APIs.io](https://apis.io/apis/scale-ai/scale-ai-evaluation-datasets-api/). The API's provider profile, Kin Score and agent-readiness rating are at https://apis.io/providers/scale-ai/.