DataRobot

DataRobot AI Robustness Tests API

The following endpoints outline how to manage AI robustness tests.

GitHub OpenAPI

Operations 40

POST /api/v2/genai/costMetricConfigurations/ Create cost metric configuration #
DELETE /api/v2/genai/costMetricConfigurations/{costMetricConfigurationId}/ Delete cost metric configuration by cost metric configuration ID #
GET /api/v2/genai/costMetricConfigurations/{costMetricConfigurationId}/ Retrieve cost metric configuration by cost metric configuration ID #
PATCH /api/v2/genai/costMetricConfigurations/{costMetricConfigurationId}/ Edit cost metric configuration by cost metric configuration ID #
GET /api/v2/genai/evaluationDatasetConfigurations/ List evaluation dataset configurations #
POST /api/v2/genai/evaluationDatasetConfigurations/ Create evaluation dataset configuration #
DELETE /api/v2/genai/evaluationDatasetConfigurations/{evaluationDatasetConfigurationId}/ Delete evaluation dataset configuration by evaluation dataset configuration ID #
GET /api/v2/genai/evaluationDatasetConfigurations/{evaluationDatasetConfigurationId}/ Retrieve evaluation dataset configuration by evaluation dataset configuration ID #
PATCH /api/v2/genai/evaluationDatasetConfigurations/{evaluationDatasetConfigurationId}/ Edit evaluation dataset configuration by evaluation dataset configuration ID #
DELETE /api/v2/genai/evaluationDatasetMetricAggregations/ Delete evaluation dataset metric aggregation #
GET /api/v2/genai/evaluationDatasetMetricAggregations/ List evaluation dataset metric aggregations #
POST /api/v2/genai/evaluationDatasetMetricAggregations/ Create evaluation dataset metric aggregation #
GET /api/v2/genai/evaluationDatasetMetricAggregations/aggregateByLLMBlueprint/ List evaluation dataset metric aggregations aggregated by llm blueprint #
GET /api/v2/genai/evaluationDatasetMetricAggregations/uniqueFieldValues/{uniqueField}/ List evaluation dataset metric aggregations unique computed metrics by… #
GET /api/v2/genai/llmTestConfigurations/ List LLM test configuration #
POST /api/v2/genai/llmTestConfigurations/ Create LLM test configuration #
GET /api/v2/genai/llmTestConfigurations/nonOotbDatasets/ List non out-of-the-box datasets #
GET /api/v2/genai/llmTestConfigurations/ootbDatasets/ List out-of-the-box datasets #
GET /api/v2/genai/llmTestConfigurations/supportedInsights/ List supported insights #
DELETE /api/v2/genai/llmTestConfigurations/{llmTestConfigurationId}/ Delete LLM test configuration by LLM test configuration ID #
GET /api/v2/genai/llmTestConfigurations/{llmTestConfigurationId}/ Retrieve LLM test configuration by LLM test configuration ID #
PATCH /api/v2/genai/llmTestConfigurations/{llmTestConfigurationId}/ Edit LLM test configuration by LLM test configuration ID #
GET /api/v2/genai/llmTestResults/ List LLM test results #
POST /api/v2/genai/llmTestResults/ Create LLM test result #
DELETE /api/v2/genai/llmTestResults/{llmTestResultId}/ Delete LLM test result by LLM test result ID #
GET /api/v2/genai/llmTestResults/{llmTestResultId}/ Retrieve LLM test result by LLM test result ID #
GET /api/v2/genai/llmTestSuites/ List LLM test suites #
POST /api/v2/genai/llmTestSuites/ Create LLM test suite #
DELETE /api/v2/genai/llmTestSuites/{llmTestSuiteId}/ Delete LLM test suite by LLM test suite ID #
GET /api/v2/genai/llmTestSuites/{llmTestSuiteId}/ Retrieve LLM test suite by LLM test suite ID #
PATCH /api/v2/genai/llmTestSuites/{llmTestSuiteId}/ Edit LLM test suite by LLM test suite ID #
DELETE /api/v2/genai/ootbMetricConfigurations/{ootbMetricConfigurationId}/ Delete OOTB metric configuration by ootb metric configuration ID #
GET /api/v2/genai/ootbMetricConfigurations/{ootbMetricConfigurationId}/ Get OOTB metric configuration by ootb metric configuration ID #
GET /api/v2/genai/sidecarModelMetricValidations/ List sidecar model metric validations #
POST /api/v2/genai/sidecarModelMetricValidations/ Validate sidecar model metric #
DELETE /api/v2/genai/sidecarModelMetricValidations/{validationId}/ Delete sidecar model metric validation by validation ID #
GET /api/v2/genai/sidecarModelMetricValidations/{validationId}/ Retrieve sidecar model metric validation status by validation ID #
PATCH /api/v2/genai/sidecarModelMetricValidations/{validationId}/ Edit sidecar model metric validation by validation ID #
POST /api/v2/genai/sidecarModelMetricValidations/{validationId}/revalidate/ Revalidate sidecar model metric by validation ID #
POST /api/v2/genai/syntheticEvaluationDatasetGenerations/ Generate synthetic evaluation dataset #

Specifications

⚙
OpenAPI
https://artifacts.apis.io/datarobot/openapi/datarobot-ai-robustness-tests-api-openapi.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/datarobot:datarobot-ai-robustness-tests-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

datarobot-ai-robustness-tests-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  contact:
    email: support@datarobot.com
    name: DataRobot Support
    url: https://support.datarobot.com
  description: DataRobot's Public facing API
  license:
    name: DataRobot Tool and Utility Agreement
    url: https://www.datarobot.com/wp-content/uploads/2021/07/DataRobot-Tool-and-Utility-Agreement.pdf
  title: Public AI Robustness Tests API
  version: 2.49.0
  x-datarobot-release-version: Latest
servers:
- url: https://app.datarobot.com/
security:
- BearerAuth: []
tags:


# --- truncated at 32 KB (181 KB total) ---
# Full source: https://artifacts.apis.io/datarobot/openapi/datarobot-ai-robustness-tests-api-openapi.yml