Microsoft Azure AI Foundry

Microsoft Azure AI Foundry Evals API

The Evals API from Microsoft Azure AI Foundry — 6 operation(s) for evals.

GitHub OpenAPI

Operations 12

GET /openai/evals List all evaluations #
POST /openai/evals Create evaluation #
GET /openai/evals/{eval_id} Get an evaluation #
POST /openai/evals/{eval_id} Update an evaluation #
DELETE /openai/evals/{eval_id} Delete an evaluation #
GET /openai/evals/{eval_id}/runs Get a list of runs for an evaluation #
POST /openai/evals/{eval_id}/runs Create evaluation run #
GET /openai/evals/{eval_id}/runs/{run_id} Get an evaluation run #
POST /openai/evals/{eval_id}/runs/{run_id} Cancel evaluation run #
DELETE /openai/evals/{eval_id}/runs/{run_id} Delete evaluation run #
GET /openai/evals/{eval_id}/runs/{run_id}/output_items Get evaluation run output items #
GET /openai/evals/{eval_id}/runs/{run_id}/output_items/{output_item_id} Get an output item of an evaluation run #

Documentation

📖
Documentation
https://learn.microsoft.com/en-us/rest/api/azureml/
📖
APIReference
https://learn.microsoft.com/en-us/azure/ai-foundry/
📖
Authentication
https://learn.microsoft.com/en-us/azure/ai-foundry/concepts/rbac-azure-ai-foundry
📖
Documentation
https://learn.microsoft.com/en-us/azure/foundry/foundry-models/how-to/use-foundry-models-microsoft-decision

Specifications

⚙
OpenAPI
https://artifacts.apis.io/azure-ai-foundry/openapi/azure-ai-foundry-evals-api-openapi.yml

Schemas & Data

📊
JSONSchema
https://artifacts.apis.io/azure-ai-foundry/json-schema/azure-ai-foundry-eval-run-schema.json
📊
JSONSchema
https://artifacts.apis.io/azure-ai-foundry/json-schema/azure-ai-foundry-eval-run-output-item-schema.json
📊
JSONSchema
https://artifacts.apis.io/azure-ai-foundry/json-schema/azure-ai-foundry-eval-schema.json
📊
JSONSchema
https://artifacts.apis.io/azure-ai-foundry/json-schema/azure-ai-foundry-create-eval-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/azure-ai-foundry/json-schema/azure-ai-foundry-create-eval-run-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/azure-ai-foundry/json-schema/azure-ai-foundry-update-eval-parameters-body-schema.json

Other Resources

🔗
SDKs
https://github.com/Azure/azure-sdk-for-python/tree/main/sdk/ai
🔗
Blog
https://commandline.microsoft.com/microsoft-decision-1-model-foundry/

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/azure-ai-foundry:azure-ai-foundry-evals-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

azure-ai-foundry-evals-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Azure AI Evals API
  version: v1
  x-typespec-generated:
  - emitter: '@azure-tools/typespec-autorest'
security:
- OAuth2Auth:
  - https://ai.azure.com/.default
tags:


# --- truncated at 32 KB (46 KB total) ---
# Full source: https://artifacts.apis.io/azure-ai-foundry/openapi/azure-ai-foundry-evals-api-openapi.yml