emerging · 0.3 capability resource

Evaluation

Score 22.7 / 100 47 providers +41 via APIs 62 APIs Search apis.io →
Workflows using this tag
Cloudflare Replace Page Rule · Cloudflare Cloudflare Configure SSL Mode · Cloudflare Cloudflare Create and Activate Zone · Cloudflare Cloudflare Create Firewall Rule · Cloudflare Cloudflare Provision Zone with DNS · Cloudflare Cloudflare Upload Custom SSL Certificate · Cloudflare Cloudflare Rotate Worker · Cloudflare Cloudflare Rotate Page Rule · Cloudflare
Business capabilities this tag reaches
Software Release & Deployment Management 3 Information & Data Management 3 Agent Infrastructure & Agentic Commerce 1 Software Product Engineering Management 1
Variants seen in the corpus: EvaluationsEvaluation

Providers using this tag (47)

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Strong 4 Solid coverage with minor gaps
Developing 8 Usable, with meaningful gaps to close
Thin 20 Limited public surface area
Emerging 11 Early or largely undocumented
Minimal 4 Almost no public developer surface

APIs with this tag (60)

Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →

Exemplar 9 Complete, well-documented, and agent-ready
Strong 7 Solid coverage with minor gaps
Developing 14 Usable, with meaningful gaps to close
Alloy Evaluations APIRun, retrieve, and audit identity, KYC, KYB, AML, fraud, and credit evaluations.52.8Authenticx Evaluations APIThe Evaluations API from Authenticx — 2 operation(s) for evaluations.51.0Braintrust APIThe Braintrust REST API provides programmatic access to projects, experiments, datasets, prompts, functions...50.0Laminar Evaluations APIThe lower-level LaminarClient.evals surface for wiring evaluations into an existing pipeline: create an eva...47.7Avito Evaluation APIThe Evaluation API from Avito — 5 operation(s) for evaluation.47.1Qlik Evaluation APIThe evaluation API from Qlik — 5 operation(s) for evaluation.45.5Understudy Control Plane APIREST surface behind the dashboard and CLI, served from the gateway host under /admin/v1 and /customer/v1, o...44.4Convai Evaluation APIThe Evaluation API from Convai — 1 operation(s) for evaluation.43.3Interfolio Evaluations APIRetrieve details of users' evaluations.42.9Eigenpal Evaluation APIManage datasets, examples, evaluators, experiment batches, evaluator scores, and run promotion workflows.41.8HashiCorp Nomad Evaluations APIEndpoints for querying evaluations. Evaluations are the mechanism by which Nomad makes scheduling decisions.41.8Split Evaluation APIEndpoints for evaluating feature flags and retrieving treatment values for given keys and feature flag names.41.6Vellum LLM Platform APIThe Vellum REST API exposes prompts, workflows, evaluations, datasets, document indexes, deployments, and e...41.0Workable Evaluations APISubmit and read interviewer evaluations and scorecards aligned to the job's interview kit.40.0
Thin 23 Limited public surface area
AmeriCorps Open Data SODA APIThe AmeriCorps Open Data portal provides programmatic access to AmeriCorps research, evaluation, and progra...37.8AlyxAlyx is Arize's AI engineering agent that helps developers debug traces, create evaluators, build dashboard...37.0Arize AXArize AX is the commercial AI engineering platform covering tracing, evaluation, experiments, prompt manage...37.0PhoenixPhoenix is Arize's open-source LLM observability platform offering local tracing, evaluation, experiments, ...37.0EvaluationPlatform and SDK capabilities for assessing model performance across data splits, running error and slice a...36.8Trakstar Evaluations APIManage candidate evaluations36.8Docling EvalEnd-to-end evaluation framework for document parsing models and services. Provides standard datasets and me...36.2GentraceGentrace was an AI evaluation and observability product; the company has shut down and its codebase is now ...35.9Agenta Evaluations APIRun evaluations of variants against testsets.35.3BigML Evaluations APIEvaluate model performance against a test dataset35.3LiteLLM Evals APIProvides /evals endpoints for the Evaluations API, enabling measurement and benchmarking of model performan...35.2Together AI Evaluation APIThe evaluation API from Together AI — 4 operation(s) for evaluation.34.8Log10 Evaluation APIAPI for running automated evaluations and benchmarking logged completions across multiple LLM providers, ge...33.3Log10 Feedback APIFeedback33.3Humanloop LLM Platform APIThe Humanloop REST API and SDKs covered prompts, tools, datasets, evaluations, evaluators, and logs for LLM...32.8Clarifai Evaluations APIThe Evaluations API from Clarifai — 2 operation(s) for evaluations.32.3AIMon APIREST API for AIMon LLM monitoring and evaluation — manage users, models, applications, evaluations and eval...32.2W&B Weave (LLM Observability)LLM observability and evaluation platform providing tracing, output evaluation, cost estimation, prompt pla...32.1Tonic ValidateTonic Validate is an open-source RAG evaluation framework and metrics platform for measuring retrieval-augm...30.3Maxim AI APIThe Maxim REST API provides programmatic access to prompts, workflows, agents, datasets, evaluators, test r...29.3Athina AI Evaluations APIRun evaluations against datasets and logged inferences.28.7Lunary APIREST API for Lunary covering ingestion (logs/traces), prompts (template management with versions and labels...27.6UpTrain Evaluation APIThe Evaluation API from UpTrain — 3 operation(s) for evaluation.26.7
Emerging 7 Early or largely undocumented

Companies reaching this through an API (41)

These companies publish an API, specification or operation carrying “Evaluation” but do not classify their business under it. Listed unranked and kept out of the count above, because one tagged operation is not a statement about what a company does.

8x8 Agenta AI Gateway Alloy AmeriCorps Amigo Amplitude Authenticx Avito BigML Buk Clarifai Cloudflare Comet Confident AI Convai Docling Eigenpal Google Dialogflow Gumloop Harness HashiCorp Nomad Interfolio LiteLLM Lunary n8n Observe.AI OpenAI Oxen Patronus AI Qlik Qlik Sense Ragas Rapidata Split Together AI Tonic.ai Trakstar USAID Workable Zoom

Score breakdown

Frequency
58.2
log-scaled weighted occurrences
Breadth
1.1
spread across providers
Quality lift
33.1
mean composite of providers using it
Cohesion
8.2
strength of nearest seed neighbor

Related tags

Tracing 15 co-occurrences Prompts 12 co-occurrences Experiments 12 co-occurrences Benchmarks 10 co-occurrences LLM 35 co-occurrences Datasets 24 co-occurrences LLM Observability 7 co-occurrences

Where this tag comes from

Api tag62
Provider tag52
Openapi tag23
Openapi op tag77

Work with this as data

Every tag here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for tags

7 MCP tools reach this
  • find_tagsBrowse and filter every tag in the catalog.
  • get_cohortThis tag as a scored cohort — every provider carrying it, with scores.
  • cohort_statsPRO — the distribution across this tag: mean, median, band split, adoption rates.
  • cohort_rankingsPRO — the leaderboard, on composite AND agent-readiness axes.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This tag
curl "https://apis.io/api/v1/tags/evaluation"
All tags
curl "https://apis.io/api/v1/tags?limit=25"
As a scored cohort
curl "https://apis.io/api/v1/cohorts/tag/evaluation"
The distribution (Pro)
curl "https://apis.io/api/v1/cohorts/tag/evaluation/stats" \
  -H "X-API-Key: $APIS_IO_KEY"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.