emerging · -2.4 capabilitymarket actiondomainresource

Evaluation

Score 20.9 / 100 62 providers +50 via APIs 70 APIs Search apis.io →
Workflows using this tag
Cloudflare Replace Page Rule · Cloudflare Cloudflare Configure SSL Mode · Cloudflare Cloudflare Create and Activate Zone · Cloudflare Cloudflare Create Firewall Rule · Cloudflare Cloudflare Provision Zone with DNS · Cloudflare Cloudflare Upload Custom SSL Certificate · Cloudflare Cloudflare Rotate Worker · Cloudflare Cloudflare Rotate Page Rule · Cloudflare
Business capabilities this tag reaches
Software Release & Deployment Management 3 Information & Data Management 3 Agent Infrastructure & Agentic Commerce 1 Software Product Engineering Management 1
Variants seen in the corpus: EvaluationsEvaluation

Providers using this tag (62)

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 1 Complete, well-documented, and agent-ready
Strong 6 Solid coverage with minor gaps
Developing 11 Usable, with meaningful gaps to close
Thin 23 Limited public surface area
Emerging 15 Early or largely undocumented
Minimal 6 Almost no public developer surface

APIs with this tag (70)

Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →

Exemplar 11 Complete, well-documented, and agent-ready
Strong 12 Solid coverage with minor gaps
Developing 17 Usable, with meaningful gaps to close
CompTeam Evaluations APIThe Evaluations API from CompTeam — 5 operation(s) for evaluations.53.5Alloy Evaluations APIRun, retrieve, and audit identity, KYC, KYB, AML, fraud, and credit evaluations.52.6Oxen Evaluations APIThe evaluations API from Oxen — 2 operation(s) for evaluations.51.5Avito Evaluation APIThe Evaluation API from Avito — 5 operation(s) for evaluation.51.1100Hires Evaluations APIFilled evaluation forms with scores and answers submitted by interviewers for applications.50.8forecall-dev Evaluations APIThe Evaluations API from forecall-dev — 1 operation(s) for evaluations.49.0Laminar Evaluations APIThe lower-level LaminarClient.evals surface for wiring evaluations into an existing pipeline: create an eva...47.2Understudy Control Plane APIREST surface behind the dashboard and CLI, served from the gateway host under /admin/v1 and /customer/v1, o...46.6Braintrust APIThe Braintrust REST API provides programmatic access to projects, experiments, datasets, prompts, functions...45.7Eigenpal Evaluation APIManage datasets, examples, evaluators, experiment batches, evaluator scores, and run promotion workflows.43.5Convai Evaluation APIThe Evaluation API from Convai — 1 operation(s) for evaluation.41.2Qlik Evaluation APIThe evaluation API from Qlik — 5 operation(s) for evaluation.40.8HashiCorp Nomad Evaluations APIEndpoints for querying evaluations. Evaluations are the mechanism by which Nomad makes scheduling decisions.40.7Interfolio Evaluations APIRetrieve details of users' evaluations.40.5AmeriCorps Open Data SODA APIThe AmeriCorps Open Data portal provides programmatic access to AmeriCorps research, evaluation, and progra...40.2Last Mile AI Evaluation APIThe Evaluation API from Last Mile AI — 8 operation(s) for evaluation.39.6EvaluationPlatform and SDK capabilities for assessing model performance across data splits, running error and slice a...39.3
Thin 23 Limited public surface area
Agenta Evaluations APIRun evaluations of variants against testsets.38.1W&B Weave (LLM Observability)LLM observability and evaluation platform providing tracing, output evaluation, cost estimation, prompt pla...38.1Docling EvalEnd-to-end evaluation framework for document parsing models and services. Provides standard datasets and me...37.9GentraceGentrace was an AI evaluation and observability product; the company has shut down and its codebase is now ...37.8Workable Evaluations APISubmit and read interviewer evaluations and scorecards aligned to the job's interview kit.37.4Vellum LLM Platform APIThe Vellum REST API exposes prompts, workflows, evaluations, datasets, document indexes, deployments, and e...37.3AlyxAlyx is Arize's AI engineering agent that helps developers debug traces, create evaluators, build dashboard...36.6Arize AXArize AX is the commercial AI engineering platform covering tracing, evaluation, experiments, prompt manage...36.6PhoenixPhoenix is Arize's open-source LLM observability platform offering local tracing, evaluation, experiments, ...36.6Split Evaluation APIEndpoints for evaluating feature flags and retrieving treatment values for given keys and feature flag names.35.9Humanloop LLM Platform APIThe Humanloop REST API and SDKs covered prompts, tools, datasets, evaluations, evaluators, and logs for LLM...35.5Trakstar Evaluations APIManage candidate evaluations34.6Together AI Evaluation APIThe evaluation API from Together AI — 4 operation(s) for evaluation.34.4BigML Evaluations APIEvaluate model performance against a test dataset32.6LiteLLM Evals APIProvides /evals endpoints for the Evaluations API, enabling measurement and benchmarking of model performan...31.7Clarifai Evaluations APIThe Evaluations API from Clarifai — 2 operation(s) for evaluations.29.5Tonic ValidateTonic Validate is an open-source RAG evaluation framework and metrics platform for measuring retrieval-augm...29.3AIMon APIREST API for AIMon LLM monitoring and evaluation — manage users, models, applications, evaluations and eval...29.1Athina AI Evaluations APIRun evaluations against datasets and logged inferences.28.3Lunary APIREST API for Lunary covering ingestion (logs/traces), prompts (template management with versions and labels...28.3Log10 Evaluation APIAPI for running automated evaluations and benchmarking logged completions across multiple LLM providers, ge...27.6Log10 Feedback APIFeedback27.6UpTrain Evaluation APIThe Evaluation API from UpTrain — 3 operation(s) for evaluation.26.5
Emerging 7 Early or largely undocumented

Companies reaching this through an API (50)

These companies publish an API, specification or operation carrying “Evaluation” but do not classify their business under it. Listed unranked and kept out of the count above, because one tagged operation is not a statement about what a company does.

100Hires 8x8 Adobe Agenta AI Gateway Alloy AmeriCorps Amigo Amplitude Authenticx Avito BigML Buk Clarifai Cloudflare Codecov CompTeam Confident AI Convai Docling Eigenpal EvalGate forecall-dev Gumloop Harness HashiCorp Nomad Interfolio LangWatch Last Mile AI LiteLLM Lunary n8n Observe.AI OpenAI Oxen Patronus AI Qlik Qlik Sense Ragas Rapidata Rulebase Scale AI Split Together AI Tonic.ai Trakstar USAID Vorn Workable Zoom

Score breakdown

Frequency
56.6
log-scaled weighted occurrences
Breadth
0.8
spread across providers
Quality lift
32.9
mean composite of providers using it
Cohesion
0.0
strength of nearest seed neighbor

Related tags

Tracing 17 co-occurrences Prompts 16 co-occurrences Experiments 14 co-occurrences Benchmarks 13 co-occurrences Prompt Management 9 co-occurrences LLM 41 co-occurrences Traces 11 co-occurrences

Where this tag comes from

Api tag69
Provider tag62
Openapi tag30
Openapi op tag98

Cohort brief

Auto-generated

The 58 providers in the APIs.io catalog tagged Evaluation, scored on the Kin Score. Every figure below is computed from the catalog — nothing here is written.

Providers
58
of 62 in the catalog
Mean Kin Score
33
+8.9 vs catalog 24.1
Mean Agent Readiness
22
+7.9 vs catalog 14.1
Spread
0–69
median 31.7 · σ 16
How the 58 split by band
Exemplar 1Strong 6Developing 10Thin 21Emerging 15Minimal 5
Facet averages, against the whole catalog
FacetThis cohortCatalogDifferenceScored
Contract Quality 33.4 18.6 +14.8 58
Developer Ergonomics 37.1 24.5 +12.6 58
Discoverability 66.3 59.1 +7.2 58
Operational Transparency 17.4 13.2 +4.2 58
Contract Governance 12.8 9.7 +3.1 58
Access Clarity 32.5 30 +2.5 58

A facet is averaged over the members that carry it, not over the whole cohort — the “Scored” column is that count. Averaging an absent facet as zero would score our own coverage gaps as the providers’ posture.

What this cohort publishes
ArtifactThis cohortCatalogDifference
MCP server (any) 34% 18% +16
MCP server (first-party) 40% 16% +24
Agent Skills 0% 0% 0
OAuth scopes 3% 13% -10
Security 100% 99% +1
Arazzo workflows 5% 1% +4
Governance rules 69% 36% +33

mcp_pct counts any mcp/ artifact including ones API Evangelist derived from the provider OpenAPI; mcp_first_party_pct counts only servers the provider publishes. Prefer the latter.

Top by Kin Score
  1. 1 Roark 69
  2. 2 Comet 63.6
  3. 3 Scorecard 61.6
  4. 4 Coval 60.9
  5. 5 Bluejay 59.4
  6. 6 Vijil 58.6
  7. 7 Runloop 57.5
  8. 8 Fleet 53
  9. 9 ADHDEvaluations 52.1
  10. 10 CompletionKit 51.5
Top by Agent Readiness
  1. 1 Coval 60.7
  2. 2 Braintrust 52.4
  3. 3 Scorecard 49.8
  4. 4 LangChain 48.6
  5. 5 Fleet 42.5
  6. 6 Openlayer 42.4
  7. 7 Bluejay 41.6
  8. 8 ADHDEvaluations 41.2
  9. 9 Vellum AI 38.5
  10. 10 Roark 36.8
All 62 members of this roster resolve to a provider in the catalog; 58 carry a score (94%). The figures above describe the scored members only.
Coverage caveat. 46 of 58 scored members had under half their catalog-attributable points satisfied at all (catalog_earned / catalog_max < 0.5). They are INCLUDED in the mean above. A large share here means the cohort mean is partly a measurement of how far our enrichment reached, not only of how these providers publish.Generated from the catalog build of 14 November 2026, across 41591 providers, using the same computation served by the APIs.io cohort API. Briefs are published for rosters of 5 or more scored providers; below that a distribution is not meaningful.

Work with this as data

Every tag here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for tags

7 MCP tools reach this
  • find_tagsBrowse and filter every tag in the catalog.
  • get_cohortThis tag as a scored cohort — every provider carrying it, with scores.
  • cohort_statsPRO — the distribution across this tag: mean, median, band split, adoption rates.
  • cohort_rankingsPRO — the leaderboard, on composite AND agent-readiness axes.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This tag
curl "https://apis.io/api/v1/tags/evaluation"
All tags
curl "https://apis.io/api/v1/tags?limit=25"
As a scored cohort (paid plan)
The distribution (Pro)

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.