Evaluation
Business capabilities this tag reaches
Information & Data Management 1
Variants seen in the corpus:
Evaluationevaluation
Providers using this tag (59)
Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.
Exemplar 1 Complete, well-documented, and agent-ready
Developing 28 Usable, with meaningful gaps to close
Thin 16 Limited public surface area
Emerging 11 Early or largely undocumented
Minimal 1 Almost no public developer surface
APIs with this tag (31)
Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →
Exemplar 1 Complete, well-documented, and agent-ready
Strong 1 Solid coverage with minor gaps
Developing 15 Usable, with meaningful gaps to close
Convai Evaluation APIThe Evaluation API from Convai — 1 operation(s) for evaluation.AlyxAlyx is Arize's AI engineering agent that helps developers debug traces, create evaluators, build dashboard...Arize AXArize AX is the commercial AI engineering platform covering tracing, evaluation, experiments, prompt manage...PhoenixPhoenix is Arize's open-source LLM observability platform offering local tracing, evaluation, experiments, ...Zoom Quality Management APIThe Zoom Quality Management API is designed to help contact centers track and analyze customer interactions...Microsoft Windows 10 Evaluation APIThe Evaluation API from Microsoft Windows 10 — 1 operation(s) for evaluation.Avito Evaluation APIThe Evaluation API from Avito — 5 operation(s) for evaluation.Braintrust APIThe Braintrust REST API provides programmatic access to projects, experiments, datasets, prompts, functions...W&B Weave (LLM Observability)LLM observability and evaluation platform providing tracing, output evaluation, cost estimation, prompt pla...Rapidata Evaluation APIThe Evaluation API from Rapidata — 1 operation(s) for evaluation.Eigenpal Evaluation APIManage datasets, examples, evaluators, experiment batches, evaluator scores, and run promotion workflows.Log10 Evaluation APIAPI for running automated evaluations and benchmarking logged completions across multiple LLM providers, ge...Log10 Feedback APIFeedbackDocling EvalEnd-to-end evaluation framework for document parsing models and services. Provides standard datasets and me...Split Evaluation APIEndpoints for evaluating feature flags and retrieving treatment values for given keys and feature flag names.
Thin 9 Limited public surface area
GentraceGentrace was an AI evaluation and observability product; the company has shut down and its codebase is now ...Tonic ValidateTonic Validate is an open-source RAG evaluation framework and metrics platform for measuring retrieval-augm...Together AI evaluation APIThe evaluation API from Together AI — 4 operation(s) for evaluation.UpTrain Evaluation APIThe Evaluation API from UpTrain — 3 operation(s) for evaluation.EvaluationPlatform and SDK capabilities for assessing model performance across data splits, running error and slice a...AmeriCorps Open Data SODA APIThe AmeriCorps Open Data portal provides programmatic access to AmeriCorps research, evaluation, and progra...Confident AI PlatformConfident AI is the hosted platform that complements DeepEval with observability, centralized reporting, re...AIMon APIREST API for AIMon LLM monitoring and evaluation — manage users, models, applications, evaluations and eval...Opik (GenAI Observability)Opik is Comet's open-source GenAI observability product. It provides spans-based tracing, evaluations, prom...
Emerging 5 Early or largely undocumented
Maxim AI APIThe Maxim REST API provides programmatic access to prompts, workflows, agents, datasets, evaluators, test r...Ragas Python LibraryThe Ragas Python library is the primary surface of the project, installed via `pip install ragas` and impor...Patronus Python SDKThe Patronus Python SDK provides decorators and clients for instrumenting LLM applications, running evaluat...PercivalPercival is Patronus's agent debugging product that ingests agent traces and surfaces failure modes, tool m...Pi Scoring APIOpenAPI-compatible REST API for scoring, calibrating, and optimizing LLM outputs against rubrics of natural...
Score breakdown
Frequency
53.1
log-scaled weighted occurrences
Breadth
1.6
spread across providers
Quality lift
43.6
mean composite of providers using it
Cohesion
0.0
strength of nearest seed neighbor
Related tags
Tracing 13 co-occurrences
Prompts 10 co-occurrences
LLM Observability 7 co-occurrences
Experiments 9 co-occurrences
Prompt Management 6 co-occurrences
Benchmarks 7 co-occurrences
Guardrails 7 co-occurrences
LLM 27 co-occurrences
Where this tag comes from
Provider tag41
Api tag31
Openapi tag9
Openapi op tag36
Cohort brief
Auto-generatedThe 59 providers in the APIs.io catalog tagged Evaluation, scored on the Kin Score. Every figure below is computed from the catalog — nothing here is written.
Providers
59
all scored
Mean Kin Score
36.1
+15.4 vs catalog 20.7
Mean Agent Readiness
20.2
+10.5 vs catalog 9.7
Spread
5–64.2
median 37.9 · σ 13.2
How the 59 split by band
Exemplar 0Strong 5Developing 19Thin 20Emerging 13Minimal 2
Facet averages, against the whole catalog
| Facet | This cohort | Catalog | Difference | Scored |
|---|---|---|---|---|
| Contract Quality | 42.9 | 17.5 | +25.4 | 59 |
| Developer Ergonomics | 36.1 | 17.9 | +18.2 | 59 |
| Operational Transparency | 25.5 | 11.3 | +14.2 | 59 |
| Access Clarity | 33.6 | 22.3 | +11.3 | 59 |
| Discoverability | 70.9 | 60.4 | +10.5 | 59 |
| Contract Governance | 8.6 | 6.4 | +2.2 | 59 |
A facet is averaged over the members that carry it, not over the whole cohort — the “Scored” column is that count. Averaging an absent facet as zero would score our own coverage gaps as the providers’ posture.
What this cohort publishes
| Artifact | This cohort | Catalog | Difference |
|---|---|---|---|
| MCP server (any) | 27% | 16% | +11 |
| MCP server (first-party) | 12% | 7% | +5 |
| Agent Skills | 0% | 0% | 0 |
| OAuth scopes | 7% | 9% | -2 |
| Security | 98% | 88% | +10 |
| Arazzo workflows | 10% | 2% | +8 |
| Governance rules | 25% | 13% | +12 |
mcp_pct counts any mcp/ artifact including ones API Evangelist derived from the provider OpenAPI; mcp_first_party_pct counts only servers the provider publishes. Prefer the latter.
Top by Kin Score
All 59 members of this roster resolve to a scored provider in
the catalog.Generated from the catalog build of
25 August 2026, across 26891
providers, using the same computation served by the
APIs.io cohort API. Briefs are published for rosters of
5 or more scored providers; below that a distribution is not meaningful.
Work with this as data
Every tag here is available over the APIs.io API and to AI agents over MCP.