Evaluations
Variants seen in the corpus:
Evaluationsevaluations
Providers using this tag (28)
Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.
Strong 4 Solid coverage with minor gaps
Developing 14 Usable, with meaningful gaps to close
APIs with this tag (22)
Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →
Strong 2 Solid coverage with minor gaps
Developing 12 Usable, with meaningful gaps to close
Gumloop Evaluations APIThe Evaluations API from Gumloop — 4 operation(s) for evaluations.Authenticx Evaluations APIThe Evaluations API from Authenticx — 2 operation(s) for evaluations.PostHog evaluations APIThe evaluations API from PostHog — 3 operation(s) for evaluations.Buk Evaluations APIThe Evaluations API from Buk — 3 operation(s) for evaluations.Trakstar Evaluations APIManage candidate evaluationsBigML Evaluations APIEvaluate model performance against a test datasetLaminar Evaluations APIThe lower-level LaminarClient.evals surface for wiring evaluations into an existing pipeline: create an eva...Understudy Control Plane APIREST surface behind the dashboard and CLI, served from the gateway host under /admin/v1 and /customer/v1, o...Athina AI Evaluations APIRun evaluations against datasets and logged inferences.HashiCorp Nomad Evaluations APIEndpoints for querying evaluations. Evaluations are the mechanism by which Nomad makes scheduling decisions.Agenta Evaluations APIRun evaluations of variants against testsets.Extend Evaluations APIThe Evaluations API from Extend — 4 operation(s) for evaluations.
Thin 8 Limited public surface area
Oxen evaluations APIThe evaluations API from Oxen — 2 operation(s) for evaluations.Vellum LLM Platform APIThe Vellum REST API exposes prompts, workflows, evaluations, datasets, document indexes, deployments, and e...Humanloop LLM Platform APIThe Humanloop REST API and SDKs covered prompts, tools, datasets, evaluations, evaluators, and logs for LLM...Workable Evaluations APISubmit and read interviewer evaluations and scorecards aligned to the job's interview kit.HashiCorp Nomad Evaluations APIInspect scheduling processes.LiteLLM Evals APIProvides /evals endpoints for the Evaluations API, enabling measurement and benchmarking of model performan...Lunary APIREST API for Lunary covering ingestion (logs/traces), prompts (template management with versions and labels...USAID Development Experience Clearinghouse APIThe USAID Development Experience Clearinghouse (DEC) API provides programmatic access to the largest online...
Score breakdown
Frequency
48.2
log-scaled weighted occurrences
Breadth
0.8
spread across providers
Quality lift
53.5
mean composite of providers using it
Cohesion
4.6
strength of nearest seed neighbor
Related tags
Prompts 6 co-occurrences
Runs 5 co-occurrences
Datasets 10 co-occurrences
Conversations 5 co-occurrences
Models 7 co-occurrences
Comments 5 co-occurrences
Sessions 6 co-occurrences
LLM 8 co-occurrences
Where this tag comes from
Api tag24
Provider tag7
Openapi tag17
Openapi op tag60
Cohort brief
Auto-generatedThe 28 providers in the APIs.io catalog tagged Evaluations, scored on the Kin Score. Every figure below is computed from the catalog — nothing here is written.
Providers
28
all scored
Mean Kin Score
44.1
+23.4 vs catalog 20.7
Mean Agent Readiness
27.4
+17.7 vs catalog 9.7
Spread
27–64.8
median 42.6 · σ 10
How the 28 split by band
Exemplar 0Strong 6Developing 10Thin 12Emerging 0Minimal 0
Facet averages, against the whole catalog
| Facet | This cohort | Catalog | Difference | Scored |
|---|---|---|---|---|
| Contract Quality | 52.5 | 17.5 | +35 | 28 |
| Developer Ergonomics | 45 | 17.9 | +27.1 | 28 |
| Access Clarity | 43.6 | 22.3 | +21.3 | 28 |
| Operational Transparency | 26.8 | 11.3 | +15.5 | 28 |
| Discoverability | 75.7 | 60.4 | +15.3 | 28 |
| Contract Governance | 11.9 | 6.4 | +5.5 | 28 |
A facet is averaged over the members that carry it, not over the whole cohort — the “Scored” column is that count. Averaging an absent facet as zero would score our own coverage gaps as the providers’ posture.
What this cohort publishes
| Artifact | This cohort | Catalog | Difference |
|---|---|---|---|
| MCP server (any) | 32% | 16% | +16 |
| MCP server (first-party) | 21% | 7% | +14 |
| Agent Skills | 0% | 0% | 0 |
| OAuth scopes | 18% | 9% | +9 |
| Security | 100% | 88% | +12 |
| Arazzo workflows | 4% | 2% | +2 |
| Governance rules | 25% | 13% | +12 |
mcp_pct counts any mcp/ artifact including ones API Evangelist derived from the provider OpenAPI; mcp_first_party_pct counts only servers the provider publishes. Prefer the latter.
Top by Kin Score
- 1 Factset 64.8
- 2 Amigo 63.8
- 3 Observe.AI 56.6
- 4 Gumloop 55.8
- 5 Prime Intellect 55.1
- 6 Alloy 54.6
- 7 Authenticx 54
- 8 Buk 51.4
- 9 PostHog 49.3
- 10 Trakstar 47.6
Top by Agent Readiness
- 1 Factset 52.8
- 2 Gumloop 47.3
- 3 Buk 46.9
- 4 Authenticx 44.1
- 5 Amigo 43.5
- 6 PostHog 33.5
- 7 Observe.AI 29.7
- 8 Vijil 29.1
- 9 Understudy Labs 28.9
- 10 Langfuse 28.1
All 28 members of this roster resolve to a scored provider in
the catalog.Generated from the catalog build of
25 August 2026, across 26891
providers, using the same computation served by the
APIs.io cohort API. Briefs are published for rosters of
5 or more scored providers; below that a distribution is not meaningful.
Work with this as data
Every tag here is available over the APIs.io API and to AI agents over MCP.