Benchmarks
Business capabilities this tag reaches
Information & Data Management 1
Sustainability Management 1
Human Capital Management 1
Variants seen in the corpus:
BenchmarkBenchmarks
Providers using this tag (35)
Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.
Strong 7 Solid coverage with minor gaps
Developing 8 Usable, with meaningful gaps to close
Thin 8 Limited public surface area
Emerging 9 Early or largely undocumented
Minimal 3 Almost no public developer surface
APIs with this tag (28)
Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →
Strong 6 Solid coverage with minor gaps
Factset Benchmark APIThe Benchmark API from Factset — 10 operation(s) for benchmark.Runloop Benchmark APIThe Benchmark API from Runloop — 25 operation(s) for benchmark.Scope3 Benchmarks APIThe Benchmarks API from Scope3 — 1 operation(s) for benchmarks.Visier Benchmarks APIGet benchmark values.Mastercard Benchmarks APIThe Benchmarks API from Mastercard — 1 operation(s) for benchmarks.Kaiko IndicesRegulated benchmark crypto indices designed for fund administrators and ETF/ETP issuers.
Developing 7 Usable, with meaningful gaps to close
tpuf-benchmarkOpen-source general-purpose benchmarking tool for turbopuffer deployments. Useful for validating recall, la...CMS — Centers for Medicare & Medicaid Services Benchmarks APIThe Benchmarks API from CMS — Centers for Medicare & Medicaid Services — 1 operation(s) for benchmarks.Aleph Alpha Benchmarks APIEndpoints for handling benchmarks. A Benchmark provides a way to compare and evaluate the quality of your t...CME Term SOFR APIJSON-over-REST API delivering CME Term SOFR Reference Rates - the IOSCO-compliant forward-looking term Secu...Rapidata Benchmark APIThe Benchmark API from Rapidata — 19 operation(s) for benchmark.Bloomberg Buyside Enterprise Solutions Benchmarks APIBenchmark assignment and comparisonDocling EvalEnd-to-end evaluation framework for document parsing models and services. Provides standard datasets and me...
Thin 8 Limited public surface area
Xignite Global Indices APIStock market index and benchmark values with chart bars and index metadata from the globalindices.xignite.c...Serif Health Payer InventoryLive public inventory of 200+ payers with network-quality scoring, updated monthly, exposing data coverage ...EvaluationPlatform and SDK capabilities for assessing model performance across data splits, running error and slice a...LiteLLM Evals APIProvides /evals endpoints for the Evaluations API, enabling measurement and benchmarking of model performan...NOAA CO-OPS Benchmarks APIThe Benchmarks API from NOAA CO-OPS — 1 operation(s) for benchmarks.PennyLane DatasetsA curated catalogue of pre-computed quantum datasets — molecular Hamiltonians, spin systems, QML benchmarks...APEX Benchmarks (AI Productivity Index)Mercor's public AI productivity benchmark and research surface. APEX measures how well AI models perform re...Terminal-BenchPublic benchmark / task-submission framework published by Mercor (terminal-bench-3 on GitHub) for evaluatin...
Emerging 7 Early or largely undocumented
CoinAPI Indexes APIThe Indexes API aggregates data from many exchanges to compute reference rates and benchmark indexes that s...AgentBenchAgentBench is the first benchmark designed to evaluate LLM-as-Agent across a diverse spectrum of environmen...BIG-BenchThe Beyond the Imitation Game Benchmark (BIG-Bench) is "a collaborative benchmark intended to probe large l...GAIA BenchmarkGAIA is "a benchmark for General AI Assistants," published in 2023 (arXiv 2311.12983). It tests general-pur...HumanEval BenchmarkHumanEval is OpenAI's evaluation harness for code-generation models, described in its README as "an evaluat...MMLU BenchmarkMMLU (Measuring Massive Multitask Language Understanding) is a multiple-choice benchmark spanning 57 subjec...FinanceBenchFinanceBench is an open benchmark of 10,000 financial question-answer pairs grounded in public filings, use...
Score breakdown
Frequency
50.7
log-scaled weighted occurrences
Breadth
1.0
spread across providers
Quality lift
41.9
mean composite of providers using it
Cohesion
2.6
strength of nearest seed neighbor
Related tags
Evaluation 7 co-occurrences
Datasets 6 co-occurrences
Python 6 co-occurrences
Market Data 6 co-occurrences
Data 6 co-occurrences
Research 5 co-occurrences
Real-Time 5 co-occurrences
Agents 8 co-occurrences
Where this tag comes from
Api tag30
Provider tag14
Openapi tag10
Openapi op tag77
Cohort brief
Auto-generatedThe 35 providers in the APIs.io catalog tagged Benchmarks, scored on the Kin Score. Every figure below is computed from the catalog — nothing here is written.
Providers
35
all scored
Mean Kin Score
34.6
+13.9 vs catalog 20.7
Mean Agent Readiness
19.3
+9.6 vs catalog 9.7
Spread
5–67.2
median 33.7 · σ 17.5
How the 35 split by band
Exemplar 1Strong 5Developing 10Thin 5Emerging 11Minimal 3
Facet averages, against the whole catalog
| Facet | This cohort | Catalog | Difference | Scored |
|---|---|---|---|---|
| Developer Ergonomics | 39.6 | 17.9 | +21.7 | 35 |
| Contract Quality | 33.3 | 17.5 | +15.8 | 35 |
| Operational Transparency | 22.1 | 11.3 | +10.8 | 35 |
| Access Clarity | 32.8 | 22.3 | +10.5 | 35 |
| Discoverability | 67.2 | 60.4 | +6.8 | 35 |
| Contract Governance | 11.2 | 6.4 | +4.8 | 35 |
A facet is averaged over the members that carry it, not over the whole cohort — the “Scored” column is that count. Averaging an absent facet as zero would score our own coverage gaps as the providers’ posture.
What this cohort publishes
| Artifact | This cohort | Catalog | Difference |
|---|---|---|---|
| MCP server (any) | 31% | 16% | +15 |
| MCP server (first-party) | 17% | 7% | +10 |
| Agent Skills | 0% | 0% | 0 |
| OAuth scopes | 20% | 9% | +11 |
| Security | 97% | 88% | +9 |
| Arazzo workflows | 3% | 2% | +1 |
| Governance rules | 29% | 13% | +16 |
mcp_pct counts any mcp/ artifact including ones API Evangelist derived from the provider OpenAPI; mcp_first_party_pct counts only servers the provider publishes. Prefer the latter.
Top by Kin Score
- 1 Triple Whale 67.2
- 2 Scope3 65
- 3 Factset 64.8
- 4 Runloop 61.6
- 5 Kaiko 57.5
- 6 Visier 56.3
- 7 Rapidata 48.8
- 8 Aleph Alpha 47.9
- 9 CME Group 47.3
- 10 Mastercard 46.2
Top by Agent Readiness
- 1 Scope3 66.6
- 2 Triple Whale 54
- 3 Factset 52.8
- 4 Rapidata 41.7
- 5 Visier 39.3
- 6 Mastercard 32.4
- 7 Aleph Alpha 29.9
- 8 Serif Health 28.7
- 9 Forithmus 27.8
- 10 Bloomberg Buyside Enterprise Solutions 27.3
All 35 members of this roster resolve to a scored provider in
the catalog.Generated from the catalog build of
25 August 2026, across 26891
providers, using the same computation served by the
APIs.io cohort API. Briefs are published for rosters of
5 or more scored providers; below that a distribution is not meaningful.
Work with this as data
Every tag here is available over the APIs.io API and to AI agents over MCP.