niche · 0.7 capabilitymarket

LLM Evaluation

Score 18.0 / 100 14 providers 5 APIs Search apis.io →

Providers using this tag (14)

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Strong 2 Solid coverage with minor gaps

Galileo TechnologiesCompanyAI ObservabilityGenerative AI9 APIs62.9 ArthurAICompanyAi MlAI GovernanceAI Observability32 APIs58.7

Developing 3 Usable, with meaningful gaps to close

LangWatchArtificial IntelligenceLLMLLM Observability1 API46.6 AgentCheckAI AgentsAI SafetySecurity TestingPrompt Injection4 APIs41.9 PromptfooRed TeamingAI SecurityGuardrails6 APIs41.7

Thin 5 Limited public surface area

Flow AICompanyArtificial IntelligenceAI AgentsAgent Infrastructure37.0 AgentaArtificial IntelligenceLLMOpsPrompt Management1 API35.1 AtlaCompanySoftware-as-a-ServiceArtificial Intelligence1 API33.0 UpTrainArtificial IntelligenceLLMEvaluation1 API31.7 Confident AIOpen SourceObservabilityRed Teaming3 APIs27.3

Emerging 4 Early or largely undocumented

DeepEvalLLM TestingEvaluation FrameworkEvaluation Metrics24.0 RagasRAG EvaluationRAGAI Evaluation1 API23.1 EvalsEvalsAI QualityBenchmarks20 APIs20.5 Patronus AIGuardrailsJudgesHallucination Detection7 APIs19.6

APIs with this tag (4)

Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →

Developing 2 Usable, with meaningful gaps to close

Promptfoo CLIThe Promptfoo CLI is the primary entry point for running prompt and model evaluations from the command line...41.7 Promptfoo Node.js LibraryThe Promptfoo Node.js package exposes the same evaluation engine programmatically so developers can embed e...41.7

Thin 1 Limited public surface area

DeepEvalDeepEval is an open-source Python framework for evaluating LLM applications as unit tests. It ships with re...27.3

Emerging 1 Early or largely undocumented

Patronus Evaluation APIThe Patronus Evaluation API scores LLM outputs against built-in and custom evaluators covering hallucinatio...19.6

Score breakdown

Frequency

35.1

log-scaled weighted occurrences

Breadth

0.4

spread across providers

Quality lift

43.7

mean composite of providers using it

Cohesion

2.4

strength of nearest seed neighbor

Where this tag comes from

Provider tag14

Api tag5

Work with this as data

Every tag here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for tags

7 MCP tools reach this

find_tagsBrowse and filter every tag in the catalog.
get_cohortThis tag as a scored cohort — every provider carrying it, with scores.
cohort_statsPRO — the distribution across this tag: mean, median, band split, adoption rates.
cohort_rankingsPRO — the leaderboard, on composite AND agent-readiness axes.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This tag

curl "https://apis.io/api/v1/tags/llm-evaluation"

All tags

curl "https://apis.io/api/v1/tags?limit=25"

As a scored cohort

curl "https://apis.io/api/v1/cohorts/tag/llm-evaluation"

The distribution (Pro)

curl "https://apis.io/api/v1/cohorts/tag/llm-evaluation/stats" \
  -H "X-API-Key: $APIS_IO_KEY"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.