stale · 0.0 capabilitymarket schemaresourcedomain

LLM Evaluation

Score 16.6 / 100 13 providers 4 APIs Search apis.io →

Providers using this tag (13)

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Strong 1 Solid coverage with minor gaps
Galileo TechnologiesCompanyAI ObservabilityGenerative AI9 APIs56.1
Developing 2 Usable, with meaningful gaps to close
ArthurAICompanyAi MlAI GovernanceAI Observability32 APIs49.1LangWatchArtificial IntelligenceLLMLLM Observability1 API47.9
Thin 6 Limited public surface area
AgentaArtificial IntelligenceLLMOpsPrompt Management1 API38.4PromptfooRed TeamingAI SecurityGuardrails6 APIs36.9AtlaCompanySoftware-as-a-ServiceArtificial Intelligence1 API34.8UpTrainArtificial IntelligenceLLMEvaluation1 API34.2Flow AICompanyArtificial IntelligenceAI AgentsAgent Infrastructure32.2Confident AIOpen-SourceObservabilityRed Teaming3 APIs29.3
Emerging 4 Early or largely undocumented
DeepEvalLLM TestingEvaluation FrameworkEvaluation Metrics25.1Patronus AIGuardrailsJudgesHallucination Detection7 APIs22.0EvalsEvalsAI QualityBenchmarks20 APIs21.7RagasRAG EvaluationRAGAI Evaluation1 API16.3

APIs with this tag (4)

Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →

Thin 3 Limited public surface area
Promptfoo CLIThe Promptfoo CLI is the primary entry point for running prompt and model evaluations from the command line...36.9Promptfoo Node.js LibraryThe Promptfoo Node.js package exposes the same evaluation engine programmatically so developers can embed e...36.9DeepEvalDeepEval is an open-source Python framework for evaluating LLM applications as unit tests. It ships with re...29.3
Emerging 1 Early or largely undocumented
Patronus Evaluation APIThe Patronus Evaluation API scores LLM outputs against built-in and custom evaluators covering hallucinatio...22.0

Score breakdown

Frequency
33.7
log-scaled weighted occurrences
Breadth
0.4
spread across providers
Quality lift
38.7
mean composite of providers using it
Cohesion
2.4
strength of nearest seed neighbor

Related tags

Guardrails 5 co-occurrences Evaluation 5 co-occurrences Python 5 co-occurrences Datasets 5 co-occurrences Observability 5 co-occurrences Open-Source 8 co-occurrences Artificial Intelligence 5 co-occurrences

Where this tag comes from

Provider tag13
Api tag4

Work with this as data

Every tag here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for tags

7 MCP tools reach this
  • find_tagsBrowse and filter every tag in the catalog.
  • get_cohortThis tag as a scored cohort — every provider carrying it, with scores.
  • cohort_statsPRO — the distribution across this tag: mean, median, band split, adoption rates.
  • cohort_rankingsPRO — the leaderboard, on composite AND agent-readiness axes.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This tag 
curl "https://apis.io/api/v1/tags/llm-evaluation"
All tags 
curl "https://apis.io/api/v1/tags?limit=25"
As a scored cohort 
curl "https://apis.io/api/v1/cohorts/tag/llm-evaluation"
The distribution (Pro) 
curl "https://apis.io/api/v1/cohorts/tag/llm-evaluation/stats" \
  -H "X-API-Key: $APIS_IO_KEY"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.