Evaluation
Workflows using this tag
Cloudflare Replace Page Rule · Cloudflare
Cloudflare Configure SSL Mode · Cloudflare
Cloudflare Create and Activate Zone · Cloudflare
Cloudflare Create Firewall Rule · Cloudflare
Cloudflare Provision Zone with DNS · Cloudflare
Cloudflare Upload Custom SSL Certificate · Cloudflare
Cloudflare Rotate Worker · Cloudflare
Cloudflare Rotate Page Rule · Cloudflare
Business capabilities this tag reaches
Software Release & Deployment Management 3
Information & Data Management 3
Agent Infrastructure & Agentic Commerce 1
Software Product Engineering Management 1
Variants seen in the corpus:
EvaluationsEvaluation
Providers using this tag (47)
Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.
Developing 8 Usable, with meaningful gaps to close
Thin 20 Limited public surface area
Emerging 11 Early or largely undocumented
APIs with this tag (60)
Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →
Exemplar 9 Complete, well-documented, and agent-ready
OpenAI Evals APIManage and run evals in the OpenAI platform.Harness Evaluations APIAccess evaluation resultsCloudflare Evaluation APIThe Evaluation API from Cloudflare — 1 operation(s) for evaluation.Google Dialogflow Evaluations APIThe evaluations API from Google Dialogflow — 6 operation(s) for evaluations.8x8 Evaluations APIThe Evaluations API from 8x8 — 3 operation(s) for evaluations.Amigo Evaluations APIThe Evaluations API from Amigo — 4 operation(s) for evaluations.Qlik Sense Evaluation APIThe evaluation API from Qlik Sense — 10 operation(s) for evaluation.Qlik Sense Evaluations APIThe evaluations API from Qlik Sense — 2 operation(s) for evaluations.n8n Evaluation APIOperations about evaluation test runs
Strong 7 Solid coverage with minor gaps
Amplitude Evaluation APIRemote flag and experiment evaluation operationsObserve.AI Evaluations APIEvaluations API can be used to pull all the Evaluations(Manual and Auto QA) done on Observe AI platform. Pl...Zoom Quality Management APIThe Zoom Quality Management API is designed to help contact centers track and analyze customer interactions...Gumloop Evaluations APIThe Evaluations API from Gumloop — 4 operation(s) for evaluations.Buk Evaluations APIThe Evaluations API from Buk — 3 operation(s) for evaluations.Oxen Evaluations APIThe evaluations API from Oxen — 2 operation(s) for evaluations.Rapidata Evaluation APIThe Evaluation API from Rapidata — 1 operation(s) for evaluation.
Developing 14 Usable, with meaningful gaps to close
Alloy Evaluations APIRun, retrieve, and audit identity, KYC, KYB, AML, fraud, and credit evaluations.Authenticx Evaluations APIThe Evaluations API from Authenticx — 2 operation(s) for evaluations.Braintrust APIThe Braintrust REST API provides programmatic access to projects, experiments, datasets, prompts, functions...Laminar Evaluations APIThe lower-level LaminarClient.evals surface for wiring evaluations into an existing pipeline: create an eva...Avito Evaluation APIThe Evaluation API from Avito — 5 operation(s) for evaluation.Qlik Evaluation APIThe evaluation API from Qlik — 5 operation(s) for evaluation.Understudy Control Plane APIREST surface behind the dashboard and CLI, served from the gateway host under /admin/v1 and /customer/v1, o...Convai Evaluation APIThe Evaluation API from Convai — 1 operation(s) for evaluation.Interfolio Evaluations APIRetrieve details of users' evaluations.Eigenpal Evaluation APIManage datasets, examples, evaluators, experiment batches, evaluator scores, and run promotion workflows.HashiCorp Nomad Evaluations APIEndpoints for querying evaluations. Evaluations are the mechanism by which Nomad makes scheduling decisions.Split Evaluation APIEndpoints for evaluating feature flags and retrieving treatment values for given keys and feature flag names.Vellum LLM Platform APIThe Vellum REST API exposes prompts, workflows, evaluations, datasets, document indexes, deployments, and e...Workable Evaluations APISubmit and read interviewer evaluations and scorecards aligned to the job's interview kit.
Thin 23 Limited public surface area
AmeriCorps Open Data SODA APIThe AmeriCorps Open Data portal provides programmatic access to AmeriCorps research, evaluation, and progra...AlyxAlyx is Arize's AI engineering agent that helps developers debug traces, create evaluators, build dashboard...Arize AXArize AX is the commercial AI engineering platform covering tracing, evaluation, experiments, prompt manage...PhoenixPhoenix is Arize's open-source LLM observability platform offering local tracing, evaluation, experiments, ...EvaluationPlatform and SDK capabilities for assessing model performance across data splits, running error and slice a...Trakstar Evaluations APIManage candidate evaluationsDocling EvalEnd-to-end evaluation framework for document parsing models and services. Provides standard datasets and me...GentraceGentrace was an AI evaluation and observability product; the company has shut down and its codebase is now ...Agenta Evaluations APIRun evaluations of variants against testsets.BigML Evaluations APIEvaluate model performance against a test datasetLiteLLM Evals APIProvides /evals endpoints for the Evaluations API, enabling measurement and benchmarking of model performan...Together AI Evaluation APIThe evaluation API from Together AI — 4 operation(s) for evaluation.Log10 Evaluation APIAPI for running automated evaluations and benchmarking logged completions across multiple LLM providers, ge...Log10 Feedback APIFeedbackHumanloop LLM Platform APIThe Humanloop REST API and SDKs covered prompts, tools, datasets, evaluations, evaluators, and logs for LLM...Clarifai Evaluations APIThe Evaluations API from Clarifai — 2 operation(s) for evaluations.AIMon APIREST API for AIMon LLM monitoring and evaluation — manage users, models, applications, evaluations and eval...W&B Weave (LLM Observability)LLM observability and evaluation platform providing tracing, output evaluation, cost estimation, prompt pla...Tonic ValidateTonic Validate is an open-source RAG evaluation framework and metrics platform for measuring retrieval-augm...Maxim AI APIThe Maxim REST API provides programmatic access to prompts, workflows, agents, datasets, evaluators, test r...Athina AI Evaluations APIRun evaluations against datasets and logged inferences.Lunary APIREST API for Lunary covering ingestion (logs/traces), prompts (template management with versions and labels...UpTrain Evaluation APIThe Evaluation API from UpTrain — 3 operation(s) for evaluation.
Emerging 7 Early or largely undocumented
Opik (GenAI Observability)Opik is Comet's open-source GenAI observability product. It provides spans-based tracing, evaluations, prom...Confident AI PlatformConfident AI is the hosted platform that complements DeepEval with observability, centralized reporting, re...USAID Development Experience Clearinghouse APIThe USAID Development Experience Clearinghouse (DEC) API provides programmatic access to the largest online...Patronus Python SDKThe Patronus Python SDK provides decorators and clients for instrumenting LLM applications, running evaluat...PercivalPercival is Patronus's agent debugging product that ingests agent traces and surfaces failure modes, tool m...Pi Scoring APIOpenAPI-compatible REST API for scoring, calibrating, and optimizing LLM outputs against rubrics of natural...Ragas Python LibraryThe Ragas Python library is the primary surface of the project, installed via `pip install ragas` and impor...
Companies reaching this through an API (41)
These companies publish an API, specification or operation carrying “Evaluation” but do not classify their business under it. Listed unranked and kept out of the count above, because one tagged operation is not a statement about what a company does.
8x8
Agenta
AI Gateway
Alloy
AmeriCorps
Amigo
Amplitude
Authenticx
Avito
BigML
Buk
Clarifai
Cloudflare
Comet
Confident AI
Convai
Docling
Eigenpal
Google Dialogflow
Gumloop
Harness
HashiCorp Nomad
Interfolio
LiteLLM
Lunary
n8n
Observe.AI
OpenAI
Oxen
Patronus AI
Qlik
Qlik Sense
Ragas
Rapidata
Split
Together AI
Tonic.ai
Trakstar
USAID
Workable
Zoom
Score breakdown
Frequency
58.2
log-scaled weighted occurrences
Breadth
1.1
spread across providers
Quality lift
33.1
mean composite of providers using it
Cohesion
8.2
strength of nearest seed neighbor
Related tags
Tracing 15 co-occurrences
Prompts 12 co-occurrences
Experiments 12 co-occurrences
Benchmarks 10 co-occurrences
LLM 35 co-occurrences
Datasets 24 co-occurrences
LLM Observability 7 co-occurrences
Where this tag comes from
Api tag62
Provider tag52
Openapi tag23
Openapi op tag77
Work with this as data
Every tag here is available over the APIs.io API and to AI agents over MCP.