UpTrain

UpTrain is an open-source (Apache-2.0) unified platform to evaluate and improve generative AI and LLM applications. It ships a Python framework plus a managed evaluation API that grades responses against 20+ preconfigured checks - context relevance, factual accuracy, response completeness, hallucination, tonality, prompt injection and more - and performs root cause analysis on failure cases.

UpTrain publishes 6 APIs on the APIs.io network, including Auth API, Checksets API, Datasets API, and 3 more. Tagged areas include Artificial Intelligence, LLM, Evaluation, LLM Evaluation, and Observability.

UpTrain’s developer surface includes authentication, documentation, and 8 more developer resources.

🌐 Visit website 📡 Source on GitHub

34.0/100 thin ▬ flat Agent 20/100 agent aware Full breakdown ↓
scored 2026-08-25 · rubric v0.14.0

AccessFreemiumSelf serve⚡ Free to try

6 APIs

Artificial Intelligence LLM Evaluation LLM Evaluation Observability Open-Source

Kin Score

Kin Score How this is scored →
scored 2026-08-25 · rubric v0.14.0

Composite quality — 34.0/100 · thin

Contract Quality 13.4 / 25

Developer Ergonomics 4.3 / 20

Access Clarity 5.8 / 20

Operational Transparency 3.1 / 13

Contract Governance 0.0 / 12

Discoverability 7.4 / 10

Agent readiness — 20/100 · agent aware

Machine-Readable Contract 18 / 18

Agentic Access Contract 10 / 10

Documented Reversibility 0 / 6

MCP Server 0 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 0 / 8

Request/Response Examples 0 / 7

Rate-Limit Signaling 7 / 7

Typed Event Surface 0 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Delegated User Identity 0 / 6

Protected Resource Metadata 0 / 5

Registration Without a Human 0 / 6

Agentic Commerce Surface 0 / 5

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/uptrain: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

APIs 6

Individual APIs this provider publishes, each with its own machine-readable definition.

Rate Limits 1

Documented rate limits and quota policies.

Uptrain Rate Limits

2 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Documentation 1

Reference material describing how the API behaves

Documentation

Documentation

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess

AgenticAccess

Build 1

SDKs, sample code, and the tooling you integrate with

GitHubOrganization

GitHubOrganization

Access & Security 2

Authentication, authorization, and security posture

DomainSecurity

DomainSecurity

Authentication

Authentication

Operate 1

Status, limits, changes, and where to get help

RateLimits

RateLimits

Commercial 2

Pricing, plans, and the legal terms of use

Plans

Plans

FinOps

FinOps

Company 2

The organization behind the API

LinkedIn

Website

Website

Source (apis.yml)

aid: uptrain
url: https://raw.githubusercontent.com/api-evangelist/uptrain/refs/heads/main/apis.yml
name: UpTrain
kind: company
description: UpTrain is an open-source (Apache-2.0) unified platform to evaluate and improve generative AI and LLM applications.
  It ships a Python framework plus a managed evaluation API that grades responses against 20+ preconfigured checks - context
  relevance, factual accuracy, response completeness, hallucination, tonality, prompt injection and more - and performs root
  cause analysis on failure cases.
accessModel:
  pricing: freemium
  onboarding: self-serve
  trial: false
  try_now: true
  public: false
  label: Freemium · Self-serve signup
  confidence: high
  source:
  - plans
  - authentication
  generated: '2026-07-22'
  method: derived
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/uptrain.png
tags:
- Artificial Intelligence
- LLM
- Evaluation
- LLM Evaluation
- Observability
- Open-Source
tags_raw:
- AI
- LLM
- Evaluation
- LLM Evaluation
- Observability
- Open Source
created: '2026-06-20'
modified: '2026-06-20'
specificationVersion: '0.23'
apis:
- aid: uptrain:uptrain-auth-api
  name: UpTrain Auth API
  description: The Auth API from UpTrain — 1 operation(s) for auth.
  humanURL: https://docs.uptrain.ai/
  baseURL: https://demo.uptrain.ai/api/public
  tags:
  - Authentication
  tags_raw:
  - Auth
  properties:
  - type: OpenAPI
    url: openapi/uptrain-auth-api-openapi.yml
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/introduction
  - type: APIReference
    url: https://docs.uptrain.ai/predefined-evaluations/overview
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/quickstart
  - type: Documentation
    url: https://docs.uptrain.ai/predefined-evaluations/overview
- aid: uptrain:uptrain-checksets-api
  name: UpTrain Checksets API
  description: The Checksets API from UpTrain — 1 operation(s) for checksets.
  humanURL: https://docs.uptrain.ai/
  baseURL: https://demo.uptrain.ai/api/public
  tags:
  - Checksets
  properties:
  - type: OpenAPI
    url: openapi/uptrain-checksets-api-openapi.yml
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/introduction
  - type: APIReference
    url: https://docs.uptrain.ai/predefined-evaluations/overview
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/quickstart
  - type: Documentation
    url: https://docs.uptrain.ai/predefined-evaluations/overview
- aid: uptrain:uptrain-datasets-api
  name: UpTrain Datasets API
  description: The Datasets API from UpTrain — 1 operation(s) for datasets.
  humanURL: https://docs.uptrain.ai/
  baseURL: https://demo.uptrain.ai/api/public
  tags:
  - Datasets
  properties:
  - type: OpenAPI
    url: openapi/uptrain-datasets-api-openapi.yml
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/introduction
  - type: APIReference
    url: https://docs.uptrain.ai/predefined-evaluations/overview
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/quickstart
  - type: Documentation
    url: https://docs.uptrain.ai/predefined-evaluations/overview
- aid: uptrain:uptrain-evaluation-api
  name: UpTrain Evaluation API
  description: The Evaluation API from UpTrain — 3 operation(s) for evaluation.
  humanURL: https://docs.uptrain.ai/
  baseURL: https://demo.uptrain.ai/api/public
  tags:
  - Evaluation
  properties:
  - type: OpenAPI
    url: openapi/uptrain-evaluation-api-openapi.yml
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/introduction
  - type: APIReference
    url: https://docs.uptrain.ai/predefined-evaluations/overview
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/quickstart
  - type: Documentation
    url: https://docs.uptrain.ai/predefined-evaluations/overview
- aid: uptrain:uptrain-root-cause-analysis-api
  name: UpTrain Root Cause Analysis API
  description: The Root Cause Analysis API from UpTrain — 1 operation(s) for root cause analysis.
  humanURL: https://docs.uptrain.ai/
  baseURL: https://demo.uptrain.ai/api/public
  tags:
  - Root Cause Analysis
  properties:
  - type: OpenAPI
    url: openapi/uptrain-root-cause-analysis-api-openapi.yml
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/introduction
  - type: APIReference
    url: https://docs.uptrain.ai/predefined-evaluations/overview
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/quickstart
  - type: Documentation
    url: https://docs.uptrain.ai/predefined-evaluations/overview
- aid: uptrain:uptrain-runs-api
  name: UpTrain Runs API
  description: The Runs API from UpTrain — 3 operation(s) for runs.
  humanURL: https://docs.uptrain.ai/
  baseURL: https://demo.uptrain.ai/api/public
  tags:
  - Runs
  properties:
  - type: OpenAPI
    url: openapi/uptrain-runs-api-openapi.yml
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/introduction
  - type: APIReference
    url: https://docs.uptrain.ai/predefined-evaluations/overview
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/quickstart
  - type: Documentation
    url: https://docs.uptrain.ai/predefined-evaluations/overview
common:
- type: AgenticAccess
  url: agentic-access/uptrain-agentic-access.yml
- type: DomainSecurity
  url: security/uptrain-domain-security.yml
- type: Authentication
  url: authentication/uptrain-authentication.yml
- type: GitHubOrganization
  url: https://github.com/uptrain-ai
- type: LinkedIn
  url: https://www.linkedin.com/company/uptrain-ai
- type: Website
  url: https://uptrain.ai/
- type: Documentation
  url: https://docs.uptrain.ai/
- type: Plans
  url: plans/uptrain-plans-pricing.yml
- type: RateLimits
  url: rate-limits/uptrain-rate-limits.yml
- type: FinOps
  url: finops/uptrain-finops.yml
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this

find_providersBrowse and filter every provider in the catalog.
get_provider_artifactsEvery artifact this provider publishes, grouped by type.
get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
get_provider_ratingPRO — composite, band, trend and facet scores.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools

Call it yourself

curl for this page

This provider

curl "https://apis.io/api/v1/providers/uptrain"

All providers

curl "https://apis.io/api/v1/providers?limit=25"

Every operation they expose

curl "https://apis.io/api/v1/providers/uptrain/operations?limit=25"

How their score was established

curl "https://apis.io/api/v1/providers/uptrain/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.