UpTrain website screenshot

UpTrain

UpTrain is an open-source (Apache-2.0) unified platform to evaluate and improve generative AI and LLM applications. It ships a Python framework plus a managed evaluation API that grades responses against 20+ preconfigured checks - context relevance, factual accuracy, response completeness, hallucination, tonality, prompt injection and more - and performs root cause analysis on failure cases.

UpTrain publishes 6 APIs on the APIs.io network, including Auth API, Checksets API, Datasets API, and 3 more. Tagged areas include AI, LLM, Evaluation, LLM Evaluation, and Observability.

UpTrain’s developer surface includes authentication, documentation, and 8 more developer resources.

🌐 Visit website 📡 Source on GitHub
35.8/100 thin ▬ flat Agent 31/100 agent aware Full breakdown ↓
scored 2026-08-05 · rubric v0.9.1
AccessFreemiumSelf serve⚡ Free to try
6 APIs
AILLMEvaluationLLM EvaluationObservabilityOpen Source

Kin Score

Kin Score Kin Score How this is scored →
scored 2026-08-05 · rubric v0.9.1
Composite quality — 35.8/100 · thin
Contract Quality 15.3 / 25
Developer Ergonomics 3.9 / 20
Commercial Clarity 5.8 / 20
Operational Transparency 3.4 / 13
Governance 0.0 / 12
Discoverability 7.4 / 10
Agent readiness — 31/100 · agent aware
Machine-Readable Contract 18 / 18
Agentic Access Contract 10 / 10
MCP Server 0 / 12
Machine-Readable Auth 10 / 10
Idempotency 0 / 9
Stable Error Semantics 0 / 8
Request/Response Examples 0 / 7
Rate-Limit Signaling 7 / 7
Typed Event Surface 0 / 6
Agent Skills 0 / 5
Well-Known Catalog 0 / 4
Consent & Bot Identity 0 / 3
A2A Agent Card 0 / 8
Dry-Run / Simulate Mode 0 / 4
Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/uptrain: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

APIs 6

Individual APIs this provider publishes, each with its own machine-readable definition.

UpTrain Auth API

The Auth API from UpTrain — 1 operation(s) for auth.

UpTrain Checksets API

The Checksets API from UpTrain — 1 operation(s) for checksets.

UpTrain Datasets API

The Datasets API from UpTrain — 1 operation(s) for datasets.

UpTrain Evaluation API

The Evaluation API from UpTrain — 3 operation(s) for evaluation.

UpTrain Root Cause Analysis API

The Root Cause Analysis API from UpTrain — 1 operation(s) for root cause analysis.

UpTrain Runs API

The Runs API from UpTrain — 3 operation(s) for runs.

Open Collections 1

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

UpTrain Managed Evaluation API

OPEN COLLECTION

Pricing Plans 1

Published pricing tiers and plan structures.

Uptrain Plans Pricing

2 plans

PLANS

Rate Limits 1

Documented rate limits and quota policies.

Uptrain Rate Limits

2 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Uptrain Finops

FINOPS

Security Posture 2

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Uptrain Authentication

apiKey · 1 scheme

SECURITY

Uptrain Domain Security

TLSv1.3 · HSTS

SECURITY

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Uptrain Agentic Access

11 operations · 6 acting

11 operations · 6 acting

AGENTIC

Resources

Documentation 1

Reference material describing how the API behaves

Documentation
Documentation

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess
AgenticAccess

Build 1

SDKs, sample code, and the tooling you integrate with

GitHubOrganization
GitHubOrganization

Access & Security 2

Authentication, authorization, and security posture

DomainSecurity
DomainSecurity
 Authentication
Authentication

Operate 1

Status, limits, changes, and where to get help

RateLimits
RateLimits

Commercial 2

Pricing, plans, and the legal terms of use

Plans
Plans
 FinOps
FinOps

Company 2

The organization behind the API

LinkedIn
LinkedIn
 Website
Website

Source (apis.yml)

apis.yml Raw ↑ 
aid: uptrain
url: https://raw.githubusercontent.com/api-evangelist/uptrain/refs/heads/main/apis.yml
name: UpTrain
kind: company
description: UpTrain is an open-source (Apache-2.0) unified platform to evaluate and improve generative AI and LLM applications.
  It ships a Python framework plus a managed evaluation API that grades responses against 20+ preconfigured checks - context
  relevance, factual accuracy, response completeness, hallucination, tonality, prompt injection and more - and performs root
  cause analysis on failure cases.
accessModel:
  pricing: freemium
  onboarding: self-serve
  trial: false
  try_now: true
  public: false
  label: Freemium · Self-serve signup
  confidence: high
  source:
  - plans
  - authentication
  generated: '2026-07-22'
  method: derived
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/uptrain.png
tags:
- AI
- LLM
- Evaluation
- LLM Evaluation
- Observability
- Open Source
created: '2026-06-20'
modified: '2026-06-20'
specificationVersion: '0.19'
apis:
- aid: uptrain:uptrain-auth-api
  name: UpTrain Auth API
  description: The Auth API from UpTrain — 1 operation(s) for auth.
  humanURL: https://docs.uptrain.ai/
  baseURL: https://demo.uptrain.ai/api/public
  tags:
  - Auth
  properties:
  - type: OpenAPI
    url: openapi/uptrain-auth-api-openapi.yml
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/introduction
  - type: APIReference
    url: https://docs.uptrain.ai/predefined-evaluations/overview
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/quickstart
  - type: Documentation
    url: https://docs.uptrain.ai/predefined-evaluations/overview
- aid: uptrain:uptrain-checksets-api
  name: UpTrain Checksets API
  description: The Checksets API from UpTrain — 1 operation(s) for checksets.
  humanURL: https://docs.uptrain.ai/
  baseURL: https://demo.uptrain.ai/api/public
  tags:
  - Checksets
  properties:
  - type: OpenAPI
    url: openapi/uptrain-checksets-api-openapi.yml
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/introduction
  - type: APIReference
    url: https://docs.uptrain.ai/predefined-evaluations/overview
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/quickstart
  - type: Documentation
    url: https://docs.uptrain.ai/predefined-evaluations/overview
- aid: uptrain:uptrain-datasets-api
  name: UpTrain Datasets API
  description: The Datasets API from UpTrain — 1 operation(s) for datasets.
  humanURL: https://docs.uptrain.ai/
  baseURL: https://demo.uptrain.ai/api/public
  tags:
  - Datasets
  properties:
  - type: OpenAPI
    url: openapi/uptrain-datasets-api-openapi.yml
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/introduction
  - type: APIReference
    url: https://docs.uptrain.ai/predefined-evaluations/overview
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/quickstart
  - type: Documentation
    url: https://docs.uptrain.ai/predefined-evaluations/overview
- aid: uptrain:uptrain-evaluation-api
  name: UpTrain Evaluation API
  description: The Evaluation API from UpTrain — 3 operation(s) for evaluation.
  humanURL: https://docs.uptrain.ai/
  baseURL: https://demo.uptrain.ai/api/public
  tags:
  - Evaluation
  properties:
  - type: OpenAPI
    url: openapi/uptrain-evaluation-api-openapi.yml
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/introduction
  - type: APIReference
    url: https://docs.uptrain.ai/predefined-evaluations/overview
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/quickstart
  - type: Documentation
    url: https://docs.uptrain.ai/predefined-evaluations/overview
- aid: uptrain:uptrain-root-cause-analysis-api
  name: UpTrain Root Cause Analysis API
  description: The Root Cause Analysis API from UpTrain — 1 operation(s) for root cause analysis.
  humanURL: https://docs.uptrain.ai/
  baseURL: https://demo.uptrain.ai/api/public
  tags:
  - Root Cause Analysis
  properties:
  - type: OpenAPI
    url: openapi/uptrain-root-cause-analysis-api-openapi.yml
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/introduction
  - type: APIReference
    url: https://docs.uptrain.ai/predefined-evaluations/overview
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/quickstart
  - type: Documentation
    url: https://docs.uptrain.ai/predefined-evaluations/overview
- aid: uptrain:uptrain-runs-api
  name: UpTrain Runs API
  description: The Runs API from UpTrain — 3 operation(s) for runs.
  humanURL: https://docs.uptrain.ai/
  baseURL: https://demo.uptrain.ai/api/public
  tags:
  - Runs
  properties:
  - type: OpenAPI
    url: openapi/uptrain-runs-api-openapi.yml
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/introduction
  - type: APIReference
    url: https://docs.uptrain.ai/predefined-evaluations/overview
  - type: Documentation
    url: https://docs.uptrain.ai/getting-started/quickstart
  - type: Documentation
    url: https://docs.uptrain.ai/predefined-evaluations/overview
common:
- type: AgenticAccess
  url: agentic-access/uptrain-agentic-access.yml
- type: DomainSecurity
  url: security/uptrain-domain-security.yml
- type: Authentication
  url: authentication/uptrain-authentication.yml
- type: GitHubOrganization
  url: https://github.com/uptrain-ai
- type: LinkedIn
  url: https://www.linkedin.com/company/uptrain-ai
- type: Website
  url: https://uptrain.ai/
- type: Documentation
  url: https://docs.uptrain.ai/
- type: Plans
  url: plans/uptrain-plans-pricing.yml
- type: RateLimits
  url: rate-limits/uptrain-rate-limits.yml
- type: FinOps
  url: finops/uptrain-finops.yml
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com