Gentrace

Gentrace was a developer platform for evaluating and testing LLM and AI applications ("evals as infrastructure"). It provided pipelines, datasets, experiments, and test cases so teams could run offline and online evaluations, grade model outputs, track regressions, and observe AI features in production via OpenTelemetry-based instrumentation. The platform shipped a REST API (v4) secured with bearer API keys, first-party Python and TypeScript/Node SDKs, and a documented object model of pipelines, datasets, experiments, and test cases. Gentrace was based in San Francisco and backed by Matrix Partners. The company has since shut down its hosted product, but its OpenAPI specification, SDK packages, and documentation mirror remain publicly available.

Gentrace publishes 1 API on the APIs.io network. Tagged areas include Company, Ai, LLM, Evaluation, and Testing.

Gentrace’s developer surface includes authentication, documentation, API reference, and 15 more developer resources.

🌐 Visit website 📡 Source on GitHub
28.9/100 emerging Agent 65/100 agent native Full breakdown ↓
scored 2026-07-20 · rubric v0.4
1 APIs 1 MCP Servers 0 Features
CompanyAiLLMEvaluationTestingObservabilityMachine LearningDeveloper Tools

API Rating

API Evangelist API Evangelist Rating How this is scored →
scored 2026-07-20 · rubric v0.4
Composite quality — 28.9/100 · emerging
Contract Quality 9.4 / 25
Developer Ergonomics 9.6 / 20
Commercial Clarity 0.0 / 20
Operational Transparency 0.7 / 13
Governance 0.0 / 12
Discoverability 9.3 / 10
Agent readiness — 65/100 · agent native
Machine-Readable Contract 18 / 18
Agentic Access Contract 15 / 15
MCP Server 12 / 12
Machine-Readable Auth 10 / 10
Idempotency 0 / 9
Stable Error Semantics 8 / 8
Request/Response Examples 0 / 7
Rate-Limit Signaling 0 / 7
Typed Event Surface 0 / 6
Agent Skills 5 / 5
Well-Known Catalog 0 / 4
Consent & Bot Identity 0 / 3
Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/gentrace: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

APIs

Gentrace API

REST API (v4) for managing Gentrace pipelines, datasets, experiments, and test cases used to evaluate and test LLM/AI applications. Bearer API-key authenticated.

MCP Servers

gentrace-mcp.yml

MCP SERVER

Resources

Documentation 2

Reference material describing how the API behaves

Documentation
Documentation
 APIReference
APIReference

Agent Surfaces 4

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess
AgenticAccess
 MCPServer
MCPServer
 LLMsTxt
LLMsTxt
 AgentSkill
AgentSkill

Design & Contract 5

Pagination, idempotency, versioning, errors, and events

ErrorCatalog
ErrorCatalog
 Conventions
Conventions
 DataModel
DataModel
 Conformance
Conformance
 Lifecycle
Lifecycle

Build 3

SDKs, sample code, and the tooling you integrate with

GitHubOrganization
GitHubOrganization
 Packages
Packages
 SDKs
SDKs

Access & Security 2

Authentication, authorization, and security posture

DomainSecurity
DomainSecurity
 Authentication
Authentication

Company 1

The organization behind the API

Website
Website

Other 1

Properties that don't map to a standard resource type

Overlay
Overlay

Source (apis.yml)

apis.yml Raw ↑ 
aid: gentrace
name: Gentrace
description: Gentrace was a developer platform for evaluating and testing LLM and AI applications ("evals as infrastructure").
  It provided pipelines, datasets, experiments, and test cases so teams could run offline and online evaluations, grade model
  outputs, track regressions, and observe AI features in production via OpenTelemetry-based instrumentation. The platform
  shipped a REST API (v4) secured with bearer API keys, first-party Python and TypeScript/Node SDKs, and a documented object
  model of pipelines, datasets, experiments, and test cases. Gentrace was based in San Francisco and backed by Matrix Partners.
  The company has since shut down its hosted product, but its OpenAPI specification, SDK packages, and documentation mirror
  remain publicly available.
url: https://raw.githubusercontent.com/api-evangelist/gentrace/refs/heads/main/apis.yml
x-type: company
x-source: vc-portfolio
x-backed-by:
- matrix-partners
x-tier: stub
x-tier-reason: portfolio-lead
x-status: shutdown
specificationVersion: '0.20'
created: '2026-07-17'
modified: '2026-07-19'
image: https://mintcdn.com/gentrace/9dIPysEl4JbHm2X9/logo/dark.svg
tags:
- Company
- Ai
- LLM
- Evaluation
- Testing
- Observability
- Machine Learning
- Developer Tools
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
- FN: APIs.json
  email: info@apis.io
apis:
- name: Gentrace API
  description: REST API (v4) for managing Gentrace pipelines, datasets, experiments, and test cases used to evaluate and test
    LLM/AI applications. Bearer API-key authenticated.
  humanURL: https://gentrace.ai
  baseURL: https://gentrace.ai/api
  tags:
  - Evaluation
  - Testing
  - LLM
  properties:
  - type: OpenAPI
    url: openapi/gentrace-openapi-original.json
  - type: Documentation
    url: https://docs.gentrace.ai
  - type: APIReference
    url: https://docs.gentrace.ai/reference
common:
- type: DomainSecurity
  url: security/gentrace-domain-security.yml
- type: AgenticAccess
  url: agentic-access/gentrace-agentic-access.yml
- type: Authentication
  url: authentication/gentrace-authentication.yml
- type: Website
  url: https://gentrace.ai
- type: Documentation
  url: https://docs.gentrace.ai
- type: APIReference
  url: https://docs.gentrace.ai/reference
- type: GitHubOrganization
  url: https://github.com/gentrace
- type: Packages
  url: packages/gentrace-packages.yml
- type: SDKs
  url: packages/gentrace-packages.yml
- type: ErrorCatalog
  url: errors/gentrace-problem-types.yml
- type: Conventions
  url: conventions/gentrace-conventions.yml
- type: DataModel
  url: data-model/gentrace-data-model.yml
- type: Overlay
  url: overlays/gentrace-openapi-overlay.yaml
- type: Conformance
  url: conformance/gentrace-conformance.yml
- type: MCPServer
  url: mcp/gentrace-mcp.yml
- type: LLMsTxt
  url: llms/gentrace-llms.txt
- type: Lifecycle
  url: lifecycle/gentrace-lifecycle.yml
- type: AgentSkill
  url: skills/_index.yml
x-enrichment:
  date: '2026-07-19'
  status: backfilled
  pass: local-v1
  note: backfilled from .gitignore signal + verified work evidence