Gentrace

Gentrace was a developer platform for evaluating and testing LLM and AI applications ("evals as infrastructure"). It provided pipelines, datasets, experiments, and test cases so teams could run offline and online evaluations, grade model outputs, track regressions, and observe AI features in production via OpenTelemetry-based instrumentation. The platform shipped a REST API (v4) secured with bearer API keys, first-party Python and TypeScript/Node SDKs, and a documented object model of pipelines, datasets, experiments, and test cases. Gentrace was based in San Francisco and backed by Matrix Partners. The company has since shut down its hosted product, but its OpenAPI specification, SDK packages, and documentation mirror remain publicly available.

Gentrace publishes 4 API contracts indexed on the APIs.io network, including Datasets API, Experiments API, Pipelines API, and 1 more. Tagged areas include Company, Artificial Intelligence, LLM, Evaluation, and Testing.

Gentrace’s developer surface includes authentication, documentation, API reference, and 16 more developer resources.

🌐 Visit website 📡 Profile data on GitHub

0.0/100 minimal ▬ flat Agent 0/100 human only Full breakdown ↓
scored 2026-10-31 · rubric v0.25.0 · Show this score on your site →

1 published contract 3 Agent Skills

Company Artificial Intelligence LLM Evaluation Testing Observability Machine Learning Developer Tools Defunct

What this lets a business do 1

Business capabilities this provider's published APIs can perform, derived from its own contracts. Browse all capabilities →

Software Product Engineering Management

BC-4200

Test Cases

POST /v4/test-cases

Kin Score

Kin Score How this is scored →
scored 2026-10-31 · rubric v0.25.0

Composite quality — 0.0/100 · minimal

Contract Quality 0.0 / 21

Developer Ergonomics 0.0 / 17

Access Clarity 0.0 / 17

Operational Transparency 0.0 / 11

Contract Governance 0.0 / 10

Discoverability 0.0 / 9

Regulatory Posture 2.3 / 15

Agent readiness — 0/100 · human only

Machine-Readable Contract 18 / 18

Agentic Access Contract 10 / 10

Documented Reversibility 0 / 6

MCP Server 0 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 8 / 8

Request/Response Examples 0 / 7

Rate-Limit Signaling 0 / 7

Typed Event Surface 0 / 6

Agent Skills 5 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Delegated User Identity 0 / 6

Protected Resource Metadata 0 / 5

Registration Without a Human 0 / 6

Agentic Commerce Well-Known Document 0 / 5

Pagination 0 / 5

Distinct Operations 3 / 3

Regulatory Posture applies to this provider. Its tags matched the Horizontal (data, software, accessibility, platform) regime, so Regulatory Posture carries 15 points of the composite. If this regime is wrong for your business, say so on your provider repo — the applicability map is public and we will correct it.

Create-or-Update Ergonomics could not be measured. We hold no machine-readable contract for this provider to read, so there is nothing to measure a write surface against. Excluded rather than scored zero: never-measured and measured-empty are different facts. Publishing an OpenAPI is what makes this facet — and several others — scorable at all.

The six quality facets above are damped to 85 points between them, because the conditional facet above carries the other 15. That is why each facet's contribution is shown against a damped maximum: raising a quality facet moves the composite by 85% of its nominal weight, not 100%. The full arithmetic is at apis.io/rating/.

Show this score on your site.

It updates itself when the score changes. Paste this where you link to your API docs:

<a href="https://apis.io/providers/gentrace/"><img src="https://apis.io/badge/gentrace/card.svg" alt="Gentrace on APIs.io — Kin Score by API Evangelist"></a>

Other styles, a README pill and a shields.io endpoint are on the badge page.

Raise your score.

Agent readiness — checks not met, largest first (exact, from this profile):

MCP Server +12 pts — deployment.mode + probe verdict on the mcp/ manifest, not the pointer; an unprobed slug falls back to authorship
Idempotency +9 pts — OpenAPI mutating operations declare an idempotency key — a header, a request-body property, or a named de-duplication token whose own description says so (verified); else common[].type matches /idempoten/i (documented)
A2A Agent Card +8 pts — a2a/-a2a.yml manifest, graded on conformance.grade against A2A 1.0.0
Rate-Limit Signaling +7 pts — OpenAPI responses document X-RateLimit-* / RateLimit headers (verified), else a rate_limits artifact or RateLimits link (documented)
Request/Response Examples +7 pts — share of operations carrying request/response examples; else an Examples / Code Samples link
Delegated User Identity +6 pts — a served discovery document listing authorization_code in grant_types_supported (served), else an oauth2 authorizationCode flow or openIdConnect declared in an OpenAPI (documented)

9 more unmet checks in the Agent Readiness table above.

Kin Score — facets with the most composite points still available (weight × headroom):

Contract Quality scores 0.0 — up to +25.0 composite points
Developer Ergonomics scores 0.0 — up to +20.0 composite points
Access Clarity scores 0.0 — up to +20.0 composite points

Each check links to what satisfies it. Publish the artifact, or tell us where it already lives, and the score moves on the next scoring run.

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from the provider profile at artifacts.apis.io/gentrace/apis.yml: open an issue on github.com/api-evangelist/gentrace to ask a question or point us at an artifact you publish. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

Markets this provider is in provisional

The Kin Score Market layer reads a provider inside its market: its position, and how deep its integrations go. Depth is only comparable within a position. Provisional and unweighted: not part of the Kin Score or agent readiness.

Market	Position	Depth	Registered MCP server	Declares compatibility
Artifact Hub Cloud-Native Packages	builds-on	36.4	-	-

Registered MCP server and declares compatibility are report only — not weighted. Undeclared means we found nothing we can read, so there is no number: we never infer integrations.

APIs 4

Individual APIs this provider publishes, each with its own machine-readable definition.

Gentrace Datasets API

The Datasets API from Gentrace — 2 operation(s) for datasets.

Gentrace Experiments API

The Experiments API from Gentrace — 2 operation(s) for experiments.

Gentrace Pipelines API

The Pipelines API from Gentrace — 2 operation(s) for pipelines.

Gentrace Test Cases API

The Test Cases API from Gentrace — 2 operation(s) for test cases.

Open Collections 4

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

Gentrace Datasets API

OPEN COLLECTION

Gentrace Datasets Experiments API

OPEN COLLECTION

Gentrace Datasets Pipelines API

OPEN COLLECTION

Gentrace Datasets TestCases API

OPEN COLLECTION

Agent Skills 3

Packaged agent skills for driving this provider's APIs from an AI assistant.

Build an evaluation dataset with test cases

AGENT SKILL

Run and track an evaluation experiment

AGENT SKILL

Set up an evaluation pipeline

AGENT SKILL

OpenAPI Overlays 1

Overlays applied on top of this provider's contracts. Each card says who wrote it: a document the provider publishes, or one API Evangelist derived or generated.

Gentrace Openapi Overlay

5 actions · update · gentrace-openapi-original.json

DERIVED

Security Posture 2

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Gentrace Authentication

http · 1 scheme

SECURITY

Gentrace Domain Security

TLSv1.3 · DMARC

SECURITY

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Gentrace Agentic Access

16 operations · 8 acting

AGENTIC

Resources

Documentation 2

Reference material describing how the API behaves

Documentation

Documentation

APIReference

APIReference

Agent Surfaces 4

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess

AgenticAccess

X-MCPServerCandidate

X-MCPServerCandidate

LLMsTxt

LLMsTxt

AgentSkill

AgentSkill

Design & Contract 5

Pagination, idempotency, versioning, errors, and events

ErrorCatalog

Conventions

DataModel

Conformance

Lifecycle

Build 3

SDKs, sample code, and the tooling you integrate with

GitHubOrganization

GitHubOrganization

Packages

Packages

SDKs

SDKs

Access & Security 2

Authentication, authorization, and security posture

DomainSecurity

DomainSecurity

Authentication

Authentication

Company 1

The organization behind the API

Website

Website

Other 2

Properties that don't map to a standard resource type

CapabilityMap

CapabilityMap

Overlay

Overlay

Source (apis.yml)

aid: gentrace
name: Gentrace
description: Gentrace was a developer platform for evaluating and testing LLM and AI applications ("evals as infrastructure").
  It provided pipelines, datasets, experiments, and test cases so teams could run offline and online evaluations, grade model
  outputs, track regressions, and observe AI features in production via OpenTelemetry-based instrumentation. The platform
  shipped a REST API (v4) secured with bearer API keys, first-party Python and TypeScript/Node SDKs, and a documented object
  model of pipelines, datasets, experiments, and test cases. Gentrace was based in San Francisco and backed by Matrix Partners.
  The company has since shut down its hosted product, but its OpenAPI specification, SDK packages, and documentation mirror
  remain publicly available.
url: https://raw.githubusercontent.com/api-evangelist/gentrace/refs/heads/main/apis.yml
x-type: company
x-source: vc-portfolio
x-backed-by:
- matrix-partners
x-tier: stub
x-tier-reason: portfolio-lead
x-status: defunct
deliveryModel:
  model: unknown
  open_source: false
  commercial: false
  callable_host: true
  label: Delivery model not determined — needs a product licence on record
  confidence: low
  source:
  - openapi
  generated: '2026-08-28'
  method: derived
accessModel:
  pricing: unknown
  onboarding: unknown
  trial: false
  try_now: false
  public: false
  label: Unknown
  confidence: low
  source:
  - authentication
  - security
  generated: '2026-09-03'
  method: derived
specificationVersion: '0.23'
created: '2026-07-17'
modified: '2026-07-19'
image: https://mintcdn.com/gentrace/9dIPysEl4JbHm2X9/logo/dark.svg
x-docs-platform: mintlify
x-docs-platform-confidence: medium
x-docs-platform-checked: 2026-10-03
tags:
- Company
- Artificial Intelligence
- LLM
- Evaluation
- Testing
- Observability
- Machine Learning
- Developer Tools
- Defunct
tags_raw:
- Company
- Ai
- LLM
- Evaluation
- Testing
- Observability
- Machine Learning
- Developer Tools
- Defunct
- Machine-Learning
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
- FN: APIs.json
  email: info@apis.io
apis:
- aid: gentrace:gentrace-datasets-api
  name: Gentrace Datasets API
  description: The Datasets API from Gentrace — 2 operation(s) for datasets.
  humanURL: https://gentrace.ai
  baseURL: https://gentrace.ai/api
  tags:
  - Datasets
  properties:
  - type: OpenAPI
    url: openapi/gentrace-datasets-api-openapi.yml
  - type: Documentation
    url: https://docs.gentrace.ai
  - type: APIReference
    url: https://docs.gentrace.ai/reference
- aid: gentrace:gentrace-experiments-api
  name: Gentrace Experiments API
  description: The Experiments API from Gentrace — 2 operation(s) for experiments.
  humanURL: https://gentrace.ai
  baseURL: https://gentrace.ai/api
  tags:
  - Experiments
  properties:
  - type: OpenAPI
    url: openapi/gentrace-experiments-api-openapi.yml
  - type: Documentation
    url: https://docs.gentrace.ai
  - type: APIReference
    url: https://docs.gentrace.ai/reference
- aid: gentrace:gentrace-pipelines-api
  name: Gentrace Pipelines API
  description: The Pipelines API from Gentrace — 2 operation(s) for pipelines.
  humanURL: https://gentrace.ai
  baseURL: https://gentrace.ai/api
  tags:
  - Pipelines
  properties:
  - type: OpenAPI
    url: openapi/gentrace-pipelines-api-openapi.yml
  - type: Documentation
    url: https://docs.gentrace.ai
  - type: APIReference
    url: https://docs.gentrace.ai/reference
- aid: gentrace:gentrace-test-cases-api
  name: Gentrace Test Cases API
  description: The Test Cases API from Gentrace — 2 operation(s) for test cases.
  humanURL: https://gentrace.ai
  baseURL: https://gentrace.ai/api
  tags:
  - Test Cases
  properties:
  - type: OpenAPI
    url: openapi/gentrace-test-cases-api-openapi.yml
  - type: Documentation
    url: https://docs.gentrace.ai
  - type: APIReference
    url: https://docs.gentrace.ai/reference
common:
- type: CapabilityMap
  url: capabilities/gentrace-capability-edges.yml
  name: Gentrace Business Capability Map
- type: DomainSecurity
  url: security/gentrace-domain-security.yml
- type: AgenticAccess
  url: agentic-access/gentrace-agentic-access.yml
- type: Authentication
  url: authentication/gentrace-authentication.yml
- type: Website
  url: https://gentrace.ai
- type: Documentation
  url: https://docs.gentrace.ai
- type: APIReference
  url: https://docs.gentrace.ai/reference
- type: GitHubOrganization
  url: https://github.com/gentrace
- type: Packages
  url: packages/gentrace-packages.yml
- type: SDKs
  url: packages/gentrace-packages.yml
- type: ErrorCatalog
  url: errors/gentrace-problem-types.yml
- type: Conventions
  url: conventions/gentrace-conventions.yml
- type: DataModel
  url: data-model/gentrace-data-model.yml
- type: Overlay
  url: overlays/gentrace-openapi-overlay.yaml
- type: Conformance
  url: conformance/gentrace-conformance.yml
- type: X-MCPServerCandidate
  url: mcp/gentrace-mcp.yml
  note: 'Renamed from MCPServer 2026-09-03 (roadmap#247): the manifest self-describes as status: candidate — a tool list derived
    from the published API contracts, not an existing server. The scorer already read the manifest and reported mcp_server
    correctly; the MCPServer type was crediting the artifact-type surfaces with a server that does not exist.'
- type: LLMsTxt
  url: llms/gentrace-llms.txt
- type: Lifecycle
  url: lifecycle/gentrace-lifecycle.yml
- type: AgentSkill
  url: skills/_index.yml
x-enrichment:
  date: '2026-07-19'
  status: backfilled
  pass: local-v1
  note: backfilled from .gitignore signal + verified work evidence

Gentrace API — frequently asked questions

Does Gentrace have an API?

Yes. APIs.io lists 4 APIs from Gentrace, including Gentrace Datasets API, Gentrace Experiments API and Gentrace Pipelines API, and 1 more.

Is there an OpenAPI specification for the Gentrace API?

Yes. APIs.io indexes 4 OpenAPI specifications for Gentrace, each linked for download from this page.

How do I authenticate with the Gentrace API?

Gentrace uses bearer-token authentication (http · 1 scheme). The details are profiled on APIs.io as Gentrace Authentication.

Is the Gentrace API ready for AI agents?

Gentrace has a Kin Score of 0.0 out of 100 (minimal) and an Agent Readiness score of 0.0 (human-only), scored by API Evangelist on 2026-10-31.

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this

find_providersBrowse and filter every provider in the catalog.
get_provider_artifactsEvery artifact this provider publishes, grouped by type.
get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
get_provider_ratingPRO — composite, band, trend and facet scores.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This provider

curl "https://apis.io/api/v1/providers/gentrace"

All providers

curl "https://apis.io/api/v1/providers?limit=25"

Every operation they expose

curl "https://apis.io/api/v1/providers/gentrace/operations?limit=25"

How their score was established

curl "https://apis.io/api/v1/providers/gentrace/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.