Braintrust

Braintrust is an enterprise-grade AI observability and evaluation platform for teams building LLM applications. It provides experiment tracking, dataset management, production tracing, prompt versioning, online and offline scoring, and human review workflows. Customers include AI-native startups and large enterprises that need to compare models, iterate on prompts, catch regressions, and leverage real user data to continuously improve their AI features. Braintrust offers a SaaS platform, plus self-hosted deployments in AWS, GCP, and Azure, and monetizes through usage-based pricing tied to spans and seats.

Braintrust publishes 28 APIs on the APIs.io network, including Acls API, AiSecrets API, ApiKeys API, and 25 more. Tagged areas include Artificial Intelligence, LLM, Observability, Evaluation, and Experiments.

Braintrust’s developer surface includes authentication, documentation, engineering blog, pricing, changelog, and 8 more developer resources.

🌐 Visit website 📡 Source on GitHub

43.7/100 developing ▬ flat Agent 37/100 agent ready Full breakdown ↓
scored 2026-07-28 · rubric v0.6

AccessFreeSelf serve⚡ Free to try

29 APIs

Artificial IntelligenceLLMObservabilityEvaluationExperimentsDatasetsPromptsTracingMonitoringScoringAI EngineeringGenerative AI

Kin Score

Kin Score How this is scored →
scored 2026-07-28 · rubric v0.6

Composite quality — 43.7/100 · developing

Contract Quality 14.4 / 25

Developer Ergonomics 4.3 / 20

Commercial Clarity 12.1 / 20

Operational Transparency 5.5 / 13

Governance 0.0 / 12

Discoverability 7.4 / 10

Agent readiness — 37/100 · agent ready

Machine-Readable Contract 18 / 18

Agentic Access Contract 10 / 10

MCP Server 0 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 0 / 8

Request/Response Examples 7 / 7

Rate-Limit Signaling 7 / 7

Typed Event Surface 0 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/braintrust: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

APIs 29

Individual APIs this provider publishes, each with its own machine-readable definition.

Rate Limits 1

Documented rate limits and quota policies.

Braintrust Rate Limits

2 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Documentation 1

Reference material describing how the API behaves

Documentation

Documentation

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess

AgenticAccess

Build 1

SDKs, sample code, and the tooling you integrate with

GitHubOrganization

GitHubOrganization

Access & Security 2

Authentication, authorization, and security posture

DomainSecurity

DomainSecurity

Authentication

Authentication

Operate 1

Status, limits, changes, and where to get help

ChangeLog

ChangeLog

Commercial 3

Pricing, plans, and the legal terms of use

Pricing

Pricing

TermsOfService

TermsOfService

PrivacyPolicy

PrivacyPolicy

Company 3

The organization behind the API

Website

Website

Blog

Blog

LinkedIn

Other 1

Properties that don't map to a standard resource type

Source (apis.yml)

aid: braintrust
name: Braintrust
description: Braintrust is an enterprise-grade AI observability and evaluation platform for teams building LLM applications.
  It provides experiment tracking, dataset management, production tracing, prompt versioning, online and offline scoring,
  and human review workflows. Customers include AI-native startups and large enterprises that need to compare models, iterate
  on prompts, catch regressions, and leverage real user data to continuously improve their AI features. Braintrust offers
  a SaaS platform, plus self-hosted deployments in AWS, GCP, and Azure, and monetizes through usage-based pricing tied to
  spans and seats.
type: Index
accessModel:
  pricing: free
  onboarding: self-serve
  trial: false
  try_now: true
  public: false
  label: Free · Self-serve signup
  confidence: high
  source:
  - plans
  - authentication
  generated: '2026-07-22'
  method: derived
position: Provider
access: 3rd-Party
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/braintrust.png
tags:
- Artificial Intelligence
- LLM
- Observability
- Evaluation
- Experiments
- Datasets
- Prompts
- Tracing
- Monitoring
- Scoring
- AI Engineering
- Generative AI
url: https://raw.githubusercontent.com/api-evangelist/braintrust/refs/heads/main/apis.yml
created: '2026-05-23'
modified: '2026-05-23'
specificationVersion: '0.20'
apis:
- aid: braintrust:braintrust-api
  name: Braintrust API
  description: The Braintrust REST API provides programmatic access to projects, experiments, datasets, prompts, functions,
    logs, and organization resources. It supports both US (api.braintrust.dev) and EU (api-eu.braintrust.dev) data planes,
    and is used to log production traces, run evaluations, manage prompt versions, and orchestrate scoring functions.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - LLM
  - Evaluation
  - Observability
  - Experiments
  - Datasets
  - Prompts
  - Tracing
  properties:
  - type: Documentation
    url: https://www.braintrust.dev/docs
  - type: GettingStarted
    url: https://www.braintrust.dev/docs/start
  - type: Signup
    url: https://www.braintrust.dev/signup
  - type: API
    url: https://www.braintrust.dev/docs/reference/api
  - type: SDKs
    url: https://github.com/braintrustdata/braintrust-sdk
  - type: SDKs
    url: https://pypi.org/project/braintrust/
  - type: SDKs
    url: https://www.npmjs.com/package/braintrust
  - type: GitHubRepository
    url: https://github.com/braintrustdata/autoevals
  - type: Pricing
    url: https://www.braintrust.dev/pricing
  - type: Authentication
    url: https://www.braintrust.dev/docs/reference/api
  features:
  - name: Experiments
    description: Create, run, and compare evaluation experiments across model and prompt versions to catch regressions before
      shipping.
  - name: Datasets
    description: Manage versioned datasets of inputs, expected outputs, and metadata for repeatable evaluation runs.
  - name: Production Logging
    description: Capture LLM spans, tool calls, and traces from production traffic via SDK or OTEL-compatible ingestion.
  - name: Prompt Management
    description: Version, deploy, and A/B test prompts independent of application deploys.
  - name: Autoevals and Custom Scorers
    description: Use built-in LLM-as-judge scorers or define custom Python and TypeScript scoring functions.
  - name: Human Review
    description: Route traces and experiment runs to subject-matter experts for annotation and grading.
  - name: Online Scoring
    description: Run scorers continuously against production logs to monitor drift and quality.
  - name: Functions and Tools
    description: Register reusable tools, scorers, and workflows that can be invoked from prompts or experiments.
  - name: Self-Hosting
    description: Deploy Braintrust inside your own AWS, GCP, or Azure account for data residency and compliance.
  useCases:
  - name: LLM Application Quality Gating
    description: Block deploys when evaluation scores regress against a golden dataset.
  - name: Prompt Iteration
    description: Compare prompt and model variants side-by-side with traceable scores.
  - name: Production Monitoring
    description: Detect hallucinations, latency spikes, and cost regressions in live AI traffic.
  - name: Agent Evaluation
    description: Evaluate multi-step agent runs, tool calls, and retrieval performance.
  - name: RAG Tuning
    description: Optimize retrieval and generation pipelines using dataset-driven experiments.
  integrations:
  - name: OpenAI
  - name: Anthropic
  - name: Google Gemini
  - name: LangChain
  - name: LlamaIndex
  - name: Vercel AI SDK
  - name: AutoGen
  - name: CrewAI
  - name: LangGraph
  - name: Firebase Genkit
  - name: OpenTelemetry
  - name: AWS Bedrock
  authentication:
  - type: Bearer Token
    description: API keys and service tokens generated in the Braintrust dashboard are passed via the Authorization header
      as a Bearer token.
- aid: braintrust:braintrust-acls-api
  name: Braintrust Acls API
  description: The Acls API from Braintrust — 4 operation(s) for acls.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Acls
  properties:
  - type: OpenAPI
    url: openapi/braintrust-acls-api-openapi.yml
- aid: braintrust:braintrust-aisecrets-api
  name: Braintrust AiSecrets API
  description: The AiSecrets API from Braintrust — 2 operation(s) for aisecrets.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - AiSecrets
  properties:
  - type: OpenAPI
    url: openapi/braintrust-aisecrets-api-openapi.yml
- aid: braintrust:braintrust-apikeys-api
  name: Braintrust ApiKeys API
  description: The ApiKeys API from Braintrust — 2 operation(s) for apikeys.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - ApiKeys
  properties:
  - type: OpenAPI
    url: openapi/braintrust-apikeys-api-openapi.yml
- aid: braintrust:braintrust-cors-api
  name: Braintrust CORS API
  description: The CORS API from Braintrust — 65 operation(s) for cors.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - CORS
  properties:
  - type: OpenAPI
    url: openapi/braintrust-cors-api-openapi.yml
- aid: braintrust:braintrust-crossobject-api
  name: Braintrust CrossObject API
  description: The CrossObject API from Braintrust — 1 operation(s) for crossobject.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - CrossObject
  properties:
  - type: OpenAPI
    url: openapi/braintrust-crossobject-api-openapi.yml
- aid: braintrust:braintrust-datasets-api
  name: Braintrust Datasets API
  description: The Datasets API from Braintrust — 6 operation(s) for datasets.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Datasets
  properties:
  - type: OpenAPI
    url: openapi/braintrust-datasets-api-openapi.yml
- aid: braintrust:braintrust-datasetsnapshots-api
  name: Braintrust DatasetSnapshots API
  description: The DatasetSnapshots API from Braintrust — 2 operation(s) for datasetsnapshots.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - DatasetSnapshots
  properties:
  - type: OpenAPI
    url: openapi/braintrust-datasetsnapshots-api-openapi.yml
- aid: braintrust:braintrust-environments-api
  name: Braintrust Environments API
  description: The Environments API from Braintrust — 2 operation(s) for environments.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Environments
  properties:
  - type: OpenAPI
    url: openapi/braintrust-environments-api-openapi.yml
- aid: braintrust:braintrust-envvars-api
  name: Braintrust EnvVars API
  description: The EnvVars API from Braintrust — 2 operation(s) for envvars.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - EnvVars
  properties:
  - type: OpenAPI
    url: openapi/braintrust-envvars-api-openapi.yml
- aid: braintrust:braintrust-evals-api
  name: Braintrust Evals API
  description: The Evals API from Braintrust — 1 operation(s) for evals.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Evals
  properties:
  - type: OpenAPI
    url: openapi/braintrust-evals-api-openapi.yml
- aid: braintrust:braintrust-experiments-api
  name: Braintrust Experiments API
  description: The Experiments API from Braintrust — 6 operation(s) for experiments.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Experiments
  properties:
  - type: OpenAPI
    url: openapi/braintrust-experiments-api-openapi.yml
- aid: braintrust:braintrust-functions-api
  name: Braintrust Functions API
  description: The Functions API from Braintrust — 3 operation(s) for functions.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Functions
  properties:
  - type: OpenAPI
    url: openapi/braintrust-functions-api-openapi.yml
- aid: braintrust:braintrust-groups-api
  name: Braintrust Groups API
  description: The Groups API from Braintrust — 2 operation(s) for groups.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Groups
  properties:
  - type: OpenAPI
    url: openapi/braintrust-groups-api-openapi.yml
- aid: braintrust:braintrust-logs-api
  name: Braintrust Logs API
  description: The Logs API from Braintrust — 3 operation(s) for logs.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Logs
  properties:
  - type: OpenAPI
    url: openapi/braintrust-logs-api-openapi.yml
- aid: braintrust:braintrust-mcpservers-api
  name: Braintrust McpServers API
  description: The McpServers API from Braintrust — 2 operation(s) for mcpservers.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - McpServers
  properties:
  - type: OpenAPI
    url: openapi/braintrust-mcpservers-api-openapi.yml
- aid: braintrust:braintrust-organizations-api
  name: Braintrust Organizations API
  description: The Organizations API from Braintrust — 3 operation(s) for organizations.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Organizations
  properties:
  - type: OpenAPI
    url: openapi/braintrust-organizations-api-openapi.yml
- aid: braintrust:braintrust-other-api
  name: Braintrust Other API
  description: The Other API from Braintrust — 1 operation(s) for other.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Other
  properties:
  - type: OpenAPI
    url: openapi/braintrust-other-api-openapi.yml
- aid: braintrust:braintrust-projectautomations-api
  name: Braintrust ProjectAutomations API
  description: The ProjectAutomations API from Braintrust — 2 operation(s) for projectautomations.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - ProjectAutomations
  properties:
  - type: OpenAPI
    url: openapi/braintrust-projectautomations-api-openapi.yml
- aid: braintrust:braintrust-projects-api
  name: Braintrust Projects API
  description: The Projects API from Braintrust — 2 operation(s) for projects.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Projects
  properties:
  - type: OpenAPI
    url: openapi/braintrust-projects-api-openapi.yml
- aid: braintrust:braintrust-projectscores-api
  name: Braintrust ProjectScores API
  description: The ProjectScores API from Braintrust — 2 operation(s) for projectscores.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - ProjectScores
  properties:
  - type: OpenAPI
    url: openapi/braintrust-projectscores-api-openapi.yml
- aid: braintrust:braintrust-projecttags-api
  name: Braintrust ProjectTags API
  description: The ProjectTags API from Braintrust — 2 operation(s) for projecttags.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - ProjectTags
  properties:
  - type: OpenAPI
    url: openapi/braintrust-projecttags-api-openapi.yml
- aid: braintrust:braintrust-prompts-api
  name: Braintrust Prompts API
  description: The Prompts API from Braintrust — 2 operation(s) for prompts.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Prompts
  properties:
  - type: OpenAPI
    url: openapi/braintrust-prompts-api-openapi.yml
- aid: braintrust:braintrust-proxy-api
  name: Braintrust Proxy API
  description: The Proxy API from Braintrust — 6 operation(s) for proxy.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Proxy
  properties:
  - type: OpenAPI
    url: openapi/braintrust-proxy-api-openapi.yml
- aid: braintrust:braintrust-roles-api
  name: Braintrust Roles API
  description: The Roles API from Braintrust — 2 operation(s) for roles.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Roles
  properties:
  - type: OpenAPI
    url: openapi/braintrust-roles-api-openapi.yml
- aid: braintrust:braintrust-servicetokens-api
  name: Braintrust ServiceTokens API
  description: The ServiceTokens API from Braintrust — 2 operation(s) for servicetokens.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - ServiceTokens
  properties:
  - type: OpenAPI
    url: openapi/braintrust-servicetokens-api-openapi.yml
- aid: braintrust:braintrust-spaniframes-api
  name: Braintrust SpanIframes API
  description: The SpanIframes API from Braintrust — 2 operation(s) for spaniframes.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - SpanIframes
  properties:
  - type: OpenAPI
    url: openapi/braintrust-spaniframes-api-openapi.yml
- aid: braintrust:braintrust-users-api
  name: Braintrust Users API
  description: The Users API from Braintrust — 2 operation(s) for users.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Users
  properties:
  - type: OpenAPI
    url: openapi/braintrust-users-api-openapi.yml
- aid: braintrust:braintrust-views-api
  name: Braintrust Views API
  description: The Views API from Braintrust — 2 operation(s) for views.
  humanURL: https://www.braintrust.dev/docs
  baseURL: https://api.braintrust.dev
  tags:
  - Views
  properties:
  - type: OpenAPI
    url: openapi/braintrust-views-api-openapi.yml
common:
- type: AgenticAccess
  url: agentic-access/braintrust-agentic-access.yml
- type: DomainSecurity
  url: security/braintrust-domain-security.yml
- type: Authentication
  url: authentication/braintrust-authentication.yml
- type: Website
  url: https://www.braintrust.dev
- type: Documentation
  url: https://www.braintrust.dev/docs
- type: Blog
  url: https://www.braintrust.dev/blog
- type: GitHubOrganization
  url: https://github.com/braintrustdata
- type: Pricing
  url: https://www.braintrust.dev/pricing
- type: TermsOfService
  url: https://www.braintrust.dev/legal/terms
- type: PrivacyPolicy
  url: https://www.braintrust.dev/legal/privacy
- type: X
  url: https://x.com/braintrustdata
- type: LinkedIn
  url: https://www.linkedin.com/company/braintrustdata
- type: ChangeLog
  url: https://www.braintrust.dev/changelog
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com