LangWatch website screenshot

LangWatch

LangWatch is an open-source LLM observability, evaluation, and AI agent testing platform. Built around OpenTelemetry-native tracing, LangWatch lets teams instrument LLM applications (LangChain, LangGraph, DSPy, OpenAI Agents, LiteLLM, Pydantic AI, CrewAI, AWS Bedrock, and more), run real-time and batch evaluations, version and deploy prompts, simulate multi-turn agent conversations against scripted scenarios and Judge Agents, manage labeled datasets, and govern model traffic through a virtual-key AI Gateway with budgets and semantic caching. The platform exposes a REST API at app.langwatch.ai, ships Python and TypeScript SDKs plus an MCP server, publishes the companion `scenario` agent-testing framework and `better-agents` standards, and runs on Apache-2.0 core (with `ee/` enterprise modules under commercial license) — deployable as LangWatch Cloud or self-hosted via Docker Compose, Helm, Kind, or full Kubernetes.

LangWatch publishes 28 APIs on the APIs.io network, including Agents API, Analytics API, Annotations API, and 25 more. Tagged areas include Artificial Intelligence, LLM, LLM Observability, LLM Evaluation, and Agent Testing.

The LangWatch catalog on APIs.io includes 1 JSON-LD context.

LangWatch’s developer surface includes authentication, developer portal, documentation, getting-started guide, signup flow, pricing, engineering blog, and 39 more developer resources.

🌐 Visit website 📡 Source on GitHub
47.1/100 developing ▬ flat Agent 36/100 agent ready saas · Apache-2.0 (core); `ee/` modules commercial Full breakdown ↓
scored 2026-09-08 · rubric v0.20.0
AccessFreemiumSelf serve⚡ Free to try
1 APIs 17 Features
Artificial IntelligenceLLMLLM ObservabilityLLM EvaluationAgent TestingAgent SimulationPrompt ManagementDatasetsTracingOpenTelemetryAI GatewayDSPyLangChainOpen-SourceMCPFinOps

Kin Score

Kin Score Kin Score How this is scored →
scored 2026-09-08 · rubric v0.20.0
Composite quality — 47.1/100 · developing
Contract Quality 13.3 / 23
Developer Ergonomics 7.7 / 18
Access Clarity 10.9 / 18
Operational Transparency 5.2 / 12
Contract Governance 0.0 / 11
Discoverability 4.8 / 9
Create-or-Update Ergonomics 1.1 / 10
Agent readiness — 36/100 · agent ready
Machine-Readable Contract 18 / 18
Agentic Access Contract 10 / 10
Documented Reversibility 6 / 6
MCP Server 0 / 12
Machine-Readable Auth 10 / 10
Idempotency 9 / 9
Stable Error Semantics 8 / 8
Request/Response Examples 7 / 7
Rate-Limit Signaling 7 / 7
Typed Event Surface 0 / 6
Agent Skills 0 / 5
Well-Known Catalog 0 / 4
Consent & Bot Identity 0 / 3
A2A Agent Card 0 / 8
Dry-Run / Simulate Mode 0 / 4
Delegated User Identity 0 / 6
Protected Resource Metadata 0 / 5
Registration Without a Human 0 / 6
Agentic Commerce Well-Known Document 0 / 5
Create-or-Update Ergonomics applies to this provider. This API accepts writes, so it carries 10 points of the composite. It is scored from the published contracts themselves: whether a caller can create-or-update in one call, whether the write accepts a key the caller already holds, and whether the response says which branch ran. Without that, every write needs a search-and-branch in front of it, and the first time that check is skipped a duplicate record is created. Scored against the observed mean rather than raw — a provider at the catalog average is unchanged by this facet, not penalised by it.
Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from github.com/api-evangelist/langwatch: open an issue to ask a question, or submit a pull request to add artifacts. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

APIs 28

Individual APIs this provider publishes, each with its own machine-readable definition.

LangWatch Agents API

The Agents API from LangWatch — 2 operation(s) for agents.

LangWatch Analytics API

The Analytics API from LangWatch — 1 operation(s) for analytics.

LangWatch Annotations API

The Annotations API from LangWatch — 3 operation(s) for annotations.

LangWatch Api Keys API

The Api Keys API from LangWatch — 2 operation(s) for api keys.

LangWatch Budgets API

The Budgets API from LangWatch — 2 operation(s) for budgets.

LangWatch Cache Rules API

The Cache Rules API from LangWatch — 2 operation(s) for cache rules.

LangWatch Dashboards API

The Dashboards API from LangWatch — 3 operation(s) for dashboards.

LangWatch Dataset API

The Dataset API from LangWatch — 7 operation(s) for dataset.

LangWatch Evaluations V3 API

The Evaluations V3 API from LangWatch — 2 operation(s) for evaluations v3.

LangWatch Evaluators API

The Evaluators API from LangWatch — 3 operation(s) for evaluators.

LangWatch Graphs API

The Graphs API from LangWatch — 2 operation(s) for graphs.

LangWatch LangWatch API API

The LangWatch API API from LangWatch — 1 operation(s) for langwatch api.

LangWatch Model Defaults API

The Model Defaults API from LangWatch — 2 operation(s) for model defaults.

LangWatch Model Providers API

The Model Providers API from LangWatch — 2 operation(s) for model providers.

LangWatch Monitors API

The Monitors API from LangWatch — 3 operation(s) for monitors.

LangWatch Projects API

The Projects API from LangWatch — 2 operation(s) for projects.

LangWatch Prompts API

The Prompts API from LangWatch — 8 operation(s) for prompts.

LangWatch Providers API

The Providers API from LangWatch — 2 operation(s) for providers.

LangWatch Scenario Events API

The Scenario Events API from LangWatch — 1 operation(s) for scenario events.

LangWatch Scenarios API

The Scenarios API from LangWatch — 2 operation(s) for scenarios.

LangWatch Secrets API

The Secrets API from LangWatch — 2 operation(s) for secrets.

LangWatch Simulation Runs API

The Simulation Runs API from LangWatch — 3 operation(s) for simulation runs.

LangWatch Suites API

The Suites API from LangWatch — 4 operation(s) for suites.

LangWatch Trace API

The Trace API from LangWatch — 3 operation(s) for trace.

LangWatch Traces API

The Traces API from LangWatch — 3 operation(s) for traces.

LangWatch Triggers API

The Triggers API from LangWatch — 2 operation(s) for triggers.

LangWatch Virtual Keys API

The Virtual Keys API from LangWatch — 4 operation(s) for virtual keys.

LangWatch Workflows API

The Workflows API from LangWatch — 2 operation(s) for workflows.

Scroll for all 28

Open Collections 30

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

API Collection

OPEN COLLECTION

LangWatch Agents API

OPEN COLLECTION

LangWatch Agents Analytics API

OPEN COLLECTION

LangWatch Agents Annotations API

OPEN COLLECTION

LangWatch Agents Api Keys API

OPEN COLLECTION

LangWatch Agents Budgets API

OPEN COLLECTION

LangWatch Agents Cache Rules API

OPEN COLLECTION

LangWatch Agents Dashboards API

OPEN COLLECTION

LangWatch Agents Dataset API

OPEN COLLECTION

LangWatch Agents Evaluations V3 API

OPEN COLLECTION

LangWatch Agents Evaluators API

OPEN COLLECTION

LangWatch Agents Graphs API

OPEN COLLECTION

LangWatch Agents LangWatch API API

OPEN COLLECTION

LangWatch Agents Model Defaults API

OPEN COLLECTION

LangWatch Agents Model Providers API

OPEN COLLECTION

LangWatch Agents Monitors API

OPEN COLLECTION

LangWatch Agents Projects API

OPEN COLLECTION

LangWatch Agents Prompts API

OPEN COLLECTION

LangWatch Agents Providers API

OPEN COLLECTION

LangWatch Agents Scenario Events API

OPEN COLLECTION

LangWatch Agents Scenarios API

OPEN COLLECTION

LangWatch Agents Secrets API

OPEN COLLECTION

LangWatch Agents Simulation Runs API

OPEN COLLECTION

LangWatch Agents Suites API

OPEN COLLECTION

LangWatch Agents Trace API

OPEN COLLECTION

LangWatch Agents Traces API

OPEN COLLECTION

LangWatch Agents Triggers API

OPEN COLLECTION

LangWatch Agents Virtual Keys API

OPEN COLLECTION

LangWatch Agents Workflows API

OPEN COLLECTION

LangWatch API

OPEN COLLECTION

Scroll for all 30

Pricing Plans 1

Published pricing tiers and plan structures.

Langwatch Plans Pricing

4 plans

PLANS

Rate Limits 1

Documented rate limits and quota policies.

Langwatch Rate Limits

4 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Langwatch Finops

FINOPS

Features 17

Notable capabilities this provider offers.

OpenTelemetry-native trace ingestion via Python and TypeScript SDKs and any OTel-compliant client
Built-in evaluators — RAGAS, Azure Content Safety, OpenAI Moderation, PII, semantic similarity, language detection, LLM-as-Judge
Real-time online monitors that score production traces against configured evaluators
Batch experiments, suites, and DSPy-driven optimization workflows
Prompt versioning with feature-flag-style deployment and `prompts/sync`/`restore`
Multi-turn agent simulations with User Simulator and Judge Agents (open-source `scenario` framework)
Collaborative annotation and labeling for domain experts and PMs
Datasets — CSV upload, programmatic CRUD, trace-to-record conversion
AI Gateway with OpenAI/Anthropic-compatible proxy, virtual keys, budgets, and semantic cache rules
Open-source Apache-2.0 core, MIT-licensed SDKs, commercial `ee/` enterprise modules
Self-hostable via Docker Compose, Helm, Kind, or full Kubernetes (PostgreSQL + Redis + ClickHouse + OpenSearch)
LangWatch Cloud with three plans — Developer (free), Growth (EUR 59 / core-seat / month), Enterprise (custom)
14-day data retention on free tier, 30-day default on Growth, configurable on Enterprise
MCP server (`@langwatch/mcp-server`) exposing observability, prompts, datasets, scenarios, and evaluator tools to Claude / Cursor / other MCP clients
Integrations — OpenAI, Anthropic, Azure, AWS Bedrock, LiteLLM, LangChain, LangGraph, DSPy, OpenAI Agents, Pydantic AI, CrewAI, Autogen, Haystack
`better-agents` standards repository for agent project scaffolding
SOC 2 / ISO 27001 reports and forward-deployed engineering available under Enterprise tier

Scroll for all 17

Semantic Vocabularies 1

JSON-LD contexts and semantic vocabularies used across these APIs.

Langwatch Context

56 classes · 0 properties

JSON-LD

Security Posture 3

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Langwatch Authentication

apiKey/http · 2 schemes

SECURITY

Langwatch Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Langwatch Trust Center

ISO 27001, GDPR

SECURITY

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Langwatch Agentic Access

133 operations · 85 acting · 3 human-in-the-loop

133 operations · 85 acting

AGENTIC

Resources

Get Started 3

Portal, sign-up, and the first successful call

Portal
Portal
 GettingStarted
GettingStarted
 Signup
Signup

Documentation 11

Reference material describing how the API behaves

ContributionGuide
ContributionGuide
 Documentation
Documentation
 Documentation
Documentation
 OpenAPI
OpenAPI
 Documentation
Documentation
 Documentation
Documentation
 Documentation
Documentation
 Documentation
Documentation
 Documentation
Documentation
 Documentation
Documentation
 Documentation
Documentation

Scroll for all 11

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess
AgenticAccess

Build 9

SDKs, sample code, and the tooling you integrate with

GitHubOrganization
GitHubOrganization
 SourceCode
SourceCode
 SourceCode
SourceCode
 SourceCode
SourceCode
 SourceCode
SourceCode
 SourceCode
SourceCode
 SourceCode
SourceCode
 SDKs
SDKs
 SDKs
SDKs

Scroll for all 9

Access & Security 4

Authentication, authorization, and security posture

SecurityPolicy
SecurityPolicy
 TrustCenter
TrustCenter
 DomainSecurity
DomainSecurity
 Authentication
Authentication

Learn 1

Tutorials, courses, talks, and written guidance

YouTube
YouTube

Operate 5

Status, limits, changes, and where to get help

IssueTracker
IssueTracker
 Releases
Releases
 RateLimits
RateLimits
 ChangeLog
ChangeLog
 Forums
Forums

Commercial 6

Pricing, plans, and the legal terms of use

Pricing
Pricing
 Plans
Plans
 FinOps
FinOps
 License
License
 TermsOfService
TermsOfService
 PrivacyPolicy
PrivacyPolicy

Company 4

The organization behind the API

Website
Website
 Blog
Blog
 LinkedIn
LinkedIn
 Twitter
Twitter

Other 2

Properties that don't map to a standard resource type

CapabilityMap
CapabilityMap
 Application
Application

Source (apis.yml)

apis.yml Raw ↑ 
aid: langwatch
name: LangWatch
description: LangWatch is an open-source LLM observability, evaluation, and AI agent testing platform. Built around OpenTelemetry-native
  tracing, LangWatch lets teams instrument LLM applications (LangChain, LangGraph, DSPy, OpenAI Agents, LiteLLM, Pydantic
  AI, CrewAI, AWS Bedrock, and more), run real-time and batch evaluations, version and deploy prompts, simulate multi-turn
  agent conversations against scripted scenarios and Judge Agents, manage labeled datasets, and govern model traffic through
  a virtual-key AI Gateway with budgets and semantic caching. The platform exposes a REST API at app.langwatch.ai, ships Python
  and TypeScript SDKs plus an MCP server, publishes the companion `scenario` agent-testing framework and `better-agents` standards,
  and runs on Apache-2.0 core (with `ee/` enterprise modules under commercial license) — deployable as LangWatch Cloud or
  self-hosted via Docker Compose, Helm, Kind, or full Kubernetes.
type: contract
deliveryModel:
  model: saas
  license: Apache-2.0 (core); `ee/` modules commercial
  open_source: false
  commercial: true
  callable_host: true
  label: Hosted service · you call their endpoint
  confidence: high
  source:
  - license
  - openapi
  - pricing
  generated: '2026-08-28'
  method: derived
accessModel:
  pricing: freemium
  onboarding: self-serve
  trial: false
  try_now: true
  public: false
  label: Freemium · Self-serve signup
  confidence: medium
  source:
  - plans
  - authentication
  - security
  generated: '2026-09-03'
  method: derived
position: Consuming
access: 3rd-Party
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/langwatch.png
tags:
- Artificial Intelligence
- LLM
- LLM Observability
- LLM Evaluation
- Agent Testing
- Agent Simulation
- Prompt Management
- Datasets
- Tracing
- OpenTelemetry
- AI Gateway
- DSPy
- LangChain
- Open-Source
- MCP
- FinOps
tags_raw:
- AI
- Artificial Intelligence
- LLM
- LLM Observability
- LLM Evaluation
- Agent Testing
- Agent Simulation
- Prompt Management
- Datasets
- Tracing
- OpenTelemetry
- AI Gateway
- DSPy
- LangChain
- Open Source
- MCP
- FinOps
url: https://raw.githubusercontent.com/api-evangelist/langwatch/refs/heads/main/apis.yml
created: '2026-05-25'
modified: '2026-05-25'
specificationVersion: '0.23'
apis:
- aid: langwatch:langwatch-agents-api
  name: LangWatch Agents API
  description: The Agents API from LangWatch — 2 operation(s) for agents.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Agents
  properties:
  - type: OpenAPI
    url: openapi/langwatch-agents-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-analytics-api
  name: LangWatch Analytics API
  description: The Analytics API from LangWatch — 1 operation(s) for analytics.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Analytics
  properties:
  - type: OpenAPI
    url: openapi/langwatch-analytics-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-annotations-api
  name: LangWatch Annotations API
  description: The Annotations API from LangWatch — 3 operation(s) for annotations.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Annotations
  properties:
  - type: OpenAPI
    url: openapi/langwatch-annotations-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-api-keys-api
  name: LangWatch Api Keys API
  description: The Api Keys API from LangWatch — 2 operation(s) for api keys.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - APIKeys
  tags_raw:
  - Api Keys
  properties:
  - type: OpenAPI
    url: openapi/langwatch-api-keys-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-budgets-api
  name: LangWatch Budgets API
  description: The Budgets API from LangWatch — 2 operation(s) for budgets.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Budgets
  properties:
  - type: OpenAPI
    url: openapi/langwatch-budgets-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-cache-rules-api
  name: LangWatch Cache Rules API
  description: The Cache Rules API from LangWatch — 2 operation(s) for cache rules.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Cache Rules
  properties:
  - type: OpenAPI
    url: openapi/langwatch-cache-rules-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-dashboards-api
  name: LangWatch Dashboards API
  description: The Dashboards API from LangWatch — 3 operation(s) for dashboards.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Dashboards
  properties:
  - type: OpenAPI
    url: openapi/langwatch-dashboards-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-dataset-api
  name: LangWatch Dataset API
  description: The Dataset API from LangWatch — 7 operation(s) for dataset.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Dataset
  properties:
  - type: OpenAPI
    url: openapi/langwatch-dataset-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-evaluations-v3-api
  name: LangWatch Evaluations V3 API
  description: The Evaluations V3 API from LangWatch — 2 operation(s) for evaluations v3.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Evaluations V3
  properties:
  - type: OpenAPI
    url: openapi/langwatch-evaluations-v3-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-evaluators-api
  name: LangWatch Evaluators API
  description: The Evaluators API from LangWatch — 3 operation(s) for evaluators.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Evaluators
  properties:
  - type: OpenAPI
    url: openapi/langwatch-evaluators-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-graphs-api
  name: LangWatch Graphs API
  description: The Graphs API from LangWatch — 2 operation(s) for graphs.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Graphs
  properties:
  - type: OpenAPI
    url: openapi/langwatch-graphs-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-langwatch-api-api
  name: LangWatch LangWatch API API
  description: The LangWatch API API from LangWatch — 1 operation(s) for langwatch api.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - LangWatch API
  properties:
  - type: OpenAPI
    url: openapi/langwatch-langwatch-api-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-model-defaults-api
  name: LangWatch Model Defaults API
  description: The Model Defaults API from LangWatch — 2 operation(s) for model defaults.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Model Defaults
  properties:
  - type: OpenAPI
    url: openapi/langwatch-model-defaults-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-model-providers-api
  name: LangWatch Model Providers API
  description: The Model Providers API from LangWatch — 2 operation(s) for model providers.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Model Providers
  properties:
  - type: OpenAPI
    url: openapi/langwatch-model-providers-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-monitors-api
  name: LangWatch Monitors API
  description: The Monitors API from LangWatch — 3 operation(s) for monitors.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Monitors
  properties:
  - type: OpenAPI
    url: openapi/langwatch-monitors-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-projects-api
  name: LangWatch Projects API
  description: The Projects API from LangWatch — 2 operation(s) for projects.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Project
  tags_raw:
  - Projects
  properties:
  - type: OpenAPI
    url: openapi/langwatch-projects-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: 

# --- truncated at 32 KB (61 KB total) ---
# Full source: https://raw.githubusercontent.com/api-evangelist/langwatch/refs/heads/main/apis.yml

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this
  • find_providersBrowse and filter every provider in the catalog.
  • get_provider_artifactsEvery artifact this provider publishes, grouped by type.
  • get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
  • get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
  • get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
  • get_provider_ratingPRO — composite, band, trend and facet scores.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This provider 
curl "https://apis.io/api/v1/providers/langwatch"
All providers 
curl "https://apis.io/api/v1/providers?limit=25"
Every operation they expose 
curl "https://apis.io/api/v1/providers/langwatch/operations?limit=25"
How their score was established 
curl "https://apis.io/api/v1/providers/langwatch/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.