LangWatch website screenshot

LangWatch

LangWatch is an open-source LLM observability, evaluation, and AI agent testing platform. Built around OpenTelemetry-native tracing, LangWatch lets teams instrument LLM applications (LangChain, LangGraph, DSPy, OpenAI Agents, LiteLLM, Pydantic AI, CrewAI, AWS Bedrock, and more), run real-time and batch evaluations, version and deploy prompts, simulate multi-turn agent conversations against scripted scenarios and Judge Agents, manage labeled datasets, and govern model traffic through a virtual-key AI Gateway with budgets and semantic caching. The platform exposes a REST API at app.langwatch.ai, ships Python and TypeScript SDKs plus an MCP server, publishes the companion `scenario` agent-testing framework and `better-agents` standards, and runs on Apache-2.0 core (with `ee/` enterprise modules under commercial license) — deployable as LangWatch Cloud or self-hosted via Docker Compose, Helm, Kind, or full Kubernetes.

LangWatch publishes 28 APIs on the APIs.io network, including Agents API, Analytics API, Annotations API, and 25 more. Tagged areas include AI, Artificial Intelligence, LLM, LLM Observability, and LLM Evaluation.

The LangWatch catalog on APIs.io includes 1 JSON-LD context.

LangWatch’s developer surface includes authentication, developer portal, documentation, getting-started guide, signup flow, pricing, engineering blog, and 33 more developer resources.

🌐 Visit website 📡 Source on GitHub
52.9/100 developing ▬ flat Agent 49/100 agent native Full breakdown ↓
scored 2026-07-28 · rubric v0.6
AccessFreemiumSelf serve⚡ Free to try
28 APIs 17 Features
AIArtificial IntelligenceLLMLLM ObservabilityLLM EvaluationAgent TestingAgent SimulationPrompt ManagementDatasetsTracingOpenTelemetryAI GatewayDSPyLangChainOpen SourceMCPFinOps

Kin Score

Kin Score Kin Score How this is scored →
scored 2026-07-28 · rubric v0.6
Composite quality — 52.9/100 · developing
Contract Quality 14.8 / 25
Developer Ergonomics 9.6 / 20
Commercial Clarity 15.8 / 20
Operational Transparency 6.8 / 13
Governance 0.0 / 12
Discoverability 5.9 / 10
Agent readiness — 49/100 · agent native
Machine-Readable Contract 18 / 18
Agentic Access Contract 10 / 10
MCP Server 0 / 12
Machine-Readable Auth 10 / 10
Idempotency 9 / 9
Stable Error Semantics 8 / 8
Request/Response Examples 7 / 7
Rate-Limit Signaling 7 / 7
Typed Event Surface 0 / 6
Agent Skills 0 / 5
Well-Known Catalog 0 / 4
Consent & Bot Identity 0 / 3
A2A Agent Card 0 / 8
Dry-Run / Simulate Mode 0 / 4
Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/langwatch: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

APIs 28

Individual APIs this provider publishes, each with its own machine-readable definition.

LangWatch Agents API

The Agents API from LangWatch — 2 operation(s) for agents.

LangWatch Analytics API

The Analytics API from LangWatch — 1 operation(s) for analytics.

LangWatch Annotations API

The Annotations API from LangWatch — 3 operation(s) for annotations.

LangWatch Api Keys API

The Api Keys API from LangWatch — 2 operation(s) for api keys.

LangWatch Budgets API

The Budgets API from LangWatch — 2 operation(s) for budgets.

LangWatch Cache Rules API

The Cache Rules API from LangWatch — 2 operation(s) for cache rules.

LangWatch Dashboards API

The Dashboards API from LangWatch — 3 operation(s) for dashboards.

LangWatch Dataset API

The Dataset API from LangWatch — 7 operation(s) for dataset.

LangWatch Evaluations V3 API

The Evaluations V3 API from LangWatch — 2 operation(s) for evaluations v3.

LangWatch Evaluators API

The Evaluators API from LangWatch — 3 operation(s) for evaluators.

LangWatch Graphs API

The Graphs API from LangWatch — 2 operation(s) for graphs.

LangWatch LangWatch API API

The LangWatch API API from LangWatch — 1 operation(s) for langwatch api.

LangWatch Model Defaults API

The Model Defaults API from LangWatch — 2 operation(s) for model defaults.

LangWatch Model Providers API

The Model Providers API from LangWatch — 2 operation(s) for model providers.

LangWatch Monitors API

The Monitors API from LangWatch — 3 operation(s) for monitors.

LangWatch Projects API

The Projects API from LangWatch — 2 operation(s) for projects.

LangWatch Prompts API

The Prompts API from LangWatch — 8 operation(s) for prompts.

LangWatch Providers API

The Providers API from LangWatch — 2 operation(s) for providers.

LangWatch Scenario Events API

The Scenario Events API from LangWatch — 1 operation(s) for scenario events.

LangWatch Scenarios API

The Scenarios API from LangWatch — 2 operation(s) for scenarios.

LangWatch Secrets API

The Secrets API from LangWatch — 2 operation(s) for secrets.

LangWatch Simulation Runs API

The Simulation Runs API from LangWatch — 3 operation(s) for simulation runs.

LangWatch Suites API

The Suites API from LangWatch — 4 operation(s) for suites.

LangWatch Trace API

The Trace API from LangWatch — 3 operation(s) for trace.

LangWatch Traces API

The Traces API from LangWatch — 3 operation(s) for traces.

LangWatch Triggers API

The Triggers API from LangWatch — 2 operation(s) for triggers.

LangWatch Virtual Keys API

The Virtual Keys API from LangWatch — 4 operation(s) for virtual keys.

LangWatch Workflows API

The Workflows API from LangWatch — 2 operation(s) for workflows.

Scroll for all 28

Open Collections 1

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

LangWatch API

OPEN COLLECTION

Pricing Plans 1

Published pricing tiers and plan structures.

Langwatch Plans Pricing

4 plans

PLANS

Rate Limits 1

Documented rate limits and quota policies.

Langwatch Rate Limits

4 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Langwatch Finops

FINOPS

Features 17

Notable capabilities this provider offers.

OpenTelemetry-native trace ingestion via Python and TypeScript SDKs and any OTel-compliant client
Built-in evaluators — RAGAS, Azure Content Safety, OpenAI Moderation, PII, semantic similarity, language detection, LLM-as-Judge
Real-time online monitors that score production traces against configured evaluators
Batch experiments, suites, and DSPy-driven optimization workflows
Prompt versioning with feature-flag-style deployment and `prompts/sync`/`restore`
Multi-turn agent simulations with User Simulator and Judge Agents (open-source `scenario` framework)
Collaborative annotation and labeling for domain experts and PMs
Datasets — CSV upload, programmatic CRUD, trace-to-record conversion
AI Gateway with OpenAI/Anthropic-compatible proxy, virtual keys, budgets, and semantic cache rules
Open-source Apache-2.0 core, MIT-licensed SDKs, commercial `ee/` enterprise modules
Self-hostable via Docker Compose, Helm, Kind, or full Kubernetes (PostgreSQL + Redis + ClickHouse + OpenSearch)
LangWatch Cloud with three plans — Developer (free), Growth (EUR 59 / core-seat / month), Enterprise (custom)
14-day data retention on free tier, 30-day default on Growth, configurable on Enterprise
MCP server (`@langwatch/mcp-server`) exposing observability, prompts, datasets, scenarios, and evaluator tools to Claude / Cursor / other MCP clients
Integrations — OpenAI, Anthropic, Azure, AWS Bedrock, LiteLLM, LangChain, LangGraph, DSPy, OpenAI Agents, Pydantic AI, CrewAI, Autogen, Haystack
`better-agents` standards repository for agent project scaffolding
SOC 2 / ISO 27001 reports and forward-deployed engineering available under Enterprise tier

Scroll for all 17

Semantic Vocabularies 1

JSON-LD contexts and semantic vocabularies used across these APIs.

Langwatch Context

56 classes · 0 properties

JSON-LD

Security Posture 3

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Langwatch Authentication

apiKey/http · 2 schemes

SECURITY

Langwatch Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Langwatch Trust Center

ISO 27001, GDPR

SECURITY

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Langwatch Agentic Access

133 operations · 85 acting · 3 human-in-the-loop

133 operations · 85 acting

AGENTIC

Resources

Get Started 3

Portal, sign-up, and the first successful call

Portal
Portal
 GettingStarted
GettingStarted
 Signup
Signup

Documentation 9

Reference material describing how the API behaves

Documentation
Documentation
 Documentation
Documentation
 OpenAPI
OpenAPI
 Documentation
Documentation
 Documentation
Documentation
 Documentation
Documentation
 Documentation
Documentation
 Documentation
Documentation
 Documentation
Documentation

Scroll for all 9

Agent Surfaces 2

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess
AgenticAccess
 MCP
MCP

Build 9

SDKs, sample code, and the tooling you integrate with

GitHubOrganization
GitHubOrganization
 SourceCode
SourceCode
 SourceCode
SourceCode
 SourceCode
SourceCode
 SourceCode
SourceCode
 SourceCode
SourceCode
 SourceCode
SourceCode
 SDKs
SDKs
 SDKs
SDKs

Scroll for all 9

Access & Security 3

Authentication, authorization, and security posture

TrustCenter
TrustCenter
 DomainSecurity
DomainSecurity
 Authentication
Authentication

Learn 1

Tutorials, courses, talks, and written guidance

YouTube
YouTube

Operate 3

Status, limits, changes, and where to get help

RateLimits
RateLimits
 ChangeLog
ChangeLog
 Forums
Forums

Commercial 6

Pricing, plans, and the legal terms of use

Pricing
Pricing
 Plans
Plans
 FinOps
FinOps
 License
License
 TermsOfService
TermsOfService
 PrivacyPolicy
PrivacyPolicy

Company 3

The organization behind the API

Blog
Blog
 LinkedIn
LinkedIn
 Twitter
Twitter

Other 1

Properties that don't map to a standard resource type

Application
Application

Source (apis.yml)

apis.yml Raw ↑ 
aid: langwatch
name: LangWatch
description: LangWatch is an open-source LLM observability, evaluation, and AI agent testing platform. Built around OpenTelemetry-native
  tracing, LangWatch lets teams instrument LLM applications (LangChain, LangGraph, DSPy, OpenAI Agents, LiteLLM, Pydantic
  AI, CrewAI, AWS Bedrock, and more), run real-time and batch evaluations, version and deploy prompts, simulate multi-turn
  agent conversations against scripted scenarios and Judge Agents, manage labeled datasets, and govern model traffic through
  a virtual-key AI Gateway with budgets and semantic caching. The platform exposes a REST API at app.langwatch.ai, ships Python
  and TypeScript SDKs plus an MCP server, publishes the companion `scenario` agent-testing framework and `better-agents` standards,
  and runs on Apache-2.0 core (with `ee/` enterprise modules under commercial license) — deployable as LangWatch Cloud or
  self-hosted via Docker Compose, Helm, Kind, or full Kubernetes.
type: contract
accessModel:
  pricing: freemium
  onboarding: self-serve
  trial: false
  try_now: true
  public: false
  label: Freemium · Self-serve signup
  confidence: high
  source:
  - plans
  - authentication
  generated: '2026-07-22'
  method: derived
position: Consuming
access: 3rd-Party
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/langwatch.png
tags:
- AI
- Artificial Intelligence
- LLM
- LLM Observability
- LLM Evaluation
- Agent Testing
- Agent Simulation
- Prompt Management
- Datasets
- Tracing
- OpenTelemetry
- AI Gateway
- DSPy
- LangChain
- Open Source
- MCP
- FinOps
url: https://raw.githubusercontent.com/api-evangelist/langwatch/refs/heads/main/apis.yml
created: '2026-05-25'
modified: '2026-05-25'
specificationVersion: '0.20'
apis:
- aid: langwatch:langwatch-agents-api
  name: LangWatch Agents API
  description: The Agents API from LangWatch — 2 operation(s) for agents.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Agents
  properties:
  - type: OpenAPI
    url: openapi/langwatch-agents-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-analytics-api
  name: LangWatch Analytics API
  description: The Analytics API from LangWatch — 1 operation(s) for analytics.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Analytics
  properties:
  - type: OpenAPI
    url: openapi/langwatch-analytics-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-annotations-api
  name: LangWatch Annotations API
  description: The Annotations API from LangWatch — 3 operation(s) for annotations.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Annotations
  properties:
  - type: OpenAPI
    url: openapi/langwatch-annotations-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-api-keys-api
  name: LangWatch Api Keys API
  description: The Api Keys API from LangWatch — 2 operation(s) for api keys.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Api Keys
  properties:
  - type: OpenAPI
    url: openapi/langwatch-api-keys-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-budgets-api
  name: LangWatch Budgets API
  description: The Budgets API from LangWatch — 2 operation(s) for budgets.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Budgets
  properties:
  - type: OpenAPI
    url: openapi/langwatch-budgets-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-cache-rules-api
  name: LangWatch Cache Rules API
  description: The Cache Rules API from LangWatch — 2 operation(s) for cache rules.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Cache Rules
  properties:
  - type: OpenAPI
    url: openapi/langwatch-cache-rules-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-dashboards-api
  name: LangWatch Dashboards API
  description: The Dashboards API from LangWatch — 3 operation(s) for dashboards.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Dashboards
  properties:
  - type: OpenAPI
    url: openapi/langwatch-dashboards-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-dataset-api
  name: LangWatch Dataset API
  description: The Dataset API from LangWatch — 7 operation(s) for dataset.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Dataset
  properties:
  - type: OpenAPI
    url: openapi/langwatch-dataset-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-evaluations-v3-api
  name: LangWatch Evaluations V3 API
  description: The Evaluations V3 API from LangWatch — 2 operation(s) for evaluations v3.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Evaluations V3
  properties:
  - type: OpenAPI
    url: openapi/langwatch-evaluations-v3-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-evaluators-api
  name: LangWatch Evaluators API
  description: The Evaluators API from LangWatch — 3 operation(s) for evaluators.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Evaluators
  properties:
  - type: OpenAPI
    url: openapi/langwatch-evaluators-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-graphs-api
  name: LangWatch Graphs API
  description: The Graphs API from LangWatch — 2 operation(s) for graphs.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Graphs
  properties:
  - type: OpenAPI
    url: openapi/langwatch-graphs-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-langwatch-api-api
  name: LangWatch LangWatch API API
  description: The LangWatch API API from LangWatch — 1 operation(s) for langwatch api.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - LangWatch API
  properties:
  - type: OpenAPI
    url: openapi/langwatch-langwatch-api-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-model-defaults-api
  name: LangWatch Model Defaults API
  description: The Model Defaults API from LangWatch — 2 operation(s) for model defaults.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Model Defaults
  properties:
  - type: OpenAPI
    url: openapi/langwatch-model-defaults-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-model-providers-api
  name: LangWatch Model Providers API
  description: The Model Providers API from LangWatch — 2 operation(s) for model providers.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Model Providers
  properties:
  - type: OpenAPI
    url: openapi/langwatch-model-providers-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-monitors-api
  name: LangWatch Monitors API
  description: The Monitors API from LangWatch — 3 operation(s) for monitors.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Monitors
  properties:
  - type: OpenAPI
    url: openapi/langwatch-monitors-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/api-keys
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/secrets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/model-providers
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/gateway
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/workflows
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/agents
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/triggers
- aid: langwatch:langwatch-projects-api
  name: LangWatch Projects API
  description: The Projects API from LangWatch — 2 operation(s) for projects.
  humanURL: https://langwatch.ai/docs/api-reference/traces
  tags:
  - Projects
  properties:
  - type: OpenAPI
    url: openapi/langwatch-projects-api-openapi.yml
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/traces
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/evaluators
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/monitors
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/datasets
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/prompts
  - type: Documentation
    url: https://github.com/langwatch/scenario
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/simulation-runs
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/suites
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/experiments
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/annotations
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/analytics
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/dashboards
  - type: Documentation
    url: https://langwatch.ai/docs/api-reference/projects
  - type: Documentation

# --- truncated at 32 KB (60 KB total) ---
# Full source: https://raw.githubusercontent.com/api-evangelist/langwatch/refs/heads/main/apis.yml