AgentOps
AgentOps is an observability, evaluation, and debugging platform for AI agents. Its open-source Python SDK (with TypeScript support for OpenAI Agents) instruments agent runs in two lines of code, capturing LLM calls, tool invocations, costs, latencies, and multi-agent interactions. Sessions are visualized in a hosted dashboard at app.agentops.ai with time-travel debugging, waterfall views, and replay. AgentOps offers native integrations with 400+ LLMs and frameworks including CrewAI, AutoGen / AG2, LangChain, LangGraph, LlamaIndex, OpenAI Agents, Haystack, and Camel AI.
AgentOps publishes 3 APIs on the APIs.io network. Tagged areas include AI Agents, Observability, Evaluation, Tracing, and Python SDK.
AgentOps’ developer surface includes documentation, engineering blog, pricing, and 10 more developer resources.
Kin Score
APIs 3
Individual APIs this provider publishes, each with its own machine-readable definition.
AgentOps Python SDK
The AgentOps Python SDK is the primary entry point, installable via pip install agentops and initialized with two lines of code. It auto-instruments supported agent frameworks a...
AgentOps TypeScript SDK
AgentOps' TypeScript SDK provides instrumentation for the OpenAI Agents SDK in Node.js applications, surfacing the same traces and metrics as the Python SDK inside the AgentOps ...
AgentOps Dashboard
The hosted dashboard at app.agentops.ai visualizes agent sessions with waterfall views, time-travel replay, LLM cost tracking, and multi-agent interaction graphs. Supports sessi...
Pricing Plans 1
Published pricing tiers and plan structures.
Rate Limits 1
Documented rate limits and quota policies.
Agentops Rate Limits
RATE LIMITSFinOps 1
Cost, billing, and metering signals for API financial operations.
Agentops Finops
FINOPSFeatures 8
Notable capabilities this provider offers.
Two-Line Instrumentation
Initialize observability with agentops.init() and automatic framework instrumentation.
Session Replay
Time-travel debugging with full session and event replay in the dashboard.
LLM Cost Tracking
Token counting and cost tracking across foundation model providers and agents.
Multi-Agent Visualization
Visualize interactions between agents in CrewAI, AutoGen, LangGraph, and custom systems.
Waterfall Traces
Time-based waterfall views of all events in a session.
Custom Traces
Use the @trace decorator and OTel-aligned spans to instrument custom code paths.
Self-Hosting
Self-hosted deployment available on Enterprise plans.
SOC 2 / HIPAA
Enterprise compliance with SOC 2 and HIPAA available on the Enterprise tier.
Scroll for all 8
Security Posture 1
Authentication, domain security, vulnerability disclosure, and trust-center signals.
Use Cases 5
What developers build with this provider.
Agent Debugging
Inspect multi-step agent runs, tool calls, and intermediate reasoning to find failures.
Cost Monitoring
Track token usage and cost per agent, framework, and provider.
Agent Evaluation
Evaluate agent performance across sessions and compare versions.
Production Observability
Monitor production agents with dashboards, alerts, and exports.
Multi-Agent Systems
Visualize and debug coordination between agents in multi-agent frameworks.
Integrations 15
Pre-built integrations with other platforms and tools.
OpenAI
Native instrumentation for OpenAI Chat Completions and Responses APIs.
OpenAI Agents SDK
First-class support for OpenAI Agents in Python and TypeScript.
Anthropic
Instrumentation for Anthropic Claude models.
CrewAI
Native CrewAI integration with multi-agent visualization.
AG2 (AutoGen)
Native integration with AG2, formerly AutoGen.
LangChain
Instrumentation for LangChain chains and agents.
LangGraph
Trace and visualize LangGraph stateful agents.
LlamaIndex
Trace LlamaIndex RAG and agent applications.
Haystack
Instrumentation for Haystack pipelines.
Camel AI
Native integration with Camel AI multi-agent system.
Cohere
Instrumentation for Cohere model calls.
LiteLLM
Capture calls routed through LiteLLM across providers.
Mistral
Instrumentation for Mistral models.
Google Generative AI
Instrumentation for Gemini and Vertex AI.
xAI
Instrumentation for xAI Grok models.
Scroll for all 15
Resources
Get Started 1
Portal, sign-up, and the first successful call
Documentation 1
Reference material describing how the API behaves
Agent Surfaces 1
MCP servers, agent skills, and machine-readable catalogs
Build 2
SDKs, sample code, and the tooling you integrate with
Access & Security 1
Authentication, authorization, and security posture
Learn 1
Tutorials, courses, talks, and written guidance
Operate 1
Status, limits, changes, and where to get help
Commercial 2
Pricing, plans, and the legal terms of use
Company 3
The organization behind the API