Humanloop

Humanloop was an LLM development platform for managing prompts, datasets, evaluations, and production observability of LLM applications, used by AI product teams at companies like Duolingo and Gusto. The platform offered a collaborative prompt editor, versioned prompts and tools, evaluation runs (LLM-as-judge and code-based), dataset management, online evaluators, and full request logging across OpenAI, Anthropic, Google, and other providers, with Python and TypeScript SDKs and a REST API. In 2025 the Humanloop team was acquired by Anthropic and the company has announced it is sunsetting the standalone platform; an official migration guide is published for existing customers. This record captures the historical API surface for archival and discovery purposes.

Humanloop publishes 6 APIs on the APIs.io network, including Datasets API, Evaluators API, Logs API, and 3 more. Tagged areas include LLM Platform, Prompt Management, Evaluations, LLMOps, and Observability.

Humanloop’s developer surface includes authentication, documentation, engineering blog, and 12 more developer resources.

🌐 Visit website 📡 Source on GitHub

40.1/100 developing ▬ flat Agent 20/100 agent aware saas Full breakdown ↓
scored 2026-09-08 · rubric v0.20.0

AccessFreeSelf serve⚡ Free to try

1 APIs

LLM PlatformPrompt Management Evaluations LLMOps Observability Datasets Prompts Tools Logs Multi-ProviderSunsettingAcquired

Kin Score

Kin Score How this is scored →
scored 2026-09-08 · rubric v0.20.0

Composite quality — 40.1/100 · developing

Contract Quality 10.6 / 23

Developer Ergonomics 5.6 / 18

Access Clarity 9.0 / 18

Operational Transparency 2.8 / 12

Contract Governance 0.0 / 11

Discoverability 6.8 / 9

Create-or-Update Ergonomics 2.2 / 10

Agent readiness — 20/100 · agent aware

Machine-Readable Contract 18 / 18

Agentic Access Contract 10 / 10

Documented Reversibility 0 / 6

MCP Server 0 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 0 / 8

Request/Response Examples 0 / 7

Rate-Limit Signaling 7 / 7

Typed Event Surface 0 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Delegated User Identity 0 / 6

Protected Resource Metadata 0 / 5

Registration Without a Human 0 / 6

Agentic Commerce Well-Known Document 0 / 5

Create-or-Update Ergonomics applies to this provider. This API accepts writes, so it carries 10 points of the composite. It is scored from the published contracts themselves: whether a caller can create-or-update in one call, whether the write accepts a key the caller already holds, and whether the response says which branch ran. Without that, every write needs a search-and-branch in front of it, and the first time that check is skipped a duplicate record is created. Scored against the observed mean rather than raw — a provider at the catalog average is unchanged by this facet, not penalised by it.

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from github.com/api-evangelist/humanloop: open an issue to ask a question, or submit a pull request to add artifacts. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

APIs 7

Individual APIs this provider publishes, each with its own machine-readable definition.

Humanloop LLM Platform API

The Humanloop REST API and SDKs covered prompts, tools, datasets, evaluations, evaluators, and logs for LLM applications. Developers called prompt endpoints from production to c...

Humanloop Datasets API

The Datasets API from Humanloop — 2 operation(s) for datasets.

Humanloop Evaluators API

The Evaluators API from Humanloop — 2 operation(s) for evaluators.

Humanloop Logs API

The Logs API from Humanloop — 2 operation(s) for logs.

Humanloop Prompts API

The Prompts API from Humanloop — 4 operation(s) for prompts.

Humanloop Sessions API

The Sessions API from Humanloop — 2 operation(s) for sessions.

Humanloop Tools API

The Tools API from Humanloop — 2 operation(s) for tools.

Scroll for all 7

Open Collections 8

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

API Collection

OPEN COLLECTION

Humanloop Datasets API

OPEN COLLECTION

Humanloop Datasets Evaluators API

OPEN COLLECTION

Humanloop Datasets Logs API

OPEN COLLECTION

Humanloop Datasets Prompts API

OPEN COLLECTION

Humanloop Datasets Sessions API

OPEN COLLECTION

Humanloop Datasets Tools API

OPEN COLLECTION

Humanloop API

OPEN COLLECTION

Scroll for all 8

Pricing Plans 1

Published pricing tiers and plan structures.

Humanloop Plans Pricing

1 plans

PLANS

Rate Limits 1

Documented rate limits and quota policies.

Humanloop Rate Limits

2 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Humanloop Finops

FINOPS

Security Posture 2

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Humanloop Authentication

apiKey/http · 2 schemes

SECURITY

Humanloop Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Humanloop Agentic Access

20 operations · 8 acting

AGENTIC

Resources

Documentation 2

Reference material describing how the API behaves

Documentation

Documentation

MigrationGuide

MigrationGuide

Agent Surfaces 2

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess

AgenticAccess

LlmsText

LlmsText

Build 1

SDKs, sample code, and the tooling you integrate with

GitHubOrganization

GitHubOrganization

Access & Security 2

Authentication, authorization, and security posture

DomainSecurity

DomainSecurity

Authentication

Authentication

Commercial 2

Pricing, plans, and the legal terms of use

TermsOfService

TermsOfService

PrivacyPolicy

PrivacyPolicy

Company 4

The organization behind the API

Website

Website

Blog

Blog

Twitter

Twitter

LinkedIn

Other 2

Properties that don't map to a standard resource type

ParentCompany

ParentCompany

MediaKit

MediaKit

Source (apis.yml)

aid: humanloop
name: Humanloop
description: Humanloop was an LLM development platform for managing prompts, datasets, evaluations, and production observability
  of LLM applications, used by AI product teams at companies like Duolingo and Gusto. The platform offered a collaborative
  prompt editor, versioned prompts and tools, evaluation runs (LLM-as-judge and code-based), dataset management, online evaluators,
  and full request logging across OpenAI, Anthropic, Google, and other providers, with Python and TypeScript SDKs and a REST
  API. In 2025 the Humanloop team was acquired by Anthropic and the company has announced it is sunsetting the standalone
  platform; an official migration guide is published for existing customers. This record captures the historical API surface
  for archival and discovery purposes.
type: Index
deliveryModel:
  model: saas
  open_source: false
  commercial: true
  callable_host: false
  label: Hosted service · you call their endpoint
  confidence: medium
  source:
  - openapi
  - pricing
  generated: '2026-08-28'
  method: derived
accessModel:
  pricing: free
  onboarding: self-serve
  trial: false
  try_now: true
  public: false
  label: Free · Self-serve signup
  confidence: medium
  source:
  - plans
  - authentication
  - security
  generated: '2026-09-03'
  method: derived
position: Producing
access: 3rd-Party
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/humanloop.png
tags:
- LLM Platform
- Prompt Management
- Evaluations
- LLMOps
- Observability
- Datasets
- Prompts
- Tools
- Logs
- Multi-Provider
- Sunsetting
- Acquired
tags_raw:
- LLM Platform
- Prompt Management
- Evaluations
- LLM Ops
- Observability
- Datasets
- Prompts
- Tools
- Logs
- Multi-Provider
- Sunsetting
- Acquired
url: https://raw.githubusercontent.com/api-evangelist/humanloop/refs/heads/main/apis.yml
created: '2026-05-23'
modified: '2026-05-23'
specificationVersion: '0.23'
apis:
- aid: humanloop:llm-platform
  name: Humanloop LLM Platform API
  description: The Humanloop REST API and SDKs covered prompts, tools, datasets, evaluations, evaluators, and logs for LLM
    applications. Developers called prompt endpoints from production to capture logs, ran evaluations against datasets, and
    managed versioned prompt configurations. The platform is being sunset following the team's acquisition by Anthropic in
    2025.
  humanURL: https://humanloop.com/docs
  baseURL: https://api.humanloop.com/v5
  tags:
  - Prompts
  - Tools
  - Datasets
  - Evaluations
  - Evaluators
  - Logs
  - File
  tags_raw:
  - Prompts
  - Tools
  - Datasets
  - Evaluations
  - Evaluators
  - Logs
  - Files
  properties:
  - type: Documentation
    url: https://humanloop.com/docs
  - type: APIReference
    url: https://humanloop.com/docs/api-reference
  - type: SDKs
    url: https://github.com/humanloop/humanloop-python
  - type: SDKs
    url: https://github.com/humanloop/humanloop-typescript
  - type: GitHubOrganization
    url: https://github.com/humanloop
  - type: MigrationGuide
    url: https://humanloop.com/docs/guides/migrating-from-humanloop
  - type: SunsetAnnouncement
    url: https://humanloop.com
  features:
  - name: Prompt Management
    description: Versioned, collaborative prompt editor with structured variables and side-by-side comparisons.
  - name: Evaluations
    description: Run dataset-driven evaluations with LLM-as-judge and code-based evaluators.
  - name: Datasets
    description: Manage curated examples and production samples for evaluations and fine-tuning.
  - name: Logs and Observability
    description: Capture every LLM call with inputs, outputs, costs, and latencies for production debugging.
  - name: Online Evaluators
    description: Score live traffic in production with custom evaluators.
  - name: Tools and Functions
    description: Define reusable tools and function specs that prompts can call.
  - name: Multi-Provider Routing
    description: Use OpenAI, Anthropic, Google, and other providers through a single API surface.
  - name: Python and TypeScript SDKs
    description: First-class SDKs for invoking prompts and logging from application code.
  useCases:
  - name: Production Prompt Iteration
    description: Update prompts in Humanloop without redeploying application code.
  - name: LLM Evaluation
    description: Score prompts and models against curated datasets before shipping.
  - name: Production Monitoring
    description: Log every LLM call and trace quality regressions in production.
  - name: Cross-Functional Collaboration
    description: Let PMs, designers, and engineers collaborate on prompts in one workbench.
  integrations:
  - name: OpenAI
  - name: Anthropic
  - name: Google
  - name: Cohere
  - name: AWS Bedrock
  - name: Azure OpenAI
  - name: LangChain
  - name: LlamaIndex
  authentication:
  - type: API Key
    description: Workspace API keys passed via the `X-API-KEY` header authenticated REST and SDK calls.
- aid: humanloop:humanloop-datasets-api
  name: Humanloop Datasets API
  description: The Datasets API from Humanloop — 2 operation(s) for datasets.
  humanURL: https://humanloop.com/docs
  baseURL: https://api.humanloop.com/v5
  tags:
  - Datasets
  properties:
  - type: OpenAPI
    url: openapi/humanloop-datasets-api-openapi.yml
- aid: humanloop:humanloop-evaluators-api
  name: Humanloop Evaluators API
  description: The Evaluators API from Humanloop — 2 operation(s) for evaluators.
  humanURL: https://humanloop.com/docs
  baseURL: https://api.humanloop.com/v5
  tags:
  - Evaluators
  properties:
  - type: OpenAPI
    url: openapi/humanloop-evaluators-api-openapi.yml
- aid: humanloop:humanloop-logs-api
  name: Humanloop Logs API
  description: The Logs API from Humanloop — 2 operation(s) for logs.
  humanURL: https://humanloop.com/docs
  baseURL: https://api.humanloop.com/v5
  tags:
  - Logs
  properties:
  - type: OpenAPI
    url: openapi/humanloop-logs-api-openapi.yml
- aid: humanloop:humanloop-prompts-api
  name: Humanloop Prompts API
  description: The Prompts API from Humanloop — 4 operation(s) for prompts.
  humanURL: https://humanloop.com/docs
  baseURL: https://api.humanloop.com/v5
  tags:
  - Prompts
  properties:
  - type: OpenAPI
    url: openapi/humanloop-prompts-api-openapi.yml
- aid: humanloop:humanloop-sessions-api
  name: Humanloop Sessions API
  description: The Sessions API from Humanloop — 2 operation(s) for sessions.
  humanURL: https://humanloop.com/docs
  baseURL: https://api.humanloop.com/v5
  tags:
  - Sessions
  properties:
  - type: OpenAPI
    url: openapi/humanloop-sessions-api-openapi.yml
- aid: humanloop:humanloop-tools-api
  name: Humanloop Tools API
  description: The Tools API from Humanloop — 2 operation(s) for tools.
  humanURL: https://humanloop.com/docs
  baseURL: https://api.humanloop.com/v5
  tags:
  - Tools
  properties:
  - type: OpenAPI
    url: openapi/humanloop-tools-api-openapi.yml
common:
- type: ParentCompany
  url: https://apis.io/providers/anthropic/
  name: Anthropic
  x-relationship: acquired
  x-evidence: In 2025 the Humanloop team was acquired by Anthropic and the company has announced it is sunsetting the standalone
    platform; an official migration guide is published for existing customers.
- type: AgenticAccess
  url: agentic-access/humanloop-agentic-access.yml
- type: DomainSecurity
  url: security/humanloop-domain-security.yml
- type: Authentication
  url: authentication/humanloop-authentication.yml
- type: Website
  url: https://humanloop.com
- type: Documentation
  url: https://humanloop.com/docs
- type: Blog
  url: https://humanloop.com/blog
- type: GitHubOrganization
  url: https://github.com/humanloop
- type: MigrationGuide
  url: https://humanloop.com/docs/guides/migrating-from-humanloop
- type: MediaKit
  url: https://humanloop.com/media-kit
- type: TermsOfService
  url: https://humanloop.com/terms
- type: PrivacyPolicy
  url: https://humanloop.com/privacy
- type: Twitter
  url: https://x.com/humanloop
- type: LinkedIn
  url: https://www.linkedin.com/company/humanloop
- type: LlmsText
  url: https://humanloop.com/llms.txt
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this

find_providersBrowse and filter every provider in the catalog.
get_provider_artifactsEvery artifact this provider publishes, grouped by type.
get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
get_provider_ratingPRO — composite, band, trend and facet scores.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This provider

curl "https://apis.io/api/v1/providers/humanloop"

All providers

curl "https://apis.io/api/v1/providers?limit=25"

Every operation they expose

curl "https://apis.io/api/v1/providers/humanloop/operations?limit=25"

How their score was established

curl "https://apis.io/api/v1/providers/humanloop/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.