Humanloop

Humanloop Evaluators API

The Evaluators API from Humanloop — 2 operation(s) for evaluators.

GitHub OpenAPI

Operations 3

GET /evaluators List Evaluators #
POST /evaluators Upsert Evaluator #
GET /evaluators/{id} Get Evaluator #

Specifications

⚙
OpenAPI
https://raw.githubusercontent.com/api-evangelist/humanloop/refs/heads/main/openapi/humanloop-evaluators-api-openapi.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/humanloop-evaluators-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

humanloop-evaluators-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Humanloop Datasets Evaluators API
  description: 'Humanloop''s V5 REST API for managing and calling Prompts, Tools, Datasets,

    Evaluators, Logs and Sessions. Authenticate with an API key sent as a Bearer

    token in the Authorization header (or X-API-KEY header).

    '
  version: 5.0.0
  contact:
    name: Humanloop Docs
    url: https://humanloop.com/docs
servers:
- url: https://api.humanloop.com/v5
security:
- bearerAuth: []
- apiKeyAuth: []
tags:
- name: Evaluators
paths:
  /evaluators:
    get:
      summary: List Evaluators
      operationId: listEvaluators
      responses:
        '200':
          description: OK
      tags:
      - Evaluators
    post:
      summary: Upsert Evaluator
      operationId: upsertEvaluator
      requestBody:
        required: true
        content:
          application/json:
            schema:
              type: object
      responses:
        '200':
          description: OK
      tags:
      - Evaluators
  /evaluators/{id}:
    parameters:
    - in: path
      name: id
      required: true
      schema:
        type: string
    get:
      summary: Get Evaluator
      operationId: getEvaluator
      responses:
        '200':
          description: OK
      tags:
      - Evaluators
components:
  securitySchemes:
    bearerAuth:
      type: http
      scheme: bearer
      bearerFormat: API Key
    apiKeyAuth:
      type: apiKey
      in: header
      name: X-API-KEY