Snorkel AI

Evaluation

Platform and SDK capabilities for assessing model performance across data splits, running error and slice analysis, and building expert-curated benchmarks. Largely delivered in-platform and through the SDK against a customer's Snorkel Flow instance rather than a public REST endpoint.

Documentation GitHub OpenAPI

Documentation

📖

Documentation

https://docs.snorkel.ai/docs/25.3/user-guide/sdk/

📖

APIReference

https://docs.snorkel.ai/docs/0.95/sdk/

Specifications

⚙

OpenAPI

https://raw.githubusercontent.com/api-evangelist/snorkel-ai/refs/heads/main/openapi/_original/snorkel-ai-openapi.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this

find_apisBrowse and filter every API in the catalog.
get_api_artifactsOne API's artifacts, grouped by type.
get_openapiThe primary OpenAPI for this API.
find_similar_apisAPIs that look like this one.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools

Call it yourself

curl for this page

This API

curl "https://apis.io/api/v1/apis/evaluation"

All apis

curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

openapi: 3.0.1
info:
  title: Snorkel Flow Platform API
  description: >-
    Snorkel Flow is an enterprise AI data-development platform driven
    programmatically through the snorkelflow Python SDK. The SDK's
    snorkelflow.client module is documented as "Interfaces to interact with the
    Snorkel Flow REST API", so a REST surface exists - but it is exposed by each
    customer's own Snorkel Flow deployment at a per-instance hostname
    (https://<your-snorkel-hostname>), authenticated with a per-user API key via
    SnorkelFlowContext. Snorkel does not publish a single hosted, public base URL
    or an endpoint-level REST reference; the developer contract is the Python SDK
    (datasets, applications, operators, labeling functions, model training, and
    evaluation), not individually documented HTTP paths. No public REST endpoints
    are enumerated here to avoid fabrication; consult the SDK API reference for the
    supported programmatic surface. The free, open-source snorkel library is a
    local Python dependency and is not a network API.
  termsOfService: https://snorkel.ai/terms-of-service/
  contact:
    name: Snorkel AI
    url: https://snorkel.ai/contact/
  version: '25.3'
servers:
  - url: https://{snorkelHostname}
    description: >-
      Per-instance Snorkel Flow deployment endpoint. Replace {snorkelHostname}
      with your organization's Snorkel Flow host. There is no shared public host.
    variables:
      snorkelHostname:
        default: your-snorkel-hostname
        description: The hostname of your Snorkel Flow instance.
paths: {}
components:
  securitySchemes:
    apiKey:
      type: apiKey
      in: header
      name: Authorization
      description: >-
        Snorkel Flow API key supplied to the SDK via SnorkelFlowContext. Keys are
        per-user and may be rotated by the platform on re-authentication.
security:
  - apiKey: []