Bem

Bem Function Accuracy API

Monitor, evaluate, and iterate on the quality of every function in your environment. Function Accuracy bundles two complementary loops: ## Evaluations (`/v3/eval`) Trigger and retrieve per-transformation evaluations. Evaluations run asynchronously and score each transformation's output against the function's schema for confidence, per-field hallucination detection, and relevance. Supported for `extract`, `transform`, `analyze`, and `join` events. 1. **Trigger** — `POST /v3/eval` queues jobs for a batch of transformation IDs. 2. **Poll** — `GET /v3/eval/results` returns the current state of each requested ID, partitioned into `results`, `pending`, and `failed`. Accepts either `eventIDs` (preferred) or `transformationIDs` as a comma-separated query parameter, and always keys the response by event KSUID. Up to 100 IDs may be submitted per request. ## Metrics, review, regression (`/v3/functions/{metrics,review,regression,compare}`) Roll evaluation results and user corrections up into actionable function-level signal: - **`GET /v3/functions/metrics`** — aggregate accuracy, precision, recall, F1, and confusion-matrix counts per function. - **`POST /v3/functions/review`** — sample-size estimation, confidence-bucketed distribution, PR-AUC, and per-threshold confidence intervals (Wald or Wilson) for picking review cutoffs. - **`POST /v3/functions/regression`** — replay corrected historical inputs against a new function version, producing a labeled regression dataset. - **`POST /v3/functions/regression/corrections`** — propagate baseline corrections onto the regression dataset so it can be scored. - **`POST /v3/functions/compare`** — compute aggregate and field-level lift between any two versions, optionally scoped to the regression dataset. All five endpoints support `extract` end-to-end on both the vision and OCR paths, alongside the legacy `transform` / `analyze` / `join` types.

Operations 10

POST /v3/eval Trigger Transformation Evaluations #
GET /v3/eval/results Get Evaluation Results #
POST /v3/eval/score Score Function Against (input, expected) Pairs #
GET /v3/eval/score/{scoreRunID} Get Score Run #
POST /v3/eval/score/{scoreRunID}/cancel Cancel Score Run #
POST /v3/functions/compare Compare Metrics Between Function Versions #
GET /v3/functions/metrics Get Function Metrics #
POST /v3/functions/regression Run Function Regression Testing #
POST /v3/functions/regression/corrections Apply Baseline Corrections to Regression Transformations #
POST /v3/functions/review Function Review #

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API
curl "https://apis.io/api/v1/apis/bem-function-accuracy-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

bem-function-accuracy-api-openapi.yml Raw ↑
openapi: 3.2.0
info:
  title: Bem Function Accuracy API
  version: 1.0.0
  description: 'Monitor, evaluate, and iterate on the quality of every function in your

    environment.'
servers:
- url: https://api.bem.ai
  description: US Region API
  variables: {}
- url: https://api.eu1.bem.ai
  description: EU Region API
  variables: {}
security:
- API Key: []
tags:


# --- truncated at 32 KB (68 KB total) ---
# Full source: https://raw.githubusercontent.com/api-evangelist/bem/refs/heads/main/openapi/bem-function-accuracy-api-openapi.yml