classifier-dev · Schema

BenchmarkSummary

CompanyMachine LearningNatural Language ProcessingClassificationOpenAPI

Properties

Name Type Description
measured string When the live measurement ran.
summary object Per test set (ag_news, emotion): n, how many items Jev was unsure about, and one row per run (jev, fast, smart).
View JSON Schema on GitHub

JSON Schema

classifier-dev-benchmark-summary-schema.json Raw ↑
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "https://artifacts.apis.io/classifier-dev/json-schema/classifier-dev-benchmark-summary-schema.json",
  "title": "BenchmarkSummary",
  "x-generated": "2026-11-10",
  "x-method": "derived",
  "x-generator": "derive-json-schema.py",
  "x-source": "openapi/classifier-dev-docs-api-openapi.yml#/components/schemas/BenchmarkSummary",
  "type": "object",
  "required": [
    "measured",
    "summary"
  ],
  "properties": {
    "measured": {
      "type": "string",
      "format": "date",
      "description": "When the live measurement ran."
    },
    "summary": {
      "type": "object",
      "description": "Per test set (ag_news, emotion): n, how many items Jev was unsure about, and one row per run (jev, fast, smart).",
      "additionalProperties": {
        "type": "object",
        "required": [
          "n",
          "unsure",
          "rows"
        ],
        "properties": {
          "n": {
            "type": "integer"
          },
          "unsure": {
            "type": "integer"
          },
          "rows": {
            "type": "object",
            "additionalProperties": {
              "type": "object",
              "properties": {
                "acc": {
                  "type": "number"
                },
                "acc_unsure": {
                  "type": [
                    "number",
                    "null"
                  ]
                },
                "acc_sure": {
                  "type": [
                    "number",
                    "null"
                  ]
                },
                "agree_with_jev": {
                  "type": "number"
                },
                "disagreements": {
                  "type": "integer"
                },
                "disagreements_unsure": {
                  "type": "integer"
                },
                "escalated": {
                  "type": "integer"
                },
                "ms_item": {
                  "type": "number"
                },
                "cost_per_1k": {
                  "type": "number"
                }
              }
            }
          }
        }
      }
    }
  }
}

Work with this as data

Every JSON Schema here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for schemas

4 MCP tools reach this
  • find_json_schemasBrowse and filter every JSON Schema in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This JSON Schema
curl "https://apis.io/api/v1/json-schemas/classifier-dev-benchmark-summary"
All schemas
curl "https://apis.io/api/v1/json-schemas?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.