Roark · Schema

BenchmarkMetric

A metric a suite version published, and the direction that counts as better

CompanyVoice AITestingEvaluationBenchmarking

Properties

Name Type Description
metricKey string
metricName string
metricKind string Which statistics are populated on a result. NUMERIC fills p50/p95/mean/ci; BOOLEAN fills passRate and its interval.
unitSymbol stringnull
goal string Which end of the scale is better. `higher` and `lower` can be ranked; `neutral` is an observational metric that describes a conversation rather than grading it, so sorting on it names no winner.
View JSON Schema on GitHub

JSON Schema

roark-benchmark-metric-schema.json Raw ↑
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "https://artifacts.apis.io/roark/json-schema/roark-benchmark-metric-schema.json",
  "title": "BenchmarkMetric",
  "description": "A metric a suite version published, and the direction that counts as better",
  "x-generated": "2026-11-10",
  "x-method": "derived",
  "x-generator": "derive-json-schema.py",
  "x-source": "openapi/roark-benchmark-api-openapi.yml#/components/schemas/BenchmarkMetric",
  "type": "object",
  "properties": {
    "metricKey": {
      "type": "string"
    },
    "metricName": {
      "type": "string"
    },
    "metricKind": {
      "type": "string",
      "enum": [
        "NUMERIC",
        "BOOLEAN"
      ],
      "description": "Which statistics are populated on a result. NUMERIC fills p50/p95/mean/ci; BOOLEAN fills passRate and its interval."
    },
    "unitSymbol": {
      "type": [
        "string",
        "null"
      ]
    },
    "goal": {
      "type": "string",
      "enum": [
        "higher",
        "lower",
        "neutral"
      ],
      "description": "Which end of the scale is better. `higher` and `lower` can be ranked; `neutral` is an observational metric that describes a conversation rather than grading it, so sorting on it names no winner."
    }
  },
  "required": [
    "metricKey",
    "metricName",
    "metricKind",
    "unitSymbol",
    "goal"
  ]
}

Work with this as data

Every JSON Schema here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for schemas

4 MCP tools reach this
  • find_json_schemasBrowse and filter every JSON Schema in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This JSON Schema
curl "https://apis.io/api/v1/json-schemas/roark-benchmark-metric"
All schemas
curl "https://apis.io/api/v1/json-schemas?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.