Roark · Schema
BenchmarkMetric
A metric a suite version published, and the direction that counts as better
CompanyVoice AITestingEvaluationBenchmarking
Properties
| Name | Type | Description |
|---|---|---|
| metricKey | string | |
| metricName | string | |
| metricKind | string | Which statistics are populated on a result. NUMERIC fills p50/p95/mean/ci; BOOLEAN fills passRate and its interval. |
| unitSymbol | stringnull | |
| goal | string | Which end of the scale is better. `higher` and `lower` can be ranked; `neutral` is an observational metric that describes a conversation rather than grading it, so sorting on it names no winner. |
JSON Schema
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"$id": "https://artifacts.apis.io/roark/json-schema/roark-benchmark-metric-schema.json",
"title": "BenchmarkMetric",
"description": "A metric a suite version published, and the direction that counts as better",
"x-generated": "2026-11-10",
"x-method": "derived",
"x-generator": "derive-json-schema.py",
"x-source": "openapi/roark-benchmark-api-openapi.yml#/components/schemas/BenchmarkMetric",
"type": "object",
"properties": {
"metricKey": {
"type": "string"
},
"metricName": {
"type": "string"
},
"metricKind": {
"type": "string",
"enum": [
"NUMERIC",
"BOOLEAN"
],
"description": "Which statistics are populated on a result. NUMERIC fills p50/p95/mean/ci; BOOLEAN fills passRate and its interval."
},
"unitSymbol": {
"type": [
"string",
"null"
]
},
"goal": {
"type": "string",
"enum": [
"higher",
"lower",
"neutral"
],
"description": "Which end of the scale is better. `higher` and `lower` can be ranked; `neutral` is an observational metric that describes a conversation rather than grading it, so sorting on it names no winner."
}
},
"required": [
"metricKey",
"metricName",
"metricKind",
"unitSymbol",
"goal"
]
}
Work with this as data
Every JSON Schema here is available over the APIs.io API and to AI agents over MCP.
MCP server
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
Tools for schemas
4 MCP tools reach this
find_json_schemasBrowse and filter every JSON Schema in the catalog.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.
Call it yourself
curl for this page
This JSON Schema
curl "https://apis.io/api/v1/json-schemas/roark-benchmark-metric"
All schemas
curl "https://apis.io/api/v1/json-schemas?limit=25"
Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.
Get an API key
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.