CrawlCheck Benchmark API

The Benchmark API from CrawlCheck — 2 operation(s) for benchmark.

GitHub OpenAPI

Operations 2

0 of 2 operations are conformant: apis.io called them with no credentials and the responses matched this contract; 1 more answered but could not be checked against a schema. Checked 2026-11-12. how this works · status file

GET /api/v1/benchmark Agent safety benchmark: the frozen suite (sha256, families, cases) and the… observed #
GET /api/benchmark Intelligence line: corpus percentile and next band, cohort metrics, and the… #

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API
curl "https://apis.io/api/v1/apis/crawlcheck-io:crawlcheck-io-benchmark-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

crawlcheck-io-benchmark-api-openapi.yml Raw ↑
openapi: 3.2.0
info:
  title: Crawlcheck Io Benchmark API
  version: '1'
  contact:
    name: CrawlCheck
    url: https://crawlcheck.io/policy
    email: hello@crawlcheck.io
  license:
    name: Terms
    url: https://crawlcheck.io/policy
  x-core-contract:
    promise: 'These operations are the core contract. They stay at /api/v1 and keep answering for at least 180 days after any /api/v2 is announced; their stable fields change only in a new major version, and their provisional fields only after 30 days'' notice, per /docs/api/compatibility. Verifying what they return needs none of these calls: crawlcheck-verify.mjs checks a document on your machine against the published keys (/.well-known/http-message-signatures-directory) and the rotation record, read once with --online or saved for --keys. Everything else documented here is useful but secondary, and may change with the notice its fields'' tags promise.'
    operations:
    - method: GET
      path: /api/v1/resolve
      operationId: resolveDomainV1
    - method: POST
      path: /api/v1/resolve
      operationId: resolveBatchV1
    - method: POST
      path: /api/v1/preflight
      operationId: preflightV1
    - method: GET
      path: /api/v1/decisions/{sha256}
      operationId: decisionCheckV1
    - method: GET
      path: /api/v1/revocations
      operationId: revocations
    - method: GET
      path: /api/v1/visitor
      operationId: visitorResolveV1
    - method: POST
      path: /api/v1/visitor
      operationId: visitorResolveBatchV1
    - method: GET
      path: /api/v1/mcp/scan
      operationId: mcpScanUrl
    - method: POST
      path: /api/v1/mcp/lock/check
      operationId: mcpLockCheck
    list: https://crawlcheck.io/api/v1/core
  description: 'Operations tagged Benchmark across 2 of this provider''s published API definitions: crawlcheck-io-openapi.json, crawlcheck-io-openapi.yml. Each path carries the servers of the definition it was published in.'
servers:
- url: https://crawlcheck.io
tags:
- name: Benchmark
paths:
  /api/v1/benchmark:
    get:
      operationId: agentSafetyBenchmark
      summary: 'Agent safety benchmark: the frozen suite (sha256, families, cases) and the…'
      responses:
        '200':
          description: crawlcheck-agent-safety-benchmark
          content:
            application/json:
              schema:
                type: object
              examples:
                worked:
                  summary: Shape; not a measurement.
                  value:
                    kind: crawlcheck-agent-safety-benchmark
                    v: 1
                    suite:
                      v: 1
                      sha256: …
                      url: https://crawlcheck.io/benchmark/suite-v1.json
                      families:
                      - lookalike
                      - poisoned_tool
                      - revoked
                      - stale
                      cases: 27
                      hazards: 14
                    run:
                      run_id: bn-2026-10-07-…
                      progress:
                        done: 216
                        of: 216
                      models:
                      - name: Model A
                        arms:
                          alone:
                            total:
                              safety: 0.5
                              usefulness: 0.9
                              score: 0.7
                          with:
                            total:
                              safety: 1
                              usefulness: 0.9
                              score: 0.95
                    sha256: …
                    signature: …
      x-codeSamples:
      - lang: Shell
        label: curl
        source: curl -s https://crawlcheck.io/api/v1/benchmark
      security: []
      x-auth: public; no credential read
      tags:
      - Benchmark
    servers:
    - url: https://crawlcheck.io
  /api/benchmark:
    get:
      operationId: benchmark
      summary: 'Intelligence line: corpus percentile and next band, cohort metrics, and the…'
      parameters:
      - name: domain
        in: query
        schema:
          type: string
      - name: id
        in: query
        schema:
          type: string
      responses:
        '200':
          description: crawlcheck-benchmark
          content:
            application/json:
              examples:
                worked:
                  summary: Intelligence add-on. With a licence covering the domain every finding carries its share of the corpus; on any other domain only the top finding does. Produced by the real Worker code in the build harness against live scans of the named domains, with a test licence and a test Ed25519 key; production signs with the key published at /.well-known/http-message-signatures-directory.
                  value:
                    kind: crawlcheck-benchmark
                    v: 1
                    generated_at: '2026-10-01T16:02:23.202Z'
                    subject:
                      domain: treeservicedenverllc.com
                      host: treeservicedenverllc.com
                      report_id: jq8bq52ycw
                      scanned_at: '2026-10-01T16:02:08.081Z'
                      grade: A
                      overall: 100
                      score_version: 26
                      certified: true
                    corpus:
                      sites: 45
                      percentile: 96
                      higher_than: 43
                      note: higher than 96% of the 45 sites CrawlCheck has measured - that is this corpus (sites people chose to scan), not the web
                    cohort:
                      name: wordpress/publisher
                      peers: 1
                      scope: corpus
                      early: true
                      reference: null
                    metrics: []
                    next_band:
                      percentile_now: 96
                      next_band: 100
                      score_at_band: 100
                      points_short: 0
                      sites_above: 0
                    best_single_fix: null
                    best_single_fix_withheld: null
                    findings:
                      visible: []
                      withheld: 0
                      shares:
                        corpus_scans: 4
                        watched_domains: 3
                        as_of: '2026-10-01T16:02:07.510Z'
                        note: share_of_scans = the share of every scan in the corpus that carried the code (the figure /data publishes); rare < 10%, uncommon < 35%, common otherwise. watched_sites_now = of the domains measured daily, how many carry it on their latest r…
                    method: Percentile and band from the headline score of every measured domain (recomputed on every call). Per-metric percentiles are the record's own benchmark against its cohort (same CMS and site kind) when it has 8+ peers, else the corpus. Findi…
              schema:
                type:
                - object
                - 'null'
                properties:
                  kind:
                    type:
                    - string
                    - 'null'
                  v:
                    type:
                    - number
                    - 'null'
                  generated_at:
                    type:
                    - string
                    - 'null'
                  subject:
                    type:
                    - object
                    - 'null'
                    properties:
                      domain:
                        type:
                        - string
                        - 'null'
                      host:
                        type:
                        - string
                        - 'null'
                      report_id:
                        type:
                        - string
                        - 'null'
                      scanned_at:
                        type:
                        - string
                        - 'null'
                      grade:
                        type:
                        - string
                        - 'null'
                      overall:
                        type:
                        - number
                        - 'null'
                      score_version:
                        type:
                        - number
                        - 'null'
                      certified:
                        type:
                        - boolean
                        - 'null'
                    additionalProperties: true
                  corpus:
                    type:
                    - object
                    - 'null'
                    properties:
                      sites:
                        type:
                        - number
                        - 'null'
                      percentile:
                        type:
                        - number
                        - 'null'
                      higher_than:
                        type:
                        - number
                        - 'null'
                      note:
                        type:
                        - string
                        - 'null'
                    additionalProperties: true
                  cohort:
                    type:
                    - object
                    - 'null'
                    properties:
                      name:
                        type:
                        - string
                        - 'null'
                      peers:
                        type:
                        - number
                        - 'null'
                      scope:
                        type:
                        - string
                        - 'null'
                      early:
                        type:
                        - boolean
                        - 'null'
                      reference: {}
                    additionalProperties: true
                  metrics:
                    type:
                    - array
                    - 'null'
                    items: {}
                  next_band:
                    type:
                    - object
                    - 'null'
                    properties:
                      percentile_now:
                        type:
                        - number
                        - 'null'
                      next_band:
                        type:
                        - number
                        - 'null'
                      score_at_band:
                        type:
                        - number
                        - 'null'
                      points_short:
                        type:
                        - number
                        - 'null'
                      sites_above:
                        type:
                        - number
                        - 'null'
                    additionalProperties: true
                  best_single_fix: {}
                  best_single_fix_withheld: {}
                  findings:
                    type:
                    - object
                    - 'null'
                    properties:
                      visible:
                        type:
                        - array
                        - 'null'
                        items: {}
                      withheld:
                        type:
                        - number
                        - 'null'
                      shares:
                        type:
                        - object
                        - 'null'
                        properties:
                          corpus_scans:
                            type:
                            - number
                            - 'null'
                          watched_domains:
                            type:
                            - number
                            - 'null'
                          as_of:
                            type:
                            - string
                            - 'null'
                          note: {}
                        additionalProperties: true
                    additionalProperties: true
                  method: {}
                additionalProperties: true
                x-schema-source: worked-example
        '403':
          description: no Intelligence add-on
        '404':
          description: no record
      x-codeSamples:
      - lang: Shell
        label: curl
        source: "curl -s \\\n  -H \"x-crawlcheck-key: $CRAWLCHECK_KEY\" \\\n  'https://crawlcheck.io/api/benchmark?domain=conductor.com'"
      security:
      - licenceKey: []
      - bearer: []
      x-auth: 'a licence key (x-crawlcheck-key or Authorization: Bearer) or the signed-in /manage session; 401 or 403 otherwise'
      tags:
      - Benchmark
    servers:
    - url: https://crawlcheck.io
components:
  securitySchemes:
    licenceKey:
      type: apiKey
      in: header
      name: x-crawlcheck-key
      description: 'Your licence key: cc_ followed by 32 hex characters. Sent on every keyed call.'
    bearer:
      type: http
      scheme: bearer
      description: The same licence key as a Bearer token. Accepted on /api/v1/* and /api/usage.
externalDocs:
  url: https://crawlcheck.io/docs/api
  description: Human-readable reference
x-refined-from:
- crawlcheck-io-openapi.json
- crawlcheck-io-openapi.yml