find_apisBrowse and filter every API in the catalog.
get_api_artifactsOne API's artifacts, grouped by type.
get_openapiThe primary OpenAPI for this API.
find_similar_apisAPIs that look like this one.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This API

curl "https://apis.io/api/v1/apis/cyberelf-link:cyberelf-link-open-bench-api"

All apis

curl "https://apis.io/api/v1/apis?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

openapi: 3.2.0
info:
  description: Verifier-grounded evaluation tools for AI systems. Workbench and report-card requests are stateless and unauthenticated; payloads and results are not persisted. Open Promotion Bench may persist only an opt-in public manifest and sanitized receipt, never task contents or answers. Operational counters and standard access logs are retained.
  license:
    name: AGPL-3.0-or-later
    url: https://www.gnu.org/licenses/agpl-3.0.html
  title: Whetstone Tools Open Bench API
  version: 0.8.0
  x-build-commit: 780558024ed039fc19bd626d956b4bd3267d61f5
servers:
- url: https://whetstone.cyberelf.link
tags:
- name: Open Bench
paths:
  /api/open-bench/leaderboard:
    get:
      operationId: openBenchLeaderboard
      responses:
        '200':
          description: OK
      summary: Opt-in, self-attested public Open Promotion Bench receipts
      tags:
      - Open Bench
  /api/open-bench/receipt/{public_id}:
    get:
      operationId: openBenchReceipt
      parameters:
      - in: path
        name: public_id
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
        '404':
          description: Not found
      summary: One sanitized public benchmark receipt
      tags:
      - Open Bench
  /api/open-bench/start:
    post:
      operationId: openBenchStart
      requestBody:
        content:
          application/json:
            schema:
              additionalProperties: false
              properties:
                challenge:
                  maxLength: 128
                  minLength: 8
                  type: string
              type: object
        required: true
      responses:
        '200':
          description: One-shot session and tasks
        '429':
          description: Rate limited
      summary: Start a paired six-item scope-integrity cohort
      tags:
      - Open Bench
  /api/open-bench/submit:
    post:
      operationId: openBenchSubmit
      responses:
        '200':
          description: PASS/HOLD/BLOCK receipt
        '400':
          description: Input error
        '429':
          description: Rate limited
      summary: Grade paired baseline/candidate patches and optionally publish a sanitized…
      tags:
      - Open Bench