Cyberelf Labs Inspect API
The Inspect API from Cyberelf Labs — 1 operation(s) for inspect.
Work with this as data
Every API here is available over the APIs.io API and to AI agents over MCP.
MCP server
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
Tools for apis
7 MCP tools reach this
find_apisBrowse and filter every API in the catalog.get_api_artifactsOne API's artifacts, grouped by type.get_openapiThe primary OpenAPI for this API.find_similar_apisAPIs that look like this one.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.
Call it yourself
curl for this page
This API
curl "https://apis.io/api/v1/apis/cyberelf-link:cyberelf-link-inspect-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.
Get an API key
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.
OpenAPI Specification
openapi: 3.2.0
info:
description: Verifier-grounded evaluation tools for AI systems. Workbench and report-card requests are stateless and unauthenticated; payloads and results are not persisted. Open Promotion Bench may persist only an opt-in public manifest and sanitized receipt, never task contents or answers. Operational counters and standard access logs are retained.
license:
name: AGPL-3.0-or-later
url: https://www.gnu.org/licenses/agpl-3.0.html
title: Whetstone Tools Inspect API
version: 0.8.0
x-build-commit: 780558024ed039fc19bd626d956b4bd3267d61f5
servers:
- url: https://whetstone.cyberelf.link
tags:
- name: Inspect
paths:
/api/inspect:
post:
operationId: inspector
requestBody:
content:
application/json:
example:
baseline:
item-1: false
item-2: false
item-3: false
item-4: false
item-5: false
item-6: false
item-7: false
item-8: false
baseline_name: v1
candidate:
item-1: true
item-2: true
item-3: true
item-4: true
item-5: true
item-6: true
item-7: false
item-8: true
candidate_name: v2
exam:
- domain: code
item_id: item-1
prompt: Repair a Python retry loop without changing its public return type.
- domain: code
item_id: item-2
prompt: Reject a malformed JSON payload while preserving valid zero values.
- domain: code
item_id: item-3
prompt: Identify the smallest safe patch for an off-by-one pagination bug.
- domain: code
item_id: item-4
prompt: Keep an asynchronous worker idempotent after a duplicate delivery.
- domain: support
item_id: item-5
prompt: Explain a delayed shipment without inventing a delivery date.
- domain: support
item_id: item-6
prompt: Apply the refund policy while preserving the stated eligibility window.
- domain: support
item_id: item-7
prompt: Reset a locked customer password after identity verification.
- domain: support
item_id: item-8
prompt: Summarize a refund policy without changing eligibility dates.
exposure:
- item_id: item-8
source: training.jsonl:42
- prompt: After identity verification, safely reset the locked customer password.
source: support-sft.jsonl:91
policy:
confidence_alpha: 0.05
max_regressions: 0
min_gains: 1
schema:
additionalProperties: false
description: Audit exposure, prove a complete clean cohort, then gate baseline versus candidate.
properties:
baseline:
additionalProperties:
type: boolean
description: item_id -> boolean pass/fail result for the baseline system.
maxProperties: 5000
minProperties: 1
type: object
baseline_name:
default: baseline
type: string
candidate:
additionalProperties:
type: boolean
description: item_id -> boolean pass/fail result for the candidate system.
maxProperties: 5000
minProperties: 1
type: object
candidate_name:
default: candidate
type: string
domains:
additionalProperties:
type: string
description: Optional item_id -> domain label mapping.
type: object
enable_behavioral_fingerprint:
default: true
type: boolean
enable_text_similarity:
default: true
type: boolean
exam:
description: Exam rows. Each row needs item_id (or id) plus prompt/content/input/task/question/expression.
items:
additionalProperties: true
properties: {}
type: object
maxItems: 5000
minItems: 1
type: array
exposure:
description: Declared exposure rows carrying identity/content fields and an optional source or path.
items:
additionalProperties: true
properties: {}
type: object
maxItems: 5000
minItems: 0
type: array
fingerprint_max_n:
default: 4
maximum: 5
minimum: 3
type: integer
policy:
additionalProperties: false
description: Explicit promotion policy. Omitted fields use the documented defaults.
properties:
confidence_alpha:
default: 0.05
exclusiveMinimum: 0
maximum: 1
type: number
max_regressions:
default: 0
minimum: 0
type: integer
min_gains:
default: 1
minimum: 0
type: integer
require_retained_probe:
default: false
type: boolean
type: object
retained_probe:
additionalProperties: false
description: Optional retained-capability result checked alongside the paired cohort.
properties:
base_verified:
minimum: 0
type: integer
candidate_verified:
minimum: 0
type: integer
items:
minimum: 0
type: integer
required:
- base_verified
- candidate_verified
- items
type: object
similarity_threshold:
default: 0.6
maximum: 1
minimum: 0.5
type: number
required:
- exam
- baseline
- candidate
type: object
required: true
responses:
'200':
description: Deterministic receipt with item-level decision path and SHA-256 hashes.
'400':
description: Input error (a hint points at /api/examples).
'429':
description: Rate limited.
summary: Quarantine exposure, compare paired outcomes, and issue a receipt
tags:
- Inspect