AimRank Tier Delivery API
The Tier Delivery API from AimRank — 4 operation(s) for tier delivery.
The Tier Delivery API from AimRank — 4 operation(s) for tier delivery.
Every API here is available over the APIs.io API and to AI agents over MCP.
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
find_apisBrowse and filter every API in the catalog.get_api_artifactsOne API's artifacts, grouped by type.get_openapiThe primary OpenAPI for this API.find_similar_apisAPIs that look like this one.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.curl "https://apis.io/api/v1/apis/aimrank-io:aimrank-io-tier-delivery-api"
curl "https://apis.io/api/v1/apis?limit=25"
Discovery needs no key. Ratings and market analysis are Pro.
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.
openapi: 3.2.0
info:
title: AimRank Tier Delivery API
description: Ranking-as-a-Service API — Turn binary comparisons into calibrated rankings with Glicko-2, Bradley-Terry, TrueSkill, and cross-domain transfer learning. Includes webhooks, API keys, RLHF exports, and embeddable widgets.
version: 4.12.0
tags:
- name: Tier Delivery
paths:
/api/v1/tier-delivery/outcomes:
post:
tags:
- Tier Delivery
summary: Register Outcome
description: 'Register a ground-truth outcome for a matchup.
Owner-only on the parent domain. The outcome doesn''t have to be
attached to any specific vote — it''s a fact about the entities
themselves, so all historical votes on the same pair can be
scored against it for predictive-accuracy reporting.'
operationId: register_outcome_api_v1_tier_delivery_outcomes_post
requestBody:
content:
application/json:
schema:
$ref: '#/components/schemas/OutcomeRequest'
required: true
responses:
'201':
description: Successful Response
content:
application/json:
schema: {}
'422':
description: Validation Error
content:
application/json:
schema:
$ref: '#/components/schemas/HTTPValidationError'
/api/v1/tier-delivery/accuracy-report:
get:
tags:
- Tier Delivery
summary: Accuracy Report
description: 'Compute predictive accuracy of our votes against registered outcomes.
For each registered outcome, find all historical votes on the same
pair and score: how often did the voter pick the actual winner?
Returns log-loss, Brier score, and raw accuracy — the same metrics
LMSYS uses for their reliability claims, computed against ground truth.'
operationId: accuracy_report_api_v1_tier_delivery_accuracy_report_get
parameters:
- name: domain_id
in: query
required: true
schema:
type: string
title: Domain Id
responses:
'200':
description: Successful Response
content:
application/json:
schema: {}
'422':
description: Validation Error
content:
application/json:
schema:
$ref: '#/components/schemas/HTTPValidationError'
/api/v1/tier-delivery/export:
post:
tags:
- Tier Delivery
summary: Tier Export
description: 'Export preference data at a specific tier, gated by the tier''s quality floor.
Returns:
200 with {samples, receipt} if the dataset passes the gate.
422 with a gate-failure explanation if it doesn''t.
The export bundle is HMAC-signed for Reliability-Stamped and
Ground-Truth tiers — buyers can verify integrity with the shared
secret / public verification helper.
Auth: JWT, Pro plan or higher, and must own the ranking.'
operationId: tier_export_api_v1_tier_delivery_export_post
requestBody:
content:
application/json:
schema:
$ref: '#/components/schemas/TierExportRequest'
required: true
responses:
'200':
description: Successful Response
content:
application/json:
schema: {}
'422':
description: Validation Error
content:
application/json:
schema:
$ref: '#/components/schemas/HTTPValidationError'
/api/v1/tier-delivery/tiers:
get:
tags:
- Tier Delivery
summary: List Tiers
description: 'Return the public tier definitions + floor requirements.
Useful for customer docs + buyer self-service — they can see
exactly what quality commitment each tier makes before purchasing.'
operationId: list_tiers_api_v1_tier_delivery_tiers_get
responses:
'200':
description: Successful Response
content:
application/json:
schema: {}
components:
schemas:
HTTPValidationError:
properties:
detail:
items:
$ref: '#/components/schemas/ValidationError'
type: array
title: Detail
type: object
title: HTTPValidationError
DeliveryTier:
type: string
enum:
- basic
- enriched
- reliability_stamped
- ground_truth_verified
title: DeliveryTier
OutcomeRequest:
properties:
domain_id:
type: string
title: Domain Id
entity_a_id:
type: string
title: Entity A Id
entity_b_id:
type: string
title: Entity B Id
actual_winner_id:
anyOf:
- type: string
- type: 'null'
title: Actual Winner Id
description: None = tie / not applicable
outcome_method:
anyOf:
- type: string
maxLength: 64
- type: 'null'
title: Outcome Method
description: human_judgment | ab_test | sports_result | clinical | ...
outcome_source:
anyOf:
- type: string
maxLength: 255
- type: 'null'
title: Outcome Source
outcome_confidence:
anyOf:
- type: number
maximum: 1.0
minimum: 0.0
- type: 'null'
title: Outcome Confidence
outcome_date:
anyOf:
- type: string
format: date-time
- type: 'null'
title: Outcome Date
notes:
anyOf:
- type: string
- type: 'null'
title: Notes
type: object
required:
- domain_id
- entity_a_id
- entity_b_id
title: OutcomeRequest
ValidationError:
properties:
loc:
items:
anyOf:
- type: string
- type: integer
type: array
title: Location
msg:
type: string
title: Message
type:
type: string
title: Error Type
input:
title: Input
ctx:
type: object
title: Context
type: object
required:
- loc
- msg
- type
title: ValidationError
ExportFormat:
type: string
enum:
- anthropic_hh
- openai_rm
- dpo
- kto
- aimrank_full
title: ExportFormat
TierExportRequest:
properties:
ranking_id:
type: string
title: Ranking Id
tier:
$ref: '#/components/schemas/DeliveryTier'
description: Basic, Enriched, Reliability-Stamped, or Ground-Truth Verified
default: enriched
format:
$ref: '#/components/schemas/ExportFormat'
default: dpo
min_confidence:
type: number
maximum: 1.0
minimum: 0.0
title: Min Confidence
default: 0.0
min_quality:
type: number
maximum: 1.0
minimum: 0.0
title: Min Quality
default: 0.0
type: object
required:
- ranking_id
title: TierExportRequest
securitySchemes:
APIKeyHeader:
type: apiKey
in: header
name: X-API-Key