AimRank Tier Delivery API

The Tier Delivery API from AimRank — 4 operation(s) for tier delivery.

Operations 4

POST /api/v1/tier-delivery/outcomes Register Outcome #
GET /api/v1/tier-delivery/accuracy-report Accuracy Report #
POST /api/v1/tier-delivery/export Tier Export #
GET /api/v1/tier-delivery/tiers List Tiers #

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API
curl "https://apis.io/api/v1/apis/aimrank-io:aimrank-io-tier-delivery-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

aimrank-io-tier-delivery-api-openapi.yml Raw ↑
openapi: 3.2.0
info:
  title: AimRank Tier Delivery API
  description: Ranking-as-a-Service API — Turn binary comparisons into calibrated rankings with Glicko-2, Bradley-Terry, TrueSkill, and cross-domain transfer learning. Includes webhooks, API keys, RLHF exports, and embeddable widgets.
  version: 4.12.0
tags:
- name: Tier Delivery
paths:
  /api/v1/tier-delivery/outcomes:
    post:
      tags:
      - Tier Delivery
      summary: Register Outcome
      description: 'Register a ground-truth outcome for a matchup.


        Owner-only on the parent domain. The outcome doesn''t have to be

        attached to any specific vote — it''s a fact about the entities

        themselves, so all historical votes on the same pair can be

        scored against it for predictive-accuracy reporting.'
      operationId: register_outcome_api_v1_tier_delivery_outcomes_post
      requestBody:
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/OutcomeRequest'
        required: true
      responses:
        '201':
          description: Successful Response
          content:
            application/json:
              schema: {}
        '422':
          description: Validation Error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/HTTPValidationError'
  /api/v1/tier-delivery/accuracy-report:
    get:
      tags:
      - Tier Delivery
      summary: Accuracy Report
      description: 'Compute predictive accuracy of our votes against registered outcomes.


        For each registered outcome, find all historical votes on the same

        pair and score: how often did the voter pick the actual winner?

        Returns log-loss, Brier score, and raw accuracy — the same metrics

        LMSYS uses for their reliability claims, computed against ground truth.'
      operationId: accuracy_report_api_v1_tier_delivery_accuracy_report_get
      parameters:
      - name: domain_id
        in: query
        required: true
        schema:
          type: string
          title: Domain Id
      responses:
        '200':
          description: Successful Response
          content:
            application/json:
              schema: {}
        '422':
          description: Validation Error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/HTTPValidationError'
  /api/v1/tier-delivery/export:
    post:
      tags:
      - Tier Delivery
      summary: Tier Export
      description: 'Export preference data at a specific tier, gated by the tier''s quality floor.


        Returns:

        200 with {samples, receipt} if the dataset passes the gate.

        422 with a gate-failure explanation if it doesn''t.


        The export bundle is HMAC-signed for Reliability-Stamped and

        Ground-Truth tiers — buyers can verify integrity with the shared

        secret / public verification helper.


        Auth: JWT, Pro plan or higher, and must own the ranking.'
      operationId: tier_export_api_v1_tier_delivery_export_post
      requestBody:
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/TierExportRequest'
        required: true
      responses:
        '200':
          description: Successful Response
          content:
            application/json:
              schema: {}
        '422':
          description: Validation Error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/HTTPValidationError'
  /api/v1/tier-delivery/tiers:
    get:
      tags:
      - Tier Delivery
      summary: List Tiers
      description: 'Return the public tier definitions + floor requirements.


        Useful for customer docs + buyer self-service — they can see

        exactly what quality commitment each tier makes before purchasing.'
      operationId: list_tiers_api_v1_tier_delivery_tiers_get
      responses:
        '200':
          description: Successful Response
          content:
            application/json:
              schema: {}
components:
  schemas:
    HTTPValidationError:
      properties:
        detail:
          items:
            $ref: '#/components/schemas/ValidationError'
          type: array
          title: Detail
      type: object
      title: HTTPValidationError
    DeliveryTier:
      type: string
      enum:
      - basic
      - enriched
      - reliability_stamped
      - ground_truth_verified
      title: DeliveryTier
    OutcomeRequest:
      properties:
        domain_id:
          type: string
          title: Domain Id
        entity_a_id:
          type: string
          title: Entity A Id
        entity_b_id:
          type: string
          title: Entity B Id
        actual_winner_id:
          anyOf:
          - type: string
          - type: 'null'
          title: Actual Winner Id
          description: None = tie / not applicable
        outcome_method:
          anyOf:
          - type: string
            maxLength: 64
          - type: 'null'
          title: Outcome Method
          description: human_judgment | ab_test | sports_result | clinical | ...
        outcome_source:
          anyOf:
          - type: string
            maxLength: 255
          - type: 'null'
          title: Outcome Source
        outcome_confidence:
          anyOf:
          - type: number
            maximum: 1.0
            minimum: 0.0
          - type: 'null'
          title: Outcome Confidence
        outcome_date:
          anyOf:
          - type: string
            format: date-time
          - type: 'null'
          title: Outcome Date
        notes:
          anyOf:
          - type: string
          - type: 'null'
          title: Notes
      type: object
      required:
      - domain_id
      - entity_a_id
      - entity_b_id
      title: OutcomeRequest
    ValidationError:
      properties:
        loc:
          items:
            anyOf:
            - type: string
            - type: integer
          type: array
          title: Location
        msg:
          type: string
          title: Message
        type:
          type: string
          title: Error Type
        input:
          title: Input
        ctx:
          type: object
          title: Context
      type: object
      required:
      - loc
      - msg
      - type
      title: ValidationError
    ExportFormat:
      type: string
      enum:
      - anthropic_hh
      - openai_rm
      - dpo
      - kto
      - aimrank_full
      title: ExportFormat
    TierExportRequest:
      properties:
        ranking_id:
          type: string
          title: Ranking Id
        tier:
          $ref: '#/components/schemas/DeliveryTier'
          description: Basic, Enriched, Reliability-Stamped, or Ground-Truth Verified
          default: enriched
        format:
          $ref: '#/components/schemas/ExportFormat'
          default: dpo
        min_confidence:
          type: number
          maximum: 1.0
          minimum: 0.0
          title: Min Confidence
          default: 0.0
        min_quality:
          type: number
          maximum: 1.0
          minimum: 0.0
          title: Min Quality
          default: 0.0
      type: object
      required:
      - ranking_id
      title: TierExportRequest
  securitySchemes:
    APIKeyHeader:
      type: apiKey
      in: header
      name: X-API-Key