Clarity

Clarity Copilot Evals API

The copilot-evals API from Clarity — 2 operation(s) for copilot-evals.

GitHub OpenAPI

Operations 2

GET /api/v1/copilot-evals/runs List Runs #
GET /api/v1/copilot-evals/runs/{run_id} Get Run #

Specifications

⚙
OpenAPI
https://artifacts.apis.io/onclarity-com/openapi/onclarity-com-copilot-evals-api-openapi.yml

Schemas & Data

📊
JSONSchema
https://artifacts.apis.io/onclarity-com/json-schema/onclarity-com-dashboard-element-schema.json
📊
JSONSchema
https://artifacts.apis.io/onclarity-com/json-schema/onclarity-com-admin-build-table-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/onclarity-com/json-schema/onclarity-com-update-dashboard-element-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/onclarity-com/json-schema/onclarity-com-admin-deeper-search-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/onclarity-com/json-schema/onclarity-com-src-routers-admin-admin-search-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/onclarity-com/json-schema/onclarity-com-agent-response-schema.json

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/onclarity-com:onclarity-com-copilot-evals-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

onclarity-com-copilot-evals-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Fast Copilot Evals API
  version: 0.1.0
tags:
- name: copilot-evals
paths:
  /api/v1/copilot-evals/runs:
    get:
      tags:
      - copilot-evals
      summary: List Runs
      description: Eval runs newest-first, each with pass/partial/fail/ungraded case counts.
      operationId: list_runs_api_v1_copilot_evals_runs_get
      security:
      - HTTPBearer: []
      parameters:
      - name: limit
        in: query
        required: false
        schema:
          type: integer
          maximum: 200
          minimum: 1
          default: 50
          title: Limit
      responses:
        '200':
          description: Successful Response
          content:
            application/json:
              schema:
                type: array
                items:
                  $ref: '#/components/schemas/RunListItem'
                title: Response List Runs Api V1 Copilot Evals Runs Get
        '422':
          description: Validation Error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/HTTPValidationError'
  /api/v1/copilot-evals/runs/{run_id}:
    get:
      tags:
      - copilot-evals
      summary: Get Run
      description: One run with all its cases (frozen prompt/expected snapshot + outcome + grade).
      operationId: get_run_api_v1_copilot_evals_runs__run_id__get
      security:
      - HTTPBearer: []
      parameters:
      - name: run_id
        in: path
        required: true
        schema:
          type: integer
          title: Run Id
      responses:
        '200':
          description: Successful Response
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/RunDetailResponse'
        '422':
          description: Validation Error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/HTTPValidationError'
components:
  schemas:
    ValidationError:
      properties:
        loc:
          items:
            anyOf:
            - type: string
            - type: integer
          type: array
          title: Location
        msg:
          type: string
          title: Message
        type:
          type: string
          title: Error Type
        input:
          title: Input
        ctx:
          type: object
          title: Context
      type: object
      required:
      - loc
      - msg
      - type
      title: ValidationError
    RunDTO:
      properties:
        id:
          type: integer
          title: Id
        agent_version:
          type: string
          title: Agent Version
        label:
          anyOf:
          - type: string
          - type: 'null'
          title: Label
        env:
          type: string
          title: Env
        slug:
          type: string
          title: Slug
        filters:
          additionalProperties: true
          type: object
          title: Filters
        totals:
          additionalProperties: true
          type: object
          title: Totals
        started_at:
          type: string
          format: date-time
          title: Started At
        finished_at:
          anyOf:
          - type: string
            format: date-time
          - type: 'null'
          title: Finished At
      type: object
      required:
      - id
      - agent_version
      - label
      - env
      - slug
      - filters
      - totals
      - started_at
      - finished_at
      title: RunDTO
    RunDetailResponse:
      properties:
        run:
          $ref: '#/components/schemas/RunDTO'
        cases:
          items:
            $ref: '#/components/schemas/CaseDTO'
          type: array
          title: Cases
      type: object
      required:
      - run
      - cases
      title: RunDetailResponse
    CaseDTO:
      properties:
        id:
          type: integer
          title: Id
        run_id:
          type: integer
          title: Run Id
        project_id:
          type: integer
          title: Project Id
        customer:
          type: string
          title: Customer
        case_id:
          type: integer
          title: Case Id
        type:
          type: string
          title: Type
        use_case:
          anyOf:
          - type: string
          - type: 'null'
          title: Use Case
        test_prompt:
          type: string
          title: Test Prompt
        expected_result:
          anyOf:
          - type: string
          - type: 'null'
          title: Expected Result
        connected_sources:
          anyOf:
          - type: string
          - type: 'null'
          title: Connected Sources
        status:
          type: string
          title: Status
        session_id:
          anyOf:
          - type: string
          - type: 'null'
          title: Session Id
        url:
          anyOf:
          - type: string
          - type: 'null'
          title: Url
        error:
          anyOf:
          - type: string
          - type: 'null'
          title: Error
        duration_s:
          anyOf:
          - type: number
          - type: 'null'
          title: Duration S
        auto_answered:
          type: boolean
          title: Auto Answered
        out_of_time:
          type: boolean
          title: Out Of Time
          default: false
        verdict:
          anyOf:
          - type: string
          - type: 'null'
          title: Verdict
        grade:
          anyOf:
          - additionalProperties: true
            type: object
          - type: 'null'
          title: Grade
        created_at:
          type: string
          format: date-time
          title: Created At
        updated_at:
          type: string
          format: date-time
          title: Updated At
      type: object
      required:
      - id
      - run_id
      - project_id
      - customer
      - case_id
      - type
      - use_case
      - test_prompt
      - expected_result
      - connected_sources
      - status
      - session_id
      - url
      - error
      - duration_s
      - auto_answered
      - verdict
      - grade
      - created_at
      - updated_at
      title: CaseDTO
    RunListItem:
      properties:
        id:
          type: integer
          title: Id
        agent_version:
          type: string
          title: Agent Version
        label:
          anyOf:
          - type: string
          - type: 'null'
          title: Label
        env:
          type: string
          title: Env
        slug:
          type: string
          title: Slug
        filters:
          additionalProperties: true
          type: object
          title: Filters
        totals:
          additionalProperties: true
          type: object
          title: Totals
        started_at:
          type: string
          format: date-time
          title: Started At
        finished_at:
          anyOf:
          - type: string
            format: date-time
          - type: 'null'
          title: Finished At
        verdict_counts:
          additionalProperties:
            type: integer
          type: object
          title: Verdict Counts
      type: object
      required:
      - id
      - agent_version
      - label
      - env
      - slug
      - filters
      - totals
      - started_at
      - finished_at
      - verdict_counts
      title: RunListItem
      description: 'A run plus its per-verdict case tallies.


        ``verdict_counts`` is a plain dict (keys: ``pass | partial | fail | ungraded``) rather than a

        typed model because ``pass`` is a Python keyword and can''t be a field name.'
    HTTPValidationError:
      properties:
        detail:
          items:
            $ref: '#/components/schemas/ValidationError'
          type: array
          title: Detail
      type: object
      title: HTTPValidationError
  securitySchemes:
    HTTPBearer:
      type: http
      scheme: bearer
    HTTPBasic:
      type: http
      scheme: basic