Clarity Copilot Evals API
The copilot-evals API from Clarity — 2 operation(s) for copilot-evals.
The copilot-evals API from Clarity — 2 operation(s) for copilot-evals.
Every API here is available over the APIs.io API and to AI agents over MCP.
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
find_apisBrowse and filter every API in the catalog.get_api_artifactsOne API's artifacts, grouped by type.get_openapiThe primary OpenAPI for this API.find_similar_apisAPIs that look like this one.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.curl "https://apis.io/api/v1/apis/onclarity-com:onclarity-com-copilot-evals-api"
curl "https://apis.io/api/v1/apis?limit=25"
Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.
openapi: 3.2.0
info:
title: Fast Copilot Evals API
version: 0.1.0
tags:
- name: copilot-evals
paths:
/api/v1/copilot-evals/runs:
get:
tags:
- copilot-evals
summary: List Runs
description: Eval runs newest-first, each with pass/partial/fail/ungraded case counts.
operationId: list_runs_api_v1_copilot_evals_runs_get
security:
- HTTPBearer: []
parameters:
- name: limit
in: query
required: false
schema:
type: integer
maximum: 200
minimum: 1
default: 50
title: Limit
responses:
'200':
description: Successful Response
content:
application/json:
schema:
type: array
items:
$ref: '#/components/schemas/RunListItem'
title: Response List Runs Api V1 Copilot Evals Runs Get
'422':
description: Validation Error
content:
application/json:
schema:
$ref: '#/components/schemas/HTTPValidationError'
/api/v1/copilot-evals/runs/{run_id}:
get:
tags:
- copilot-evals
summary: Get Run
description: One run with all its cases (frozen prompt/expected snapshot + outcome + grade).
operationId: get_run_api_v1_copilot_evals_runs__run_id__get
security:
- HTTPBearer: []
parameters:
- name: run_id
in: path
required: true
schema:
type: integer
title: Run Id
responses:
'200':
description: Successful Response
content:
application/json:
schema:
$ref: '#/components/schemas/RunDetailResponse'
'422':
description: Validation Error
content:
application/json:
schema:
$ref: '#/components/schemas/HTTPValidationError'
components:
schemas:
ValidationError:
properties:
loc:
items:
anyOf:
- type: string
- type: integer
type: array
title: Location
msg:
type: string
title: Message
type:
type: string
title: Error Type
input:
title: Input
ctx:
type: object
title: Context
type: object
required:
- loc
- msg
- type
title: ValidationError
RunDTO:
properties:
id:
type: integer
title: Id
agent_version:
type: string
title: Agent Version
label:
anyOf:
- type: string
- type: 'null'
title: Label
env:
type: string
title: Env
slug:
type: string
title: Slug
filters:
additionalProperties: true
type: object
title: Filters
totals:
additionalProperties: true
type: object
title: Totals
started_at:
type: string
format: date-time
title: Started At
finished_at:
anyOf:
- type: string
format: date-time
- type: 'null'
title: Finished At
type: object
required:
- id
- agent_version
- label
- env
- slug
- filters
- totals
- started_at
- finished_at
title: RunDTO
RunDetailResponse:
properties:
run:
$ref: '#/components/schemas/RunDTO'
cases:
items:
$ref: '#/components/schemas/CaseDTO'
type: array
title: Cases
type: object
required:
- run
- cases
title: RunDetailResponse
CaseDTO:
properties:
id:
type: integer
title: Id
run_id:
type: integer
title: Run Id
project_id:
type: integer
title: Project Id
customer:
type: string
title: Customer
case_id:
type: integer
title: Case Id
type:
type: string
title: Type
use_case:
anyOf:
- type: string
- type: 'null'
title: Use Case
test_prompt:
type: string
title: Test Prompt
expected_result:
anyOf:
- type: string
- type: 'null'
title: Expected Result
connected_sources:
anyOf:
- type: string
- type: 'null'
title: Connected Sources
status:
type: string
title: Status
session_id:
anyOf:
- type: string
- type: 'null'
title: Session Id
url:
anyOf:
- type: string
- type: 'null'
title: Url
error:
anyOf:
- type: string
- type: 'null'
title: Error
duration_s:
anyOf:
- type: number
- type: 'null'
title: Duration S
auto_answered:
type: boolean
title: Auto Answered
out_of_time:
type: boolean
title: Out Of Time
default: false
verdict:
anyOf:
- type: string
- type: 'null'
title: Verdict
grade:
anyOf:
- additionalProperties: true
type: object
- type: 'null'
title: Grade
created_at:
type: string
format: date-time
title: Created At
updated_at:
type: string
format: date-time
title: Updated At
type: object
required:
- id
- run_id
- project_id
- customer
- case_id
- type
- use_case
- test_prompt
- expected_result
- connected_sources
- status
- session_id
- url
- error
- duration_s
- auto_answered
- verdict
- grade
- created_at
- updated_at
title: CaseDTO
RunListItem:
properties:
id:
type: integer
title: Id
agent_version:
type: string
title: Agent Version
label:
anyOf:
- type: string
- type: 'null'
title: Label
env:
type: string
title: Env
slug:
type: string
title: Slug
filters:
additionalProperties: true
type: object
title: Filters
totals:
additionalProperties: true
type: object
title: Totals
started_at:
type: string
format: date-time
title: Started At
finished_at:
anyOf:
- type: string
format: date-time
- type: 'null'
title: Finished At
verdict_counts:
additionalProperties:
type: integer
type: object
title: Verdict Counts
type: object
required:
- id
- agent_version
- label
- env
- slug
- filters
- totals
- started_at
- finished_at
- verdict_counts
title: RunListItem
description: 'A run plus its per-verdict case tallies.
``verdict_counts`` is a plain dict (keys: ``pass | partial | fail | ungraded``) rather than a
typed model because ``pass`` is a Python keyword and can''t be a field name.'
HTTPValidationError:
properties:
detail:
items:
$ref: '#/components/schemas/ValidationError'
type: array
title: Detail
type: object
title: HTTPValidationError
securitySchemes:
HTTPBearer:
type: http
scheme: bearer
HTTPBasic:
type: http
scheme: basic