EvalGate Collector API
The collector API from EvalGate — 2 operation(s) for collector.
The collector API from EvalGate — 2 operation(s) for collector.
Every API here is available over the APIs.io API and to AI agents over MCP.
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
find_apisBrowse and filter every API in the catalog.get_api_artifactsOne API's artifacts, grouped by type.get_openapiThe primary OpenAPI for this API.find_similar_apisAPIs that look like this one.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.curl "https://apis.io/api/v1/apis/evalgate-com:evalgate-com-collector-api"
curl "https://apis.io/api/v1/apis?limit=25"
Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. By signing up you are subscribing to the APIs.io and API Evangelist newsletters — you can unsubscribe from any issue. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.
openapi: 3.2.0
info:
title: EvalGate Collector API
version: 18.13.0
description: EvalGate API. See docs/api-contract.md for stability commitments.
servers:
- url: https://evalgate.com
description: Production
- url: http://localhost:3000
description: Local
tags:
- name: collector
paths:
/api/collector/batch:
post:
x-evalgate-source-hash: sha256:af42f73b03426855e3aed9b87ff7364e92dee706924e93d7a6c6a5112d864e3e
summary: Create collector batch
operationId: post_collector_batch
responses:
'200':
description: Successful response
content:
application/json:
schema:
$ref: '#/components/schemas/PostApiCollectorBatchResponse200ApplicationJson'
'400':
$ref: '#/components/responses/ValidationError'
'401':
$ref: '#/components/responses/Unauthorized'
'403':
$ref: '#/components/responses/Forbidden'
'404':
$ref: '#/components/responses/NotFound'
'409':
$ref: '#/components/responses/Conflict'
'429':
$ref: '#/components/responses/RateLimited'
'500':
$ref: '#/components/responses/InternalError'
'503':
$ref: '#/components/responses/ServiceUnavailable'
security:
- bearerAuth: []
tags:
- collector
x-evalgate-request-validators:
- batchBodySchema
x-evalgate-required-scopes:
- traces:write
description: 'Requires scopes: traces:write'
requestBody:
required: true
content:
application/json:
schema:
$ref: '#/components/schemas/PostApiCollectorBatchRequest'
x-evalgate-contract-hash: sha256:e7acca5ea56799f966929bb18cb1a23fca53ae6960ed3c9e560752c2588e6259
/api/collector:
post:
x-evalgate-source-hash: sha256:5cb58d62b43dcb0b7e7a161060c3b64ba03612b4eec75873aded55ebe3260689
summary: Create collector collector
operationId: post_collector
responses:
'201':
description: Successful response
content:
application/json:
schema:
$ref: '#/components/schemas/PostApiCollectorResponse201ApplicationJson'
'400':
$ref: '#/components/responses/ValidationError'
'401':
$ref: '#/components/responses/Unauthorized'
'403':
$ref: '#/components/responses/Forbidden'
'404':
$ref: '#/components/responses/NotFound'
'409':
$ref: '#/components/responses/Conflict'
'429':
$ref: '#/components/responses/RateLimited'
'500':
$ref: '#/components/responses/InternalError'
'503':
$ref: '#/components/responses/ServiceUnavailable'
security:
- bearerAuth: []
tags:
- collector
x-evalgate-request-validators:
- collectorBodySchema
x-evalgate-required-scopes:
- traces:write
description: 'Requires scopes: traces:write'
requestBody:
required: true
content:
application/json:
schema:
$ref: '#/components/schemas/PostApiCollectorRequest'
x-evalgate-contract-hash: sha256:70d01bf823bff49e69f6d42e0e6627c81d5bb99111c09069b9a3c83519ecd9c0
components:
schemas:
PostApiCollectorBatchResponse200ApplicationJson:
type: object
properties:
results:
type: array
items:
type: object
properties:
trace_id:
type: string
status:
oneOf:
- type: string
enum:
- failed
- type: string
enum:
- accepted
span_count:
type: number
spans_written:
type: number
spans_existing:
type: number
error:
type: string
additionalProperties: false
required:
- trace_id
- status
accepted:
type: number
failed:
type: number
additionalProperties: false
required:
- results
- accepted
- failed
PostApiCollectorBatchRequest:
type: object
properties:
traces:
type: array
items:
type: object
properties:
trace_id:
type: string
name:
type: string
status:
oneOf:
- type: string
enum:
- error
- type: string
enum:
- pending
- type: string
enum:
- success
duration_ms:
oneOf:
- type: 'null'
- type: number
source:
oneOf:
- type: string
enum:
- api
- type: string
enum:
- cli
- type: string
enum:
- otel
- type: string
enum:
- sdk
environment:
oneOf:
- type: string
enum:
- dev
- type: string
enum:
- production
- type: string
enum:
- staging
repo_sha:
type: string
content_hash:
type: string
metadata:
oneOf:
- type: 'null'
- type: object
additionalProperties:
$ref: '#/components/schemas/JsonValue'
evaluation_run_id:
type: number
spans:
type: array
items:
type: object
properties:
span_id:
type: string
type:
oneOf:
- type: string
enum:
- agent
- type: string
enum:
- default
- type: string
enum:
- llm
- type: string
enum:
- retrieval
- type: string
enum:
- tool
name:
type: string
parent_span_id:
type: string
input:
$ref: '#/components/schemas/JsonValue'
output:
$ref: '#/components/schemas/JsonValue'
model:
type: string
vendor:
type: string
params:
type: object
additionalProperties:
$ref: '#/components/schemas/JsonValue'
metrics:
type: object
properties:
prompt_tokens:
type: number
completion_tokens:
type: number
total_time_ms:
type: number
additionalProperties: false
timestamps:
type: object
properties:
started_at:
type: number
finished_at:
type: number
additionalProperties: false
required:
- started_at
- finished_at
error:
oneOf:
- type: 'null'
- type: object
properties:
message:
type: string
code:
type: string
additionalProperties: false
required:
- message
behavioral:
type: object
additionalProperties:
$ref: '#/components/schemas/JsonValue'
metadata:
type: object
additionalProperties:
$ref: '#/components/schemas/JsonValue'
additionalProperties: false
required:
- span_id
- name
user_feedback:
type: object
properties:
type:
oneOf:
- type: string
enum:
- comment
- type: string
enum:
- rating
- type: string
enum:
- review_verdict
- type: string
enum:
- thumbs_down
- type: string
enum:
- thumbs_up
value:
$ref: '#/components/schemas/JsonValue'
user_id:
type: string
additionalProperties: false
required:
- type
additionalProperties: false
required:
- trace_id
- name
- spans
additionalProperties: false
required:
- traces
PostApiCollectorResponse201ApplicationJson:
type: object
properties:
trace_id:
type: string
trace_db_id:
type: number
span_count:
type: number
spans_written:
type: number
spans_existing:
type: number
feedback_recorded:
type: boolean
queued_for_analysis:
type: boolean
sampling_reason:
oneOf:
- type: string
enum:
- skipped
- type: string
enum:
- error_trace
- type: string
enum:
- negative_feedback
- type: string
enum:
- sampled
additionalProperties: false
required:
- trace_id
- trace_db_id
- span_count
- spans_written
- spans_existing
- feedback_recorded
- queued_for_analysis
- sampling_reason
ApiError:
type: object
properties:
error:
type: object
properties:
code:
type: string
enum:
- UNAUTHORIZED
- FORBIDDEN
- NOT_FOUND
- INVALID_REFERENCE
- VALIDATION_ERROR
- RATE_LIMITED
- CONFLICT
- INTERNAL_ERROR
- SERVICE_UNAVAILABLE
- QUOTA_EXCEEDED
- FEATURE_LIMIT_REACHED
- NO_ORG_MEMBERSHIP
- SHARE_REVOKED
- SHARE_EXPIRED
- SHARE_UNAVAILABLE
- PROVIDER_KEY_MISSING
- PROVIDER_KEY_EXPIRED
- PROVIDER_RATE_LIMITED
- PROVIDER_UNAUTHORIZED
- PROVIDER_UNAVAILABLE
- AGENT_HANDOFF_INVALID
- AGENT_HANDOFF_EXPIRED
- AGENT_HANDOFF_DENIED
- AGENT_HANDOFF_CONSUMED
- PAYLOAD_TOO_LARGE
- METHOD_NOT_ALLOWED
message:
type: string
details: {}
requestId:
type: string
format: uuid
redaction:
type: object
properties:
applied:
type: boolean
enum:
- true
fieldCount:
type: integer
minimum: 0
secretCount:
type: integer
minimum: 0
required:
- applied
- fieldCount
- secretCount
required:
- code
- message
required:
- error
JsonValue:
oneOf:
- type: 'null'
- type: boolean
- type: number
- type: string
- type: array
items:
$ref: '#/components/schemas/JsonValue'
- type: object
additionalProperties:
$ref: '#/components/schemas/JsonValue'
PostApiCollectorRequest:
type: object
properties:
trace_id:
type: string
name:
type: string
status:
oneOf:
- type: string
enum:
- error
- type: string
enum:
- pending
- type: string
enum:
- success
duration_ms:
oneOf:
- type: 'null'
- type: number
source:
oneOf:
- type: string
enum:
- api
- type: string
enum:
- cli
- type: string
enum:
- otel
- type: string
enum:
- sdk
environment:
oneOf:
- type: string
enum:
- dev
- type: string
enum:
- production
- type: string
enum:
- staging
repo_sha:
type: string
content_hash:
type: string
metadata:
oneOf:
- type: 'null'
- type: object
additionalProperties:
$ref: '#/components/schemas/JsonValue'
evaluation_run_id:
type: number
spans:
type: array
items:
type: object
properties:
span_id:
type: string
type:
oneOf:
- type: string
enum:
- agent
- type: string
enum:
- default
- type: string
enum:
- llm
- type: string
enum:
- retrieval
- type: string
enum:
- tool
name:
type: string
parent_span_id:
type: string
input:
$ref: '#/components/schemas/JsonValue'
output:
$ref: '#/components/schemas/JsonValue'
model:
type: string
vendor:
type: string
params:
type: object
additionalProperties:
$ref: '#/components/schemas/JsonValue'
metrics:
type: object
properties:
prompt_tokens:
type: number
completion_tokens:
type: number
total_time_ms:
type: number
additionalProperties: false
timestamps:
type: object
properties:
started_at:
type: number
finished_at:
type: number
additionalProperties: false
required:
- started_at
- finished_at
error:
oneOf:
- type: 'null'
- type: object
properties:
message:
type: string
code:
type: string
additionalProperties: false
required:
- message
behavioral:
type: object
additionalProperties:
$ref: '#/components/schemas/JsonValue'
metadata:
type: object
additionalProperties:
$ref: '#/components/schemas/JsonValue'
additionalProperties: false
required:
- span_id
- name
user_feedback:
type: object
properties:
type:
oneOf:
- type: string
enum:
- comment
- type: string
enum:
- rating
- type: string
enum:
- review_verdict
- type: string
enum:
- thumbs_down
- type: string
enum:
- thumbs_up
value:
$ref: '#/components/schemas/JsonValue'
user_id:
type: string
additionalProperties: false
required:
- type
additionalProperties: false
required:
- trace_id
- name
- spans
responses:
Unauthorized:
description: Unauthorized
content:
application/json:
schema:
$ref: '#/components/schemas/ApiError'
headers:
RateLimit-Limit:
description: Quota in requests for the active window.
schema:
type: integer
minimum: 0
RateLimit-Remaining:
description: Remaining requests in the active window.
schema:
type: integer
minimum: 0
RateLimit-Reset:
description: Reset delay in seconds (not a Unix timestamp).
schema:
type: integer
minimum: 1
X-RateLimit-Limit:
schema:
type: integer
minimum: 0
X-RateLimit-Remaining:
schema:
type: integer
minimum: 0
X-RateLimit-Reset:
description: Legacy reset timestamp in Unix milliseconds.
schema:
type: integer
minimum: 0
RateLimit-Policy:
description: IETF HTTPAPI structured quota policy (work in progress).
schema:
type: string
RateLimit:
description: IETF HTTPAPI structured remaining quota and reset delay (work in progress).
schema:
type: string
WWW-Authenticate:
description: Bearer challenge. Agent-facing routes include the RFC 9728 resource_metadata URL.
schema:
type: string
Conflict:
description: Conflict
content:
application/json:
schema:
$ref: '#/components/schemas/ApiError'
headers:
RateLimit-Limit:
description: Quota in requests for the active window.
schema:
type: integer
minimum: 0
RateLimit-Remaining:
description: Remaining requests in the active window.
schema:
type: integer
minimum: 0
RateLimit-Reset:
description: Reset delay in seconds (not a Unix timestamp).
schema:
type: integer
minimum: 1
X-RateLimit-Limit:
schema:
type: integer
minimum: 0
X-RateLimit-Remaining:
schema:
type: integer
minimum: 0
X-RateLimit-Reset:
description: Legacy reset timestamp in Unix milliseconds.
schema:
type: integer
minimum: 0
RateLimit-Policy:
description: IETF HTTPAPI structured quota policy (work in progress).
schema:
type: string
RateLimit:
description: IETF HTTPAPI structured remaining quota and reset delay (work in progress).
schema:
type: string
ValidationError:
description: Validation error
content:
application/json:
schema:
$ref: '#/components/schemas/ApiError'
headers:
RateLimit-Limit:
description: Quota in requests for the active window.
schema:
type: integer
minimum: 0
RateLimit-Remaining:
description: Remaining requests in the active window.
schema:
type: integer
minimum: 0
RateLimit-Reset:
description: Reset delay in seconds (not a Unix timestamp).
schema:
type: integer
minimum: 1
X-RateLimit-Limit:
schema:
type: integer
minimum: 0
X-RateLimit-Remaining:
schema:
type: integer
minimum: 0
X-RateLimit-Reset:
description: Legacy reset timestamp in Unix milliseconds.
schema:
type: integer
minimum: 0
RateLimit-Policy:
description: IETF HTTPAPI structured quota policy (work in progress).
schema:
type: string
RateLimit:
description: IETF HTTPAPI structured remaining quota and reset delay (work in progress).
schema:
type: string
RateLimited:
description: Rate limit exceeded
content:
application/json:
schema:
$ref: '#/components/schemas/ApiError'
headers:
RateLimit-Limit:
description: Quota in requests for the active window.
schema:
type: integer
minimum: 0
RateLimit-Remaining:
description: Remaining requests in the active window.
schema:
type: integer
minimum: 0
RateLimit-Reset:
description: Reset delay in seconds (not a Unix timestamp).
schema:
type: integer
minimum: 1
X-RateLimit-Limit:
schema:
type: integer
minimum: 0
X-RateLimit-Remaining:
schema:
type: integer
minimum: 0
X-RateLimit-Reset:
description: Legacy reset timestamp in Unix milliseconds.
schema:
type: integer
minimum: 0
RateLimit-Policy:
description: IETF HTTPAPI structured quota policy (work in progress).
schema:
type: string
RateLimit:
description: IETF HTTPAPI structured remaining quota and reset delay (work in progress).
schema:
type: string
Retry-After:
description: Delay in seconds before retrying when present.
schema:
type: integer
minimum: 1
Forbidden:
description: Forbidden
content:
application/json:
schema:
$ref: '#/components/schemas/ApiError'
headers:
RateLimit-Limit:
description: Quota in requests for the active window.
schema:
type: integer
minimum: 0
RateLimit-Remaining:
description: Remaining requests in the active window.
schema:
type: integer
minimum: 0
RateLimit-Reset:
description: Reset delay in seconds (not a Unix timestamp).
schema:
type: integer
minimum: 1
X-RateLimit-Limit:
schema:
type: integer
minimum: 0
X-RateLimit-Remaining:
schema:
type: integer
minimum: 0
X-RateLimit-Reset:
description: Legacy reset timestamp in Unix milliseconds.
schema:
type: integer
minimum: 0
RateLimit-Policy:
description: IETF HTTPAPI structured quota policy (work in progress).
schema:
type: string
RateLimit:
description: IETF HTTPAPI structured remaining quota and reset delay (work in progress).
schema:
type: string
ServiceUnavailable:
description: Service unavailable
content:
application/json:
schema:
$ref: '#/components/schemas/ApiError'
headers:
RateLimit-Limit:
description: Quota in requests for the active window.
schema:
type: integer
minimum: 0
RateLimit-Remaining:
description: Remaining requests in the active window.
schema:
type: integer
minimum: 0
RateLimit-Reset:
description: Reset delay in seconds (not a Unix timestamp).
schema:
type: integer
minimum: 1
X-RateLimit-Limit:
schema:
type: integer
minimum: 0
X-RateLimit-Remaining:
schema:
type: integer
minimum: 0
X-RateLimit-Reset:
description: Legacy reset timestamp in Unix milliseconds.
schema:
type: integer
minimum: 0
RateLimit-Policy:
description: IETF HTTPAPI structured quota policy (work in progress).
schema:
type: string
RateLimit:
description: IETF HTTPAPI structured remaining quota and reset delay (work in progress).
schema:
type: string
InternalError:
description: Internal server error
content:
application/json:
schema:
$ref: '#/components/schemas/ApiError'
headers:
RateLimit-Limit:
description: Quota in requests for the active window.
schema:
type: integer
minimum: 0
RateLimit-Remaining:
description: Remaining requests in the active window.
schema:
type: integer
minimum: 0
RateLimit-Reset:
description: Reset delay in seconds (not a Unix timestamp).
schema:
type: integer
minimum: 1
X-RateLimit-Limit:
schema:
type: integer
minimum: 0
X-RateLimit-Remaining:
schema:
type: integer
minimum: 0
X-RateLimit-Reset:
description: Legacy reset timestamp in Unix milliseconds.
schema:
type: integer
minimum: 0
RateLimit-Policy:
description: IETF HTTPAPI structured quota policy (work in progress).
schema:
type: string
RateLimit:
description: IETF HTTPAPI structured remaining quota and reset delay (work in progress).
schema:
type: string
NotFound:
description: Resource not found
content:
application/json:
schema:
$ref: '#/components/schemas/ApiError'
headers:
RateLimit-Limit:
description: Quota in requests for the active window.
schema:
type: integer
minimum: 0
RateLimit-Remaining:
description: Remaining requests in the active window.
schema:
type: integer
minimum: 0
RateLimit-Reset:
description: Reset delay in seconds (not a Unix timestamp).
schema:
type: integer
minimum: 1
X-RateLimit-Limit:
schema:
type: integer
minimum: 0
X-RateLimit-Remaining:
schema:
type: integer
minimum: 0
X-RateLimit-Reset:
description: Legacy reset timestamp in Unix milliseconds.
schema:
type: integer
minimum: 0
RateLimit-Policy:
description: IETF HTTPAPI structured quota policy (work in progress).
schema:
type: string
RateLimit:
description: IETF HTTPAPI structured remaining quota and reset delay (work in progress).
schema:
type: string
securitySchemes:
bearerAuth:
type: http
scheme: bearer
bearerFormat: EvalGate API key
description: Organization-scoped EvalGate API key. Discover the supported agent scopes at /.well-known/oauth-protected-resource. Per-operation grants are listed in x-evalgate-required-scopes; OpenAPI bearer security requirement arrays remain empty as required for non-OAuth schemes.
x-evalgate-scopes-supported:
- eval:read
- eval:write
- objectives:read
- objectives:write
- runs:read
- runs:write
- traces:read
- traces:write
- exports:download
- reports:write
- prompt:publish
- scorer:publish
- red_team:read
- red_team:run
- red_team:approve
- docs:read
- agent:read
- agent:execute
- resources:read
- resources:write
- contexts:read
- contexts:write
- observations:write
- checks:read
- checks:run
- standards:read
- standards:write
- standards:approve
- grants:read
- grants:write
- admin:keys
- admin:workspace
- admin:org
x-evalgate-protected-resource-metadata: https://www.evalgate.com/.well-known/oauth-protected-resource
ProviderHealthSignature:
type: apiKey
in: header
name: x-evalgate-provider-health-signature
description: HMAC SHA-256 signature over the exact provider request bytes. Provider requests also require the timestamp and key-id headers.
browserSession:
type: apiKey
in: cookie
name: better-auth.session_token
description: Interactive EvalGate browser session established through GitHub or Google sign-in. This scheme represents the human approval step and is not an agent API key or an EvalGate OAuth authorization-server token.
x-service-info:
categories:
- ai
- developer-tools
docs:
homepage: https://evalgate.com
apiReference: https://docs.evalgate.com/api-reference
llms: https://evalgate.com/llms.txt