Omni

Omni AI Eval API

AI evaluation: manage prompt sets and runs used to score AI quality against curated prompt suites.

GitHub OpenAPI

Operations 12

GET /v1/ai/eval/prompt-sets List eval prompt sets #
POST /v1/ai/eval/prompt-sets Create an eval prompt set #
GET /v1/ai/eval/prompt-sets/{promptSetId} Get an eval prompt set #
PATCH /v1/ai/eval/prompt-sets/{promptSetId} Update an eval prompt set #
DELETE /v1/ai/eval/prompt-sets/{promptSetId} Archive an eval prompt set #
POST /v1/ai/eval/prompt-sets/{promptSetId}/unarchive Restore an archived eval prompt set #
GET /v1/ai/eval/runs List eval runs #
POST /v1/ai/eval/runs Start an eval run #
GET /v1/ai/eval/runs/{runId} Get an eval run #
DELETE /v1/ai/eval/runs/{runId} Archive an eval run #
POST /v1/ai/eval/runs/{runId}/cancel Cancel an eval run #
POST /v1/ai/eval/runs/{runId}/unarchive Restore an archived eval run #

Documentation

📖
Documentation
https://docs.omni.co/api
📖
APIReference
https://docs.omni.co/api/api-explorer

Specifications

⚙
OpenAPI
https://raw.githubusercontent.com/api-evangelist/omni/refs/heads/main/openapi/omni-ai-eval-api-openapi.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/omni-ai-eval-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

omni-ai-eval-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Omni AI Eval API
  description: The Omni REST API provides programmatic access to your Omni instance for managing users, documents, queries, schedules, and more.
  version: 1.0.0
  contact:
    name: Omni Support
    url: https://docs.omni.co
servers:
- url: https://{instance}.omniapp.co/api
  description: Production
  variables:
    instance:
      default: blobsrus
      description: Your production Omni instance subdomain
- url: https://{instance}.playground.exploreomni.dev/api
  description: Playground
  variables:
    instance:
      default: blobsrus
      description: Your playground Omni instance subdomain
security:
- bearerAuth: []
- orgApiKey: []
tags:


# --- truncated at 32 KB (50 KB total) ---
# Full source: https://raw.githubusercontent.com/api-evangelist/omni/refs/heads/main/openapi/omni-ai-eval-api-openapi.yml