Openlayer website screenshot

Openlayer

Openlayer is an AI evaluation, testing, and observability platform for machine learning and LLM applications. Its REST API lets teams create projects, commit model versions and datasets, run tests, stream production inference data into monitoring pipelines, and retrieve test results - with official SDKs generated from a Stainless OpenAPI definition.

Openlayer publishes 6 APIs on the APIs.io network, including Commits API, Data Stream API, Inference Pipelines API, and 3 more. Tagged areas include AI, Evaluation, Testing, Observability, and LLM.

Openlayer’s developer surface includes authentication, documentation, engineering blog, and 9 more developer resources.

39.6/100 thin ▬ flat Agent 31/100 agent aware Full breakdown ↓
scored 2026-08-05 · rubric v0.9.1
AccessEnterpriseSelf serve
6 APIs
AIEvaluationTestingObservabilityLLMMLOps

Kin Score

Kin Score Kin Score How this is scored →
scored 2026-08-05 · rubric v0.9.1
Composite quality — 39.6/100 · thin
Contract Quality 15.7 / 25
Developer Ergonomics 4.3 / 20
Commercial Clarity 7.4 / 20
Operational Transparency 4.8 / 13
Governance 0.0 / 12
Discoverability 7.4 / 10
Agent readiness — 31/100 · agent aware
Machine-Readable Contract 18 / 18
Agentic Access Contract 10 / 10
MCP Server 0 / 12
Machine-Readable Auth 10 / 10
Idempotency 0 / 9
Stable Error Semantics 0 / 8
Request/Response Examples 0 / 7
Rate-Limit Signaling 7 / 7
Typed Event Surface 0 / 6
Agent Skills 0 / 5
Well-Known Catalog 0 / 4
Consent & Bot Identity 0 / 3
A2A Agent Card 0 / 8
Dry-Run / Simulate Mode 0 / 4
Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/openlayer: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

APIs 6

Individual APIs this provider publishes, each with its own machine-readable definition.

Openlayer Commits API

Project versions (commits) and their test results.

Openlayer Data Stream API

Publish production inference data to a pipeline.

Openlayer Inference Pipelines API

Production monitoring pipelines and their rows, sessions, and users.

Openlayer Projects API

Create, list, and delete projects.

Openlayer Storage API

Presigned URLs for uploading datasets and artifacts.

Openlayer Tests API

Define, evaluate, and read project tests.

Open Collections 1

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

Openlayer API

OPEN COLLECTION

Pricing Plans 1

Published pricing tiers and plan structures.

Rate Limits 1

Documented rate limits and quota policies.

Openlayer Rate Limits

3 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Security Posture 3

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Openlayer Authentication

http · 1 scheme

SECURITY

Openlayer Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Openlayer Trust Center

SOC 2, HIPAA, GDPR

SECURITY

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Openlayer Agentic Access

24 operations · 14 acting

24 operations · 14 acting

AGENTIC

Resources

Documentation 1

Reference material describing how the API behaves

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

Build 1

SDKs, sample code, and the tooling you integrate with

Access & Security 3

Authentication, authorization, and security posture

Operate 1

Status, limits, changes, and where to get help

Commercial 2

Pricing, plans, and the legal terms of use

Company 3

The organization behind the API

Source (apis.yml)

apis.yml Raw ↑
aid: openlayer
url: https://raw.githubusercontent.com/api-evangelist/openlayer/refs/heads/main/apis.yml
name: Openlayer
kind: company
description: Openlayer is an AI evaluation, testing, and observability platform for machine learning and LLM applications.
  Its REST API lets teams create projects, commit model versions and datasets, run tests, stream production inference data
  into monitoring pipelines, and retrieve test results - with official SDKs generated from a Stainless OpenAPI definition.
accessModel:
  pricing: enterprise
  onboarding: self-serve
  trial: false
  try_now: false
  public: false
  label: Enterprise · Self-serve signup
  confidence: high
  source:
  - plans
  - authentication
  generated: '2026-07-22'
  method: derived
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/openlayer.png
tags:
- AI
- Evaluation
- Testing
- Observability
- LLM
- MLOps
created: '2026-06-20'
modified: '2026-06-20'
specificationVersion: '0.19'
apis:
- aid: openlayer:openlayer-commits-api
  name: Openlayer Commits API
  description: Project versions (commits) and their test results.
  humanURL: https://www.openlayer.com/docs/api-reference/rest/overview
  baseURL: https://api.openlayer.com/v1
  tags:
  - Commits
  properties:
  - type: OpenAPI
    url: openapi/openlayer-commits-api-openapi.yml
  - type: Documentation
    url: https://www.openlayer.com/docs
  - type: APIReference
    url: https://www.openlayer.com/docs/api-reference/rest/overview
  - type: PostmanCollection
    url: collections/openlayer.postman_collection.json
  - type: Documentation
    url: https://www.openlayer.com/docs/monitoring
  - type: Documentation
    url: https://www.openlayer.com/docs/monitoring/publishing-data
- aid: openlayer:openlayer-data-stream-api
  name: Openlayer Data Stream API
  description: Publish production inference data to a pipeline.
  humanURL: https://www.openlayer.com/docs/api-reference/rest/overview
  baseURL: https://api.openlayer.com/v1
  tags:
  - Data Stream
  properties:
  - type: OpenAPI
    url: openapi/openlayer-data-stream-api-openapi.yml
  - type: Documentation
    url: https://www.openlayer.com/docs
  - type: APIReference
    url: https://www.openlayer.com/docs/api-reference/rest/overview
  - type: PostmanCollection
    url: collections/openlayer.postman_collection.json
  - type: Documentation
    url: https://www.openlayer.com/docs/monitoring
  - type: Documentation
    url: https://www.openlayer.com/docs/monitoring/publishing-data
- aid: openlayer:openlayer-inference-pipelines-api
  name: Openlayer Inference Pipelines API
  description: Production monitoring pipelines and their rows, sessions, and users.
  humanURL: https://www.openlayer.com/docs/api-reference/rest/overview
  baseURL: https://api.openlayer.com/v1
  tags:
  - Inference Pipelines
  properties:
  - type: OpenAPI
    url: openapi/openlayer-inference-pipelines-api-openapi.yml
  - type: Documentation
    url: https://www.openlayer.com/docs
  - type: APIReference
    url: https://www.openlayer.com/docs/api-reference/rest/overview
  - type: PostmanCollection
    url: collections/openlayer.postman_collection.json
  - type: Documentation
    url: https://www.openlayer.com/docs/monitoring
  - type: Documentation
    url: https://www.openlayer.com/docs/monitoring/publishing-data
- aid: openlayer:openlayer-projects-api
  name: Openlayer Projects API
  description: Create, list, and delete projects.
  humanURL: https://www.openlayer.com/docs/api-reference/rest/overview
  baseURL: https://api.openlayer.com/v1
  tags:
  - Projects
  properties:
  - type: OpenAPI
    url: openapi/openlayer-projects-api-openapi.yml
  - type: Documentation
    url: https://www.openlayer.com/docs
  - type: APIReference
    url: https://www.openlayer.com/docs/api-reference/rest/overview
  - type: PostmanCollection
    url: collections/openlayer.postman_collection.json
  - type: Documentation
    url: https://www.openlayer.com/docs/monitoring
  - type: Documentation
    url: https://www.openlayer.com/docs/monitoring/publishing-data
- aid: openlayer:openlayer-storage-api
  name: Openlayer Storage API
  description: Presigned URLs for uploading datasets and artifacts.
  humanURL: https://www.openlayer.com/docs/api-reference/rest/overview
  baseURL: https://api.openlayer.com/v1
  tags:
  - Storage
  properties:
  - type: OpenAPI
    url: openapi/openlayer-storage-api-openapi.yml
  - type: Documentation
    url: https://www.openlayer.com/docs
  - type: APIReference
    url: https://www.openlayer.com/docs/api-reference/rest/overview
  - type: PostmanCollection
    url: collections/openlayer.postman_collection.json
  - type: Documentation
    url: https://www.openlayer.com/docs/monitoring
  - type: Documentation
    url: https://www.openlayer.com/docs/monitoring/publishing-data
- aid: openlayer:openlayer-tests-api
  name: Openlayer Tests API
  description: Define, evaluate, and read project tests.
  humanURL: https://www.openlayer.com/docs/api-reference/rest/overview
  baseURL: https://api.openlayer.com/v1
  tags:
  - Tests
  properties:
  - type: OpenAPI
    url: openapi/openlayer-tests-api-openapi.yml
  - type: Documentation
    url: https://www.openlayer.com/docs
  - type: APIReference
    url: https://www.openlayer.com/docs/api-reference/rest/overview
  - type: PostmanCollection
    url: collections/openlayer.postman_collection.json
  - type: Documentation
    url: https://www.openlayer.com/docs/monitoring
  - type: Documentation
    url: https://www.openlayer.com/docs/monitoring/publishing-data
common:
- type: AgenticAccess
  url: agentic-access/openlayer-agentic-access.yml
- type: TrustCenter
  url: security/openlayer-trust-center.yml
- type: DomainSecurity
  url: security/openlayer-domain-security.yml
- type: Authentication
  url: authentication/openlayer-authentication.yml
- type: GitHubOrganization
  url: https://github.com/openlayer-ai
- type: LinkedIn
  url: https://www.linkedin.com/company/openlayer
- type: Website
  url: https://www.openlayer.com
- type: Documentation
  url: https://www.openlayer.com/docs
- type: Plans
  url: plans/openlayer-plans-pricing.yml
- type: RateLimits
  url: rate-limits/openlayer-rate-limits.yml
- type: FinOps
  url: finops/openlayer-finops.yml
- url: https://www.openlayer.com/blog
  type: Blog
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com