Deepchecks

Deepchecks is an ML and LLM testing, evaluation, and monitoring platform. Its cloud LLM Evaluation product exposes a REST API for logging LLM interactions, managing applications and versions, retrieving annotations, and configuring evaluation properties, while its open-source Python packages provide continuous validation of tabular, computer-vision, and LLM data and models.

Deepchecks publishes 6 APIs on the APIs.io network, including Application Versions API, Applications API, Interactions API, and 3 more. Tagged areas include AI, LLM, Evaluation, Testing, and Monitoring.

Deepchecks’ developer surface includes authentication, documentation, and 8 more developer resources.

🌐 Visit website 📡 Source on GitHub

37.4/100 thin ▬ flat Agent 31/100 agent aware Full breakdown ↓
scored 2026-07-28 · rubric v0.6

AccessFreemiumSelf serveFree trial⚡ Free to try

7 APIs

AILLMEvaluationTestingMonitoring

Kin Score

Kin Score How this is scored →
scored 2026-07-28 · rubric v0.6

Composite quality — 37.4/100 · thin

Contract Quality 13.4 / 25

Developer Ergonomics 3.9 / 20

Commercial Clarity 7.9 / 20

Operational Transparency 4.8 / 13

Governance 0.0 / 12

Discoverability 7.4 / 10

Agent readiness — 31/100 · agent aware

Machine-Readable Contract 18 / 18

Agentic Access Contract 10 / 10

MCP Server 0 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 0 / 8

Request/Response Examples 0 / 7

Rate-Limit Signaling 7 / 7

Typed Event Surface 0 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/deepchecks: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

APIs 7

Individual APIs this provider publishes, each with its own machine-readable definition.

Rate Limits 1

Documented rate limits and quota policies.

Deepchecks Rate Limits

4 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Documentation 1

Reference material describing how the API behaves

Documentation

Documentation

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess

AgenticAccess

Build 1

SDKs, sample code, and the tooling you integrate with

GitHubOrganization

GitHubOrganization

Access & Security 2

Authentication, authorization, and security posture

DomainSecurity

DomainSecurity

Authentication

Authentication

Operate 1

Status, limits, changes, and where to get help

RateLimits

RateLimits

Commercial 2

Pricing, plans, and the legal terms of use

Plans

Plans

FinOps

FinOps

Company 2

The organization behind the API

LinkedIn

Website

Website

Source (apis.yml)

aid: deepchecks
url: https://raw.githubusercontent.com/api-evangelist/deepchecks/refs/heads/main/apis.yml
name: Deepchecks
kind: company
description: Deepchecks is an ML and LLM testing, evaluation, and monitoring platform. Its cloud LLM Evaluation product exposes
  a REST API for logging LLM interactions, managing applications and versions, retrieving annotations, and configuring evaluation
  properties, while its open-source Python packages provide continuous validation of tabular, computer-vision, and LLM data
  and models.
accessModel:
  pricing: freemium
  onboarding: self-serve
  trial: true
  try_now: true
  public: false
  label: Freemium (free trial) · Self-serve signup
  confidence: high
  source:
  - plans
  - authentication
  generated: '2026-07-22'
  method: derived
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/deepchecks.png
tags:
- AI
- LLM
- Evaluation
- Testing
- Monitoring
created: '2026-06-20'
modified: '2026-06-20'
specificationVersion: '0.19'
apis:
- aid: deepchecks:open-source-testing
  name: Deepchecks Open-Source Testing
  tags:
  - Open Source
  - Testing
  - Validation
  - Python
  image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/apis-json-logo.jpg
  humanURL: https://github.com/deepchecks/deepchecks
  baseURL: https://github.com/deepchecks/deepchecks
  properties:
  - url: https://docs.deepchecks.com/stable/getting-started/welcome.html
    type: Documentation
  - url: https://github.com/deepchecks/deepchecks
    type: GitHub
  description: The AGPL-3.0 licensed open-source Python package for continuous validation of tabular, computer-vision, and
    LLM/NLP data and models. Distributed via PyPI (pip install deepchecks); a Python library rather than a hosted HTTP API.
- aid: deepchecks:deepchecks-application-versions-api
  name: Deepchecks Application Versions API
  description: Versions of an evaluation application.
  humanURL: https://llmdocs.deepchecks.com/reference
  baseURL: https://app.llm.deepchecks.com/api/v1
  tags:
  - Application Versions
  properties:
  - type: OpenAPI
    url: openapi/deepchecks-application-versions-api-openapi.yml
  - type: Documentation
    url: https://llmdocs.deepchecks.com/docs/deepchecks-sdk
  - type: APIReference
    url: https://llmdocs.deepchecks.com/reference
  - type: PostmanCollection
    url: collections/deepchecks.postman_collection.json
  - type: OpenCollection
    url: collections/deepchecks.opencollection.json
  - type: GitHub
    url: https://github.com/deepchecks
- aid: deepchecks:deepchecks-applications-api
  name: Deepchecks Applications API
  description: Evaluation applications.
  humanURL: https://llmdocs.deepchecks.com/reference
  baseURL: https://app.llm.deepchecks.com/api/v1
  tags:
  - Applications
  properties:
  - type: OpenAPI
    url: openapi/deepchecks-applications-api-openapi.yml
  - type: Documentation
    url: https://llmdocs.deepchecks.com/docs/deepchecks-sdk
  - type: APIReference
    url: https://llmdocs.deepchecks.com/reference
  - type: PostmanCollection
    url: collections/deepchecks.postman_collection.json
  - type: OpenCollection
    url: collections/deepchecks.opencollection.json
  - type: GitHub
    url: https://github.com/deepchecks
- aid: deepchecks:deepchecks-interactions-api
  name: Deepchecks Interactions API
  description: LLM interaction logging and retrieval.
  humanURL: https://llmdocs.deepchecks.com/reference
  baseURL: https://app.llm.deepchecks.com/api/v1
  tags:
  - Interactions
  properties:
  - type: OpenAPI
    url: openapi/deepchecks-interactions-api-openapi.yml
  - type: Documentation
    url: https://llmdocs.deepchecks.com/docs/deepchecks-sdk
  - type: APIReference
    url: https://llmdocs.deepchecks.com/reference
  - type: PostmanCollection
    url: collections/deepchecks.postman_collection.json
  - type: OpenCollection
    url: collections/deepchecks.opencollection.json
  - type: GitHub
    url: https://github.com/deepchecks
- aid: deepchecks:deepchecks-properties-api
  name: Deepchecks Properties API
  description: LLM property definitions.
  humanURL: https://llmdocs.deepchecks.com/reference
  baseURL: https://app.llm.deepchecks.com/api/v1
  tags:
  - Properties
  properties:
  - type: OpenAPI
    url: openapi/deepchecks-properties-api-openapi.yml
  - type: Documentation
    url: https://llmdocs.deepchecks.com/docs/deepchecks-sdk
  - type: APIReference
    url: https://llmdocs.deepchecks.com/reference
  - type: PostmanCollection
    url: collections/deepchecks.postman_collection.json
  - type: OpenCollection
    url: collections/deepchecks.opencollection.json
  - type: GitHub
    url: https://github.com/deepchecks
- aid: deepchecks:deepchecks-spans-api
  name: Deepchecks Spans API
  description: Raw tracing spans.
  humanURL: https://llmdocs.deepchecks.com/reference
  baseURL: https://app.llm.deepchecks.com/api/v1
  tags:
  - Spans
  properties:
  - type: OpenAPI
    url: openapi/deepchecks-spans-api-openapi.yml
  - type: Documentation
    url: https://llmdocs.deepchecks.com/docs/deepchecks-sdk
  - type: APIReference
    url: https://llmdocs.deepchecks.com/reference
  - type: PostmanCollection
    url: collections/deepchecks.postman_collection.json
  - type: OpenCollection
    url: collections/deepchecks.opencollection.json
  - type: GitHub
    url: https://github.com/deepchecks
- aid: deepchecks:deepchecks-system-api
  name: Deepchecks System API
  description: Backend metadata.
  humanURL: https://llmdocs.deepchecks.com/reference
  baseURL: https://app.llm.deepchecks.com/api/v1
  tags:
  - System
  properties:
  - type: OpenAPI
    url: openapi/deepchecks-system-api-openapi.yml
  - type: Documentation
    url: https://llmdocs.deepchecks.com/docs/deepchecks-sdk
  - type: APIReference
    url: https://llmdocs.deepchecks.com/reference
  - type: PostmanCollection
    url: collections/deepchecks.postman_collection.json
  - type: OpenCollection
    url: collections/deepchecks.opencollection.json
  - type: GitHub
    url: https://github.com/deepchecks
common:
- type: AgenticAccess
  url: agentic-access/deepchecks-agentic-access.yml
- type: DomainSecurity
  url: security/deepchecks-domain-security.yml
- type: Authentication
  url: authentication/deepchecks-authentication.yml
- type: GitHubOrganization
  url: https://github.com/deepchecks
- type: LinkedIn
  url: https://www.linkedin.com/company/deepchecks
- type: Website
  url: https://www.deepchecks.com
- type: Documentation
  url: https://llmdocs.deepchecks.com
- type: Plans
  url: plans/deepchecks-plans-pricing.yml
- type: RateLimits
  url: rate-limits/deepchecks-rate-limits.yml
- type: FinOps
  url: finops/deepchecks-finops.yml
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com

Deepchecks

Kin Score

APIs 7

Deepchecks Open-Source Testing

Deepchecks Application Versions API

Deepchecks Applications API

Deepchecks Interactions API

Deepchecks Properties API

Deepchecks Spans API

Deepchecks System API

Open Collections 1

Deepchecks LLM Evaluation API

Pricing Plans 1

Deepchecks Plans Pricing

Rate Limits 1

Deepchecks Rate Limits

FinOps 1

Deepchecks Finops

Security Posture 2

Deepchecks Authentication

Deepchecks Domain Security

Agentic Access 1

Deepchecks Agentic Access

Resources