Datumo

Datumo provides an advanced LLM evaluation platform that offers automated generation of golden question sets, custom metric support, and comprehensive red‑team testing for AI models. Their services include Datumo Eval for model benchmarking, AI Red Team for adversarial analysis, and a dataset store with premium and open datasets for training and evaluation. The platform aims to help developers and researchers improve LLM performance, safety, and reliability through detailed analytics and actionable insights.

Datumo is profiled on the APIs.io network. Tagged areas include Company, Artificial Intelligence, Evaluation, LLM, and Platform.

Datumo’s developer surface includes changelog, getting-started guide, documentation, engineering blog, support, pricing, and 9 more developer resources.

🌐 Visit website 📡 Profile data on GitHub

11.3/100 emerging ▼ -7.2 Agent 0/100 human only Heartbeat 94/100 alive Full breakdown ↓
scored 2026-11-06 · rubric v0.27.0 · Show this score on your site →

0 APIs

Company Artificial Intelligence Evaluation LLM Platform

Kin Score

Kin Score How this is scored →
scored 2026-11-06 · rubric v0.27.0

Composite quality — 11.3/100 · emerging

Contract Quality 0.0 / 21

Developer Ergonomics 3.2 / 17

Access Clarity 1.8 / 17

Operational Transparency 0.9 / 11

Contract Governance 0.0 / 10

Discoverability 4.7 / 9

Regulatory Posture 1.1 / 15

Agent readiness — 0/100 · human only

Machine-Readable Contract 0 / 18

Agentic Access Contract 0 / 10

Documented Reversibility 0 / 6

MCP Server 0 / 12

Machine-Readable Auth 0 / 10

Idempotency 0 / 9

Stable Error Semantics 0 / 8

Request/Response Examples 0 / 7

Rate-Limit Signaling 0 / 7

Typed Event Surface 0 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Delegated User Identity 0 / 6

Protected Resource Metadata 0 / 5

Registration Without a Human 0 / 6

Agentic Commerce Well-Known Document 0 / 5

Pagination 5 / 5

Distinct Operations 3 / 3

MCP Tool Quality 6 / 6

Regulatory Posture applies to this provider. Its tags matched the Horizontal (data, software, accessibility, platform) regime, so Regulatory Posture carries 15 points of the composite. If this regime is wrong for your business, say so on your provider repo — the applicability map is public and we will correct it.

Create-or-Update Ergonomics could not be measured. We hold no machine-readable contract for this provider to read, so there is nothing to measure a write surface against. Excluded rather than scored zero: never-measured and measured-empty are different facts. Publishing an OpenAPI is what makes this facet — and several others — scorable at all.

The six quality facets above are damped to 85 points between them, because the conditional facet above carries the other 15. That is why each facet's contribution is shown against a damped maximum: raising a quality facet moves the composite by 85% of its nominal weight, not 100%. The full arithmetic is at apis.io/rating/.

Show this score on your site.

It updates itself when the score changes. Paste this where you link to your API docs:

<a href="https://apis.io/providers/datumo/"><img src="https://apis.io/badge/datumo/card.svg" alt="Datumo on APIs.io — Kin Score by API Evangelist"></a>

Other styles, a README pill and a shields.io endpoint are on the badge page.

Raise your score.

Agent readiness — checks not met, largest first (exact, from this profile):

Machine-Readable Contract +18 pts — api_specs includes an OpenAPI document
MCP Server +12 pts — deployment.mode + probe verdict on the mcp/ manifest, not the pointer; an unprobed slug falls back to authorship
Agentic Access Contract +10 pts — agentic_access artifact present (x-agentic-access), graded by author
Machine-Readable Auth +10 pts — a served openid-configuration/oauth-authorization-server carrying `issuer` (served), else the securitySchemes class in the provider OpenAPIs — bound (mutualTLS, DPoP, Signature) > negotiable (oauth2 authorizationCode/clientCredentials, openIdConnect) > bearer (http bearer, apiKey)
Idempotency +9 pts — OpenAPI mutating operations declare an idempotency key — a header, a request-body property, or a named de-duplication token whose own description says so (verified); else common[].type matches /idempoten/i (documented)
Stable Error Semantics +8 pts — OpenAPI $refs a shared error schema across 4xx/5xx responses (verified), else common[].type includes ErrorCatalog / ErrorCodes / DeclineCodes

13 more unmet checks in the Agent Readiness table above.

Kin Score — facets with the most composite points still available (weight × headroom):

Contract Quality scores 0.0 — up to +25.0 composite points
Access Clarity scores 10.5 — up to +17.9 composite points
Developer Ergonomics scores 19.0 — up to +16.2 composite points

Each check links to what satisfies it. Publish the artifact, or tell us where it already lives, and the score moves on the next scoring run.

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from the provider profile at artifacts.apis.io/datumo/apis.yml: open an issue on github.com/api-evangelist/datumo to ask a question or point us at an artifact you publish. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

Security Posture 1

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Datumo Domain Security

TLSv1.3 · DMARC

SECURITY

Resources

Get Started 2

Portal, sign-up, and the first successful call

DeveloperPortal

DeveloperPortal

GettingStarted

GettingStarted

Documentation 1

Reference material describing how the API behaves

Documentation

Documentation

Agent Surfaces 2

MCP servers, agent skills, and machine-readable catalogs

LLMsTxt

LLMsTxt

WellKnown

WellKnown

Access & Security 1

Authentication, authorization, and security posture

DomainSecurity

DomainSecurity

Operate 3

Status, limits, changes, and where to get help

ChangeLog

ChangeLog

ChangeLog

ChangeLog

Support

Support

Commercial 2

Pricing, plans, and the legal terms of use

Pricing

Pricing

PrivacyPolicy

PrivacyPolicy

Company 2

The organization behind the API

Website

Website

Blog

Blog

Other 2

Properties that don't map to a standard resource type

Hosts

Hosts

Vendors

Vendors

Source (apis.yml)

aid: datumo
name: Datumo
accessModel:
  pricing: unknown
  onboarding: unknown
  trial: false
  try_now: false
  public: false
  label: Unknown
  confidence: low
  probe_state: unreadable
  source:
  - security
  generated: '2026-11-06'
  method: derived
image: https://datumo.com/wp-content/uploads/2024/08/back_3.webp
description: Datumo provides an advanced LLM evaluation platform that offers automated generation of golden question sets,
  custom metric support, and comprehensive red‑team testing for AI models. Their services include Datumo Eval for model benchmarking,
  AI Red Team for adversarial analysis, and a dataset store with premium and open datasets for training and evaluation. The
  platform aims to help developers and researchers improve LLM performance, safety, and reliability through detailed analytics
  and actionable insights.
url: https://raw.githubusercontent.com/api-evangelist/datumo/refs/heads/main/apis.yml
x-type: company
x-source: harvest:g2-catalog
x-tier: profiled
x-tier-reason: enrichment pass 2026-10-16 (modular-v1; was harvest)
specificationVersion: '0.20'
created: '2026-10-16'
modified: '2026-10-16'
tags:
- Company
- Artificial Intelligence
- Evaluation
- LLM
- Platform
tags_raw:
- Company
- AI
- Evaluation
- LLM
- Platform
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
- FN: APIs.json
  email: info@apis.io
common:
- type: ChangeLog
  url: changelog/datumo-changelog.yml
- type: LLMsTxt
  url: llms/datumo-llms.txt
- type: WellKnown
  url: well-known/datumo-well-known.yml
- type: Hosts
  url: hosts/datumo-hosts.yml
- type: Vendors
  url: vendors/datumo-vendors.yml
- type: DeveloperPortal
  url: https://dev.datumo.com/
- type: ChangeLog
  url: https://docs.datumo.com/changelog
- type: GettingStarted
  url: https://docs.datumo.com/documentation/readme/quickstart
- type: DomainSecurity
  url: security/datumo-domain-security.yml
- type: Website
  url: https://datumo.com/
- type: Documentation
  url: https://open.datumo.com/en/
- type: Blog
  url: https://datumo.com/blog/
- type: Support
  url: https://datumo.com/contact_datumo/
- type: Pricing
  url: https://datumo.com/paid-dataset/
- type: PrivacyPolicy
  url: https://stump-shark-f56.notion.site/DATUMO-Privacy-Policy-7eeb73c3d8044a058dce8e3057a4df2b
apis: []
x-coverage:
  state: unreadable
  reason: js-rendered-docs
  detail: Documentation is served as a JavaScript‑rendered GitBook site with no machine‑readable OpenAPI spec.
  evidence:
  - url: https://docs.datumo.com/
    status: 200
  checked: '2026-10-16'
x-enrichment:
  date: '2026-10-16'
  status: enriched
  artifacts_added: 8
  pass: modular-v1
  engine: identity=local,contract=local,surfaces=local,docs=local,regulatory=local

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this

find_providersBrowse and filter every provider in the catalog.
get_provider_artifactsEvery artifact this provider publishes, grouped by type.
get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
get_provider_ratingPRO — composite, band, trend and facet scores.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This provider

curl "https://apis.io/api/v1/providers/datumo"

All providers

curl "https://apis.io/api/v1/providers?limit=25"

Every operation they expose

curl "https://apis.io/api/v1/providers/datumo/operations?limit=25"

How their score was established

curl "https://apis.io/api/v1/providers/datumo/evidence"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.