CrawlCheck Served API
The Served API from CrawlCheck — 1 operation(s) for served.
Work with this as data
Every API here is available over the APIs.io API and to AI agents over MCP.
MCP server
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
Tools for apis
7 MCP tools reach this
find_apisBrowse and filter every API in the catalog.get_api_artifactsOne API's artifacts, grouped by type.get_openapiThe primary OpenAPI for this API.find_similar_apisAPIs that look like this one.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.
Call it yourself
curl for this page
This API
curl "https://apis.io/api/v1/apis/crawlcheck-io:crawlcheck-io-served-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.
Get an API key
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.
OpenAPI Specification
openapi: 3.2.0
info:
title: Crawlcheck Io Served API
version: '1'
contact:
name: CrawlCheck
url: https://crawlcheck.io/policy
email: hello@crawlcheck.io
license:
name: Terms
url: https://crawlcheck.io/policy
x-core-contract:
promise: 'These operations are the core contract. They stay at /api/v1 and keep answering for at least 180 days after any /api/v2 is announced; their stable fields change only in a new major version, and their provisional fields only after 30 days'' notice, per /docs/api/compatibility. Verifying what they return needs none of these calls: crawlcheck-verify.mjs checks a document on your machine against the published keys (/.well-known/http-message-signatures-directory) and the rotation record, read once with --online or saved for --keys. Everything else documented here is useful but secondary, and may change with the notice its fields'' tags promise.'
operations:
- method: GET
path: /api/v1/resolve
operationId: resolveDomainV1
- method: POST
path: /api/v1/resolve
operationId: resolveBatchV1
- method: POST
path: /api/v1/preflight
operationId: preflightV1
- method: GET
path: /api/v1/decisions/{sha256}
operationId: decisionCheckV1
- method: GET
path: /api/v1/revocations
operationId: revocations
- method: GET
path: /api/v1/visitor
operationId: visitorResolveV1
- method: POST
path: /api/v1/visitor
operationId: visitorResolveBatchV1
- method: GET
path: /api/v1/mcp/scan
operationId: mcpScanUrl
- method: POST
path: /api/v1/mcp/lock/check
operationId: mcpLockCheck
list: https://crawlcheck.io/api/v1/core
description: 'Operations tagged Served across 2 of this provider''s published API definitions: crawlcheck-io-openapi.json, crawlcheck-io-openapi.yml. Each path carries the servers of the definition it was published in.'
servers:
- url: https://crawlcheck.io
tags:
- name: Served
paths:
/api/v1/served:
get:
operationId: servedV1
summary: 'Time travel (tt1): what a site served each crawler identity on a past date…'
parameters:
- name: url
in: query
required: true
schema:
type: string
- name: date
in: query
required: false
schema:
type: string
format: date
- name: identity
in: query
required: false
schema:
type: string
- name: from
in: query
required: false
schema:
type: string
format: date
- name: to
in: query
required: false
schema:
type: string
format: date
- name: format
in: query
required: false
schema:
type: string
enum:
- html
responses:
'200':
description: crawlcheck-served
content:
application/json:
examples:
worked:
summary: Shape of the answer; values are not a measurement. Needs a licence covering the domain.
value:
kind: crawlcheck-served
v: 1
domain: example.com
date_asked: '2026-10-22'
exact_day: true
observed_at: '2026-10-22T09:14:03.000Z'
url: https://example.com
identities:
- identity: gptbot
label: GPTBot
role: train
status: 403
bytes: 5120
sha256: …
words: 38
blocker: cloudflare
redirected_to: null
- identity: browser
label: Mobile browser
role: browser
status: 200
bytes: 48211
sha256: …
words: 1210
blocker: null
redirected_to: null
same_for_all: false
identity:
identity: gptbot
status: 403
held: true
text: Sorry, you have been blocked …
text_words: 38
vs_browser:
same_bytes: false
browser_words: 1210
robots_txt:
sha256: …
status: 200
text: 'User-agent: *
Allow: /'
proof:
said: https://crawlcheck.io/api/v1/said?url=https%3A%2F%2Fexample.com&date=2026-10-22
verify: https://crawlcheck.io/api/verify?id=…
day_root: https://crawlcheck.io/proof/2026-10-22
sha256: …
signature: …
schema:
type:
- object
- 'null'
properties:
kind:
type:
- string
- 'null'
v:
type:
- number
- 'null'
domain:
type:
- string
- 'null'
date_asked:
type:
- string
- 'null'
exact_day:
type:
- boolean
- 'null'
observed_at:
type:
- string
- 'null'
url:
type:
- string
- 'null'
identities:
type:
- array
- 'null'
items:
type:
- object
- 'null'
properties:
identity:
type:
- string
- 'null'
label:
type:
- string
- 'null'
role:
type:
- string
- 'null'
status:
type:
- number
- 'null'
bytes:
type:
- number
- 'null'
sha256: {}
words:
type:
- number
- 'null'
blocker:
type:
- string
- 'null'
redirected_to: {}
additionalProperties: true
same_for_all:
type:
- boolean
- 'null'
identity:
type:
- object
- 'null'
properties:
identity:
type:
- string
- 'null'
status:
type:
- number
- 'null'
held:
type:
- boolean
- 'null'
text: {}
text_words:
type:
- number
- 'null'
vs_browser:
type:
- object
- 'null'
properties:
same_bytes:
type:
- boolean
- 'null'
browser_words:
type:
- number
- 'null'
additionalProperties: true
additionalProperties: true
robots_txt:
type:
- object
- 'null'
properties:
sha256: {}
status:
type:
- number
- 'null'
text:
type:
- string
- 'null'
additionalProperties: true
proof:
type:
- object
- 'null'
properties:
said:
type:
- string
- 'null'
verify: {}
day_root:
type:
- string
- 'null'
additionalProperties: true
sha256: {}
signature: {}
additionalProperties: true
x-schema-source: worked-example
'403':
description: no licence for the domain
'404':
description: no reading on or before the date
x-codeSamples:
- lang: Shell
label: curl
source: 'curl -s -H ''x-crawlcheck-key: <your licence key>'' ''https://crawlcheck.io/api/v1/served?url=https://example.com/&date=2026-10-22&identity=gptbot'''
security: []
x-auth: public; no credential read
tags:
- Served
servers:
- url: https://crawlcheck.io
components:
securitySchemes:
licenceKey:
type: apiKey
in: header
name: x-crawlcheck-key
description: 'Your licence key: cc_ followed by 32 hex characters. Sent on every keyed call.'
bearer:
type: http
scheme: bearer
description: The same licence key as a Bearer token. Accepted on /api/v1/* and /api/usage.
externalDocs:
url: https://crawlcheck.io/docs/api
description: Human-readable reference
x-refined-from:
- crawlcheck-io-openapi.json
- crawlcheck-io-openapi.yml