The Identity Divergence API from CrawlCheck — 1 operation(s) for identity divergence.
Every API here is available over the APIs.io API and to AI agents over MCP.
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
find_apisBrowse and filter every API in the catalog.get_api_artifactsOne API's artifacts, grouped by type.get_openapiThe primary OpenAPI for this API.find_similar_apisAPIs that look like this one.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.curl "https://apis.io/api/v1/apis/crawlcheck-io:crawlcheck-io-identity-divergence-api"curl "https://apis.io/api/v1/apis?limit=25"Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.
openapi: 3.2.0
info:
title: Crawlcheck Io Identity Divergence API
version: '1'
contact:
name: CrawlCheck
url: https://crawlcheck.io/policy
email: hello@crawlcheck.io
license:
name: Terms
url: https://crawlcheck.io/policy
x-core-contract:
promise: 'These operations are the core contract. They stay at /api/v1 and keep answering for at least 180 days after any /api/v2 is announced; their stable fields change only in a new major version, and their provisional fields only after 30 days'' notice, per /docs/api/compatibility. Verifying what they return needs none of these calls: crawlcheck-verify.mjs checks a document on your machine against the published keys (/.well-known/http-message-signatures-directory) and the rotation record, read once with --online or saved for --keys. Everything else documented here is useful but secondary, and may change with the notice its fields'' tags promise.'
operations:
- method: GET
path: /api/v1/resolve
operationId: resolveDomainV1
- method: POST
path: /api/v1/resolve
operationId: resolveBatchV1
- method: POST
path: /api/v1/preflight
operationId: preflightV1
- method: GET
path: /api/v1/decisions/{sha256}
operationId: decisionCheckV1
- method: GET
path: /api/v1/revocations
operationId: revocations
- method: GET
path: /api/v1/visitor
operationId: visitorResolveV1
- method: POST
path: /api/v1/visitor
operationId: visitorResolveBatchV1
- method: GET
path: /api/v1/mcp/scan
operationId: mcpScanUrl
- method: POST
path: /api/v1/mcp/lock/check
operationId: mcpLockCheck
list: https://crawlcheck.io/api/v1/core
description: 'Operations tagged Identity Divergence across 2 of this provider''s published API definitions: crawlcheck-io-openapi.json, crawlcheck-io-openapi.yml. Each path carries the servers of the definition it was published in.'
servers:
- url: https://crawlcheck.io
tags:
- name: Identity Divergence
paths:
/api/v1/identity-divergence:
get:
operationId: identityDivergence
summary: Which document each crawler identity was handed, from the latest scan of a…
parameters:
- name: domain
in: query
required: true
schema:
type: string
responses:
'200':
description: signed crawlcheck-identity-divergence
content:
application/json:
examples:
worked:
summary: Shape from the build harness on 2026-11-01 (a mock site that hands Googlebot a different title and author, and a challenge to ClaudeBot); lists shortened and the signature block abbreviated.
value:
kind: crawlcheck-identity-divergence
v: 1
domain: example.com
report: https://crawlcheck.io/r/m8x6j1ua9m
measured_at: '2026-11-01T15:34:31.483Z'
state: measured
url: https://example.com/
baseline:
id: desktop
label: Desktop browser
attributes:
title: Example Co — Denver fencing
h1: Example Co fencing in Denver
robots: ''
canonical: https://example.com/
words: 294
unique_ratio: 0.112
begin_unique_ratio: 0.124
salient:
- denver
- fence
- arvada
- cedar
- crews
top_term_share: 0.048
chrome_share: 0.017
dates:
byline: '2026-05-12'
byline_modified: ''
syntactic: ''
semantic: '2026-05-12'
entities:
- Organization:Example Co
author: Jane Roe
bad_title: false
identities:
- id: googlebot
label: Googlebot
role: search
status: 200
class: differs
fields:
- title
- author
diff:
- field: title
baseline: example co — denver fencing
this: buy cheap fences now!!!
- field: author
baseline: jane roe
this: staff
looks_like: 'a different document: the page''s own identity fields differ'
- id: claudebot
label: ClaudeBot
role: train
status: 403
class: error_to_this_identity
detail: served a Cloudflare managed challenge at HTTP 403
- id: gptbot
label: GPTBot
role: train
status: 200
class: same
counts:
compared: 14
same: 13
differs: 1
error: 1
not_compared: 0
googlebot:
class: differs
fields:
- title
- author
looks_like: 'a different document: the page''s own identity fields differ'
detail: null
reading: Document attributes computed on the copy each identity was served, against the desktop browser's copy (and Googlebot's, named separately). Only a real difference is listed. Reported, never scored.
signature:
kid: '...'
alg: ed25519
schema:
type:
- object
- 'null'
properties:
kind:
type:
- string
- 'null'
v:
type:
- number
- 'null'
domain:
type:
- string
- 'null'
report:
type:
- string
- 'null'
measured_at:
type:
- string
- 'null'
state:
type:
- string
- 'null'
url:
type:
- string
- 'null'
baseline:
type:
- object
- 'null'
properties:
id:
type:
- string
- 'null'
label:
type:
- string
- 'null'
additionalProperties: true
attributes:
type:
- object
- 'null'
properties:
title:
type:
- string
- 'null'
h1:
type:
- string
- 'null'
robots:
type:
- string
- 'null'
canonical:
type:
- string
- 'null'
words:
type:
- number
- 'null'
unique_ratio:
type:
- number
- 'null'
begin_unique_ratio:
type:
- number
- 'null'
salient:
type:
- array
- 'null'
items:
type:
- string
- 'null'
top_term_share:
type:
- number
- 'null'
chrome_share:
type:
- number
- 'null'
dates:
type:
- object
- 'null'
properties:
byline:
type:
- string
- 'null'
byline_modified:
type:
- string
- 'null'
syntactic:
type:
- string
- 'null'
semantic:
type:
- string
- 'null'
additionalProperties: true
entities:
type:
- array
- 'null'
items:
type:
- string
- 'null'
author:
type:
- string
- 'null'
bad_title:
type:
- boolean
- 'null'
additionalProperties: true
identities:
type:
- array
- 'null'
items:
type:
- object
- 'null'
properties:
id:
type:
- string
- 'null'
label:
type:
- string
- 'null'
role:
type:
- string
- 'null'
status:
type:
- number
- 'null'
class:
type:
- string
- 'null'
fields:
type:
- array
- 'null'
items:
type:
- string
- 'null'
diff:
type:
- array
- 'null'
items:
type:
- object
- 'null'
properties:
field:
type:
- string
- 'null'
baseline:
type:
- string
- 'null'
this:
type:
- string
- 'null'
additionalProperties: true
looks_like:
type:
- string
- 'null'
detail:
type:
- string
- 'null'
additionalProperties: true
counts:
type:
- object
- 'null'
properties:
compared:
type:
- number
- 'null'
same:
type:
- number
- 'null'
differs:
type:
- number
- 'null'
error:
type:
- number
- 'null'
not_compared:
type:
- number
- 'null'
additionalProperties: true
googlebot:
type:
- object
- 'null'
properties:
class:
type:
- string
- 'null'
fields:
type:
- array
- 'null'
items:
type:
- string
- 'null'
looks_like:
type:
- string
- 'null'
detail: {}
additionalProperties: true
reading:
type:
- string
- 'null'
signature:
type:
- object
- 'null'
properties:
kid: {}
alg:
type:
- string
- 'null'
additionalProperties: true
additionalProperties: true
x-schema-source: worked-example
'404':
description: no scan on record
x-codeSamples:
- lang: Shell
label: curl
source: curl -s 'https://crawlcheck.io/api/v1/identity-divergence?domain=example.com'
security: []
x-auth: public; no credential read
tags:
- Identity Divergence
servers:
- url: https://crawlcheck.io
components:
securitySchemes:
licenceKey:
type: apiKey
in: header
name: x-crawlcheck-key
description: 'Your licence key: cc_ followed by 32 hex characters. Sent on every keyed call.'
bearer:
type: http
scheme: bearer
description: The same licence key as a Bearer token. Accepted on /api/v1/* and /api/usage.
externalDocs:
url: https://crawlcheck.io/docs/api
description: Human-readable reference
x-refined-from:
- crawlcheck-io-openapi.json
- crawlcheck-io-openapi.yml