The Agentic Web Map API from CrawlCheck — 1 operation(s) for agentic web map.
1 of 1 operations are conformant: apis.io called them with no credentials and the responses matched this contract. Checked 2026-11-12. how this works · status file
Every API here is available over the APIs.io API and to AI agents over MCP.
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
find_apisBrowse and filter every API in the catalog.get_api_artifactsOne API's artifacts, grouped by type.get_openapiThe primary OpenAPI for this API.find_similar_apisAPIs that look like this one.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.curl "https://apis.io/api/v1/apis/crawlcheck-io:crawlcheck-io-agentic-web-map-api"curl "https://apis.io/api/v1/apis?limit=25"Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.
openapi: 3.2.0
info:
title: Crawlcheck Io Agentic Web Map API
version: '1'
contact:
name: CrawlCheck
url: https://crawlcheck.io/policy
email: hello@crawlcheck.io
license:
name: Terms
url: https://crawlcheck.io/policy
x-core-contract:
promise: 'These operations are the core contract. They stay at /api/v1 and keep answering for at least 180 days after any /api/v2 is announced; their stable fields change only in a new major version, and their provisional fields only after 30 days'' notice, per /docs/api/compatibility. Verifying what they return needs none of these calls: crawlcheck-verify.mjs checks a document on your machine against the published keys (/.well-known/http-message-signatures-directory) and the rotation record, read once with --online or saved for --keys. Everything else documented here is useful but secondary, and may change with the notice its fields'' tags promise.'
operations:
- method: GET
path: /api/v1/resolve
operationId: resolveDomainV1
- method: POST
path: /api/v1/resolve
operationId: resolveBatchV1
- method: POST
path: /api/v1/preflight
operationId: preflightV1
- method: GET
path: /api/v1/decisions/{sha256}
operationId: decisionCheckV1
- method: GET
path: /api/v1/revocations
operationId: revocations
- method: GET
path: /api/v1/visitor
operationId: visitorResolveV1
- method: POST
path: /api/v1/visitor
operationId: visitorResolveBatchV1
- method: GET
path: /api/v1/mcp/scan
operationId: mcpScanUrl
- method: POST
path: /api/v1/mcp/lock/check
operationId: mcpLockCheck
list: https://crawlcheck.io/api/v1/core
description: 'Operations tagged Agentic Web Map across 2 of this provider''s published API definitions: crawlcheck-io-openapi.json, crawlcheck-io-openapi.yml. Each path carries the servers of the definition it was published in.'
servers:
- url: https://crawlcheck.io
tags:
- name: Agentic Web Map
paths:
/api/v1/agentic-web-map:
get:
operationId: agenticWebMap
summary: The agentic web map (?month=YYYY-MM; default this month, month to date until…
parameters:
- name: month
in: query
required: false
schema:
type: string
- name: domain
in: query
required: false
schema:
type: string
responses:
'200':
description: crawlcheck-agentic-web-map or crawlcheck-agentic-web-map-lookup
content:
application/json:
examples:
worked:
summary: Shape; one layer and one node shown, numbers illustrative, signature shortened.
value:
kind: crawlcheck-agentic-web-map
v: 1
month: 2026-10
state: month_to_date
frame: top10k
run: 1
sites: 9300
mapped: 9300
totals:
sites: 9300
edge_refused:
any:
count: 610
pct: 6.6
robots:
served: 8100
block_any:
count: 1900
pct: 23.5
llms_txt:
count: 700
pct: 7.5
layers:
- id: network
label: Network
providers_named: 60
nodes:
- id: network:cloudflare
name: Cloudflare
kind: provider
share: 30.1
sites: 2800
edge_refused:
any:
count: 400
pct: 14.3
robots:
served: 2500
block_any:
count: 700
pct: 28
llms_txt:
count: 300
pct: 10.7
links:
- from: network:cloudflare
to: bot:cloudflare-bot-management
sites: 900
edge_refused: 210
robots_only: 250
passes: 440
attribution:
edge_refusals_by_network:
- node: network:cloudflare
name: Cloudflare
count: 400
share_of_all: 65.6
rate: 14.3
overall_rate: 6.6
lift: 2.17
sha256: …
signature:
v: 1
alg: Ed25519
kid: …
sig: …
schema:
type:
- object
- 'null'
properties:
kind:
type:
- string
- 'null'
v:
type:
- number
- 'null'
month:
type:
- string
- 'null'
state:
type:
- string
- 'null'
frame:
type:
- string
- 'null'
run:
type:
- number
- 'null'
sites:
type:
- number
- 'null'
mapped:
type:
- number
- 'null'
totals:
type:
- object
- 'null'
properties:
sites:
type:
- number
- 'null'
edge_refused:
type:
- object
- 'null'
properties:
any:
type:
- object
- 'null'
properties:
count:
type:
- number
- 'null'
pct:
type:
- number
- 'null'
additionalProperties: true
additionalProperties: true
robots:
type:
- object
- 'null'
properties:
served:
type:
- number
- 'null'
block_any:
type:
- object
- 'null'
properties:
count:
type:
- number
- 'null'
pct:
type:
- number
- 'null'
additionalProperties: true
additionalProperties: true
llms_txt:
type:
- object
- 'null'
properties:
count:
type:
- number
- 'null'
pct:
type:
- number
- 'null'
additionalProperties: true
additionalProperties: true
layers:
type:
- array
- 'null'
items:
type:
- object
- 'null'
properties:
id:
type:
- string
- 'null'
label:
type:
- string
- 'null'
providers_named:
type:
- number
- 'null'
nodes:
type:
- array
- 'null'
items:
type:
- object
- 'null'
properties:
id:
type:
- string
- 'null'
name:
type:
- string
- 'null'
kind:
type:
- string
- 'null'
share:
type:
- number
- 'null'
sites:
type:
- number
- 'null'
edge_refused:
type:
- object
- 'null'
properties:
any:
type:
- object
- 'null'
properties:
count:
type:
- number
- 'null'
pct:
type:
- number
- 'null'
additionalProperties: true
additionalProperties: true
robots:
type:
- object
- 'null'
properties:
served:
type:
- number
- 'null'
block_any:
type:
- object
- 'null'
properties:
count:
type:
- number
- 'null'
pct:
type:
- number
- 'null'
additionalProperties: true
additionalProperties: true
llms_txt:
type:
- object
- 'null'
properties:
count:
type:
- number
- 'null'
pct:
type:
- number
- 'null'
additionalProperties: true
additionalProperties: true
additionalProperties: true
links:
type:
- array
- 'null'
items:
type:
- object
- 'null'
properties:
from:
type:
- string
- 'null'
to:
type:
- string
- 'null'
sites:
type:
- number
- 'null'
edge_refused:
type:
- number
- 'null'
robots_only:
type:
- number
- 'null'
passes:
type:
- number
- 'null'
additionalProperties: true
attribution:
type:
- object
- 'null'
properties:
edge_refusals_by_network:
type:
- array
- 'null'
items:
type:
- object
- 'null'
properties:
node:
type:
- string
- 'null'
name:
type:
- string
- 'null'
count:
type:
- number
- 'null'
share_of_all:
type:
- number
- 'null'
rate:
type:
- number
- 'null'
overall_rate:
type:
- number
- 'null'
lift:
type:
- number
- 'null'
additionalProperties: true
additionalProperties: true
sha256: {}
signature:
type:
- object
- 'null'
properties:
v:
type:
- number
- 'null'
alg:
type:
- string
- 'null'
kid: {}
sig: {}
additionalProperties: true
additionalProperties: true
x-schema-source: worked-example
'400':
description: bad month or domain
'404':
description: no edition for that month yet
'429':
description: live lookup limit
x-codeSamples:
- lang: Shell
label: curl
source: curl -s 'https://crawlcheck.io/api/v1/agentic-web-map'
security: []
x-auth: public; no credential read
tags:
- Agentic Web Map
servers:
- url: https://crawlcheck.io
components:
securitySchemes:
licenceKey:
type: apiKey
in: header
name: x-crawlcheck-key
description: 'Your licence key: cc_ followed by 32 hex characters. Sent on every keyed call.'
bearer:
type: http
scheme: bearer
description: The same licence key as a Bearer token. Accepted on /api/v1/* and /api/usage.
externalDocs:
url: https://crawlcheck.io/docs/api
description: Human-readable reference
x-refined-from:
- crawlcheck-io-openapi.json
- crawlcheck-io-openapi.yml