CrawlCheck Rights Feed API
The Rights Feed API from CrawlCheck — 2 operation(s) for rights feed.
Work with this as data
Every API here is available over the APIs.io API and to AI agents over MCP.
MCP server
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
Tools for apis
7 MCP tools reach this
find_apisBrowse and filter every API in the catalog.get_api_artifactsOne API's artifacts, grouped by type.get_openapiThe primary OpenAPI for this API.find_similar_apisAPIs that look like this one.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.
Call it yourself
curl for this page
This API
curl "https://apis.io/api/v1/apis/crawlcheck-io:crawlcheck-io-rights-feed-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.
Get an API key
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.
OpenAPI Specification
openapi: 3.2.0
info:
title: Crawlcheck Io Rights Feed API
version: '1'
contact:
name: CrawlCheck
url: https://crawlcheck.io/policy
email: hello@crawlcheck.io
license:
name: Terms
url: https://crawlcheck.io/policy
x-core-contract:
promise: 'These operations are the core contract. They stay at /api/v1 and keep answering for at least 180 days after any /api/v2 is announced; their stable fields change only in a new major version, and their provisional fields only after 30 days'' notice, per /docs/api/compatibility. Verifying what they return needs none of these calls: crawlcheck-verify.mjs checks a document on your machine against the published keys (/.well-known/http-message-signatures-directory) and the rotation record, read once with --online or saved for --keys. Everything else documented here is useful but secondary, and may change with the notice its fields'' tags promise.'
operations:
- method: GET
path: /api/v1/resolve
operationId: resolveDomainV1
- method: POST
path: /api/v1/resolve
operationId: resolveBatchV1
- method: POST
path: /api/v1/preflight
operationId: preflightV1
- method: GET
path: /api/v1/decisions/{sha256}
operationId: decisionCheckV1
- method: GET
path: /api/v1/revocations
operationId: revocations
- method: GET
path: /api/v1/visitor
operationId: visitorResolveV1
- method: POST
path: /api/v1/visitor
operationId: visitorResolveBatchV1
- method: GET
path: /api/v1/mcp/scan
operationId: mcpScanUrl
- method: POST
path: /api/v1/mcp/lock/check
operationId: mcpLockCheck
list: https://crawlcheck.io/api/v1/core
description: 'Operations tagged Rights Feed across 2 of this provider''s published API definitions: crawlcheck-io-openapi.json, crawlcheck-io-openapi.yml. Each path carries the servers of the definition it was published in.'
servers:
- url: https://crawlcheck.io
tags:
- name: Rights Feed
paths:
/api/v1/rights-feed:
get:
operationId: rightsFeedIndex
summary: 'Rights feed for crawler operators: the index of signed weekly editions covering…'
responses:
'200':
description: crawlcheck-rights-feed-index
content:
application/json:
examples:
worked:
value:
kind: crawlcheck-rights-feed-index
v: 1
generated_at: '2026-10-08T12:00:00.000Z'
spec: https://crawlcheck.io/spec/rights-feed
license: CC BY 4.0 (sample edition)
latest:
id: rf-2026-10-07-3fa1c2
sites: 9712
parts: 10
finished_at: '2026-10-08T11:17:00.000Z'
totals:
train:
denied: 2410
not_declared: 5980
restricted_by_terms: 611
unknown: 702
allowed: 9
manifest: https://crawlcheck.io/api/v1/rights-feed/rf-2026-10-07-3fa1c2/manifest.json
manifest_sha256: …
in_progress: null
editions: []
schema:
type:
- object
- 'null'
properties:
kind:
type:
- string
- 'null'
v:
type:
- number
- 'null'
generated_at:
type:
- string
- 'null'
spec:
type:
- string
- 'null'
license:
type:
- string
- 'null'
latest:
type:
- object
- 'null'
properties:
id:
type:
- string
- 'null'
sites:
type:
- number
- 'null'
parts:
type:
- number
- 'null'
finished_at:
type:
- string
- 'null'
totals:
type:
- object
- 'null'
properties:
train:
type:
- object
- 'null'
properties:
denied:
type:
- number
- 'null'
not_declared:
type:
- number
- 'null'
restricted_by_terms:
type:
- number
- 'null'
unknown:
type:
- number
- 'null'
allowed:
type:
- number
- 'null'
additionalProperties: true
additionalProperties: true
manifest:
type:
- string
- 'null'
manifest_sha256: {}
additionalProperties: true
in_progress: {}
editions:
type:
- array
- 'null'
items: {}
additionalProperties: true
x-schema-source: worked-example
x-codeSamples:
- lang: Shell
label: curl
source: curl -s 'https://crawlcheck.io/api/v1/rights-feed'
security: []
x-auth: public; no credential read
tags:
- Rights Feed
servers:
- url: https://crawlcheck.io
/api/v1/rights-feed/{id}/{file}:
get:
operationId: rightsFeedFile
summary: 'One file of a finished rights-feed edition: manifest.json (signed…'
parameters:
- name: id
in: path
required: true
schema:
type: string
- name: file
in: path
required: true
schema:
type: string
responses:
'200':
description: manifest or gzip part
content:
application/gzip:
examples:
worked:
value:
kind: crawlcheck-rights
v: 1
domain: example.com
rank: 412
read_at: '2026-10-07T07:02:11.000Z'
robots:
url: https://example.com/robots.txt
status: 200
readable: true
groups:
- agents:
- gptbot
allow: []
disallow:
- /
- agents:
- '*'
allow: []
disallow:
- /admin/
content_signal:
- 'Content-Signal: search=yes, ai-train=no'
page:
url: https://example.com/
status: 200
meta_robots: null
x_robots_tag: null
tdm: null
ai_txt: null
terms:
url: https://example.com/terms
status: 200
ai_clauses:
- You may not use the Content to train any artificial intelligence model without our prior written consent.
uses_at_root:
train:
value: denied
signal: Content-Signal
evidence: 'Content-Signal: search=yes, ai-train=no'
conflicts: 0
closed_to:
- GPTBot
cite:
value: allowed
signal: Content-Signal
evidence: 'Content-Signal: search=yes, ai-train=no'
conflicts: 0
sha256: …
signature: …
schema:
type: string
x-schema-source: worked-example
'404':
description: no such edition or file
x-codeSamples:
- lang: Shell
label: curl
source: curl -s 'https://crawlcheck.io/api/v1/rights-feed/rf-2026-10-07-3fa1c2/part-0001.ndjson.gz' | gunzip | head -1
security: []
x-auth: public; no credential read
tags:
- Rights Feed
servers:
- url: https://crawlcheck.io
components:
securitySchemes:
licenceKey:
type: apiKey
in: header
name: x-crawlcheck-key
description: 'Your licence key: cc_ followed by 32 hex characters. Sent on every keyed call.'
bearer:
type: http
scheme: bearer
description: The same licence key as a Bearer token. Accepted on /api/v1/* and /api/usage.
externalDocs:
url: https://crawlcheck.io/docs/api
description: Human-readable reference
x-refined-from:
- crawlcheck-io-openapi.json
- crawlcheck-io-openapi.yml