Crawl Census · Rate Limits

Crawl Census Rate Limits

Crawl Census Rate Limits is the rate-limit profile for Crawl Census on the APIs.io network — every limit transcribed verbatim from the provider’s own documentation on 2026-11-04.

It captures 3 rate-limit definitions, including Unauthenticated read allowance (headline) — 60 / day unauthenticated limit; Unauthenticated read allowance (authentication section) — Every read endpoint works unauthenticated at 240 requests per hour per IP; Corpus dump — Not under /api/v1 and not rate limited, because it is a single cached object rather than a query..

Limit state is signalled in the ratelimit-limit, ratelimit-remaining, ratelimit-reset, and retry-after response headers.

Tagged areas include Company, AI Crawlers, Robots.txt, SEO, and Web Measurement.

3 Limits ratelimit-limitratelimit-remainingratelimit-resetretry-after
Transcribed from the provider's documentation on 2026-11-04 — crawlcensus.com/api.
View Source
CompanyAI CrawlersRobots.txtSEOWeb MeasurementOpen DataLlms.txtMCP

Limits

Unauthenticated read allowance (headline) per-ip
60 / day unauthenticated limit
· per day
Unauthenticated read allowance (authentication section) per-ip
Every read endpoint works unauthenticated at 240 requests per hour per IP
· per hour
Corpus dump endpoint
Not under /api/v1 and not rate limited, because it is a single cached object rather than a query.
GET /data.json

Work with this as data

Every rate limit here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for rate limits

4 MCP tools reach this
  • find_rate_limitsBrowse and filter every rate limit in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This rate limit 
curl "https://apis.io/api/v1/rate-limits/crawlcensus-com-rate-limits"
All rate limits 
curl "https://apis.io/api/v1/rate-limits?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.