Crawl4AI · Rate Limits

Crawl4Ai Rate Limits

Published Crawl4AI rate limits and the runtime headers the API returns. Limits are enforced on two axes at once — a per-minute request rate and a monthly per-capability quota (search and scrape have separate buckets) — plus a storage allowance surfaced in its own headers.

Crawl4Ai Rate Limits is the machine-readable rate-limit profile for Crawl4AI on the APIs.io network, in the API Commons Rate Limits shape.

It captures 8 rate-limit definitions, across the free, pro, community, and supporter tiers, measuring requests_per_minute, requests_per_day, searches_per_month, and scrapes_per_month.

Limit state is signalled in the limit, remaining, reset, and storage_used response headers, and an exhausted limit returns HTTP 429.

The profile also includes 3 backoff/retry policies defined and response codes documented for throttled, quotaExceeded, serviceUnavailable, and gatewayTimeout.

Tagged areas include AI Automation, Web Crawling, Rate Limiting, and Quotas.

8 Limits Exhausted: HTTP 429 Quota: 429 limitremainingresetstorage_used
Transcribed from the provider's documentation on 2026-08-29 — gate.crawl4ai.com/ (#pricing), gate.crawl4ai.com/llms.txt....
View Source
AI AutomationWeb CrawlingRate LimitingQuotas

Limits

Free per-minute request rate api-key
requests_per_minute · minute
10
Free daily crawl limit api-key
requests_per_day · day
100
Pro per-minute request rate api-key
requests_per_minute · minute
100
Pro daily crawl limit api-key
requests_per_day · day
10000
Community monthly web search quota account
searches_per_month · month
5000
Community monthly scrape quota account
scrapes_per_month · month
1000
Supporter monthly web search quota account
searches_per_month · month
30000
Supporter monthly scrape quota account
scrapes_per_month · month
5000

Policies

Retry on exhaustion
Published guidance: on 429 wait X-RateLimit-Reset seconds then retry; on 503 retry after 5s up to 3 attempts; on 5xx retry once after 2s.
Fair use
"Fair use: each plan has request/concurrency limits (see the dashboard); over-limit calls get 429." Concurrency limits are per-plan and published only inside the authenticated dashboard.
Self-hosted caps
The self-hosted Docker server caps request body size, per-crawl wall clock, job-queue size and per-principal concurrency since 0.9.0; all are operator- configurable and 0 means unbounded.

Work with this as data

Every rate limit here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for rate limits

4 MCP tools reach this
  • find_rate_limitsBrowse and filter every rate limit in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This rate limit 
curl "https://apis.io/api/v1/rate-limits/crawl4ai-rate-limits"
All rate limits 
curl "https://apis.io/api/v1/rate-limits?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.