Scrapfly · Rate Limits

Scrapfly Rate Limits

Scrapfly does not advertise per-second request limits. Throttling is enforced primarily through account-level concurrency caps (set by subscription tier) and credit-pool exhaustion. Per-domain throttling may also engage. The API surfaces concurrency and credit state in response headers, and returns 429 when concurrency, free quota, or domain throttling is hit.

Scrapfly Rate Limits is the machine-readable rate-limit profile for Scrapfly on the APIs.io network, conforming to the API Commons Rate Limits specification.

It captures 7 rate-limit definitions, measuring concurrent_requests and varies.

The profile also includes 4 backoff/retry policies defined and response codes documented for throttled and quotaExceeded.

Tagged areas include Web Scraping, Data Extraction, and Rate Limiting.

7 Limits Throttle: 429 Quota: 429
Web ScrapingData ExtractionRate Limiting

Limits

Free concurrency account
concurrent_requests
5
Applies to Free tier.
Discovery concurrency account
concurrent_requests
5
Applies to Discovery ($30/mo) tier.
Pro concurrency account
concurrent_requests
20
Applies to Pro ($100/mo) tier.
Startup concurrency account
concurrent_requests
50
Applies to Startup ($250/mo) tier.
Enterprise concurrency account
concurrent_requests
100
Applies to Enterprise ($500/mo) tier.
Custom concurrency account
concurrent_requests
negotiated
Custom plans negotiate concurrency above 100.
Per-domain throttling account/domain
varies
see Scrapfly throttling rules
Scrapfly may throttle a specific destination domain to protect target sites; surfaced as 429.

Policies

Concurrency-based throttling
Subscription tier sets the maximum simultaneously open scrape requests. Excess requests are rejected with 429 rather than queued.
Credit pool overflow
Free and Discovery plans hard-cap at the monthly credit quota. Pro and higher plans auto-bill overflow credits at tier-specific block rates ($1.20–$5.00 per 10,000 credits).
Backoff
On 429 responses clients should back off and retry, monitoring X-Scrapfly-Account-Remaining-Concurrent-Usage to gauge headroom.
Project-scoped limits
Concurrency can be sub-divided across Scrapfly Projects; project-level usage is reported via X-Scrapfly-Project-Concurrent-Usage.

Sources

Work with this as data

Every rate limit here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for rate limits

4 MCP tools reach this
  • find_rate_limitsBrowse and filter every rate limit in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools

Call it yourself

curl for this page
This rate limit 
curl "https://apis.io/api/v1/rate-limits/scrapfly-rate-limits"
All rate limits 
curl "https://apis.io/api/v1/rate-limits?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.