Spider · Rate Limits

Spider Cloud Rate Limits

Rate limit definitions for the Spider Cloud API. Every account is permitted up to 10,000 core API requests per minute by default. Spider's hosted MCP server inherits the same per-account API limit. Browser-automation sessions are constrained to five concurrent sessions and time out after five minutes of inactivity. Enterprise accounts can negotiate higher limits.

Spider Cloud Rate Limits is the machine-readable rate-limit profile for Spider on the APIs.io network, conforming to the API Commons Rate Limits specification.

It captures 4 rate-limit definitions, across the default and enterprise tiers, measuring requests_per_minute, concurrent_sessions, and idle_minutes.

The profile also includes 5 backoff/retry policies defined and response codes documented for throttled, quotaExceeded, and serviceUnavailable.

Tagged areas include Crawling, Scraping, Data Extraction, URLs, and AI.

4 Limits Throttle: 429 Quota: 429
CrawlingScrapingData ExtractionURLsAIRate LimitingQuotasThrottling

Limits

Default Core API RPM account
requests_per_minute · minute
10000
Browser Session Concurrency account
concurrent_sessions · instant
5
Browser Session Idle Timeout session
idle_minutes · minute
5
Negotiated Enterprise Limit contract
requests_per_minute · minute
-1

Policies

Backoff Strategy
Clients should implement exponential backoff with jitter on 429 responses, honoring the Retry-After header when present.
Failed Requests Are Free
Spider's billing model does not charge for failed responses — only successful responses that return data — which complements rate limit recovery.
Browser Session Lifecycle
Browser-automation sessions are limited to five concurrent sessions per account and are automatically closed after five minutes of inactivity.
Enterprise Negotiation
Accounts needing more than 10,000 RPM should contact sales for custom rate limit provisioning.
Robots.txt
Crawling honors robots.txt by default; clients can opt out but should respect target-site policies and fair-use norms.