Fireworks AI · Rate Limits

Fireworks Ai Rate Limits

Fireworks AI publishes high serverless rate limits that scale with paid spend, expressed primarily as RPM (requests per minute) per model, with separate limits for batch jobs and fine-tuning. On-demand dedicated deployments are bounded by provisioned GPU capacity rather than shared serverless limits.

Fireworks Ai Rate Limits is the machine-readable rate-limit profile for Fireworks AI on the APIs.io network, conforming to the API Commons Rate Limits specification.

It captures 6 rate-limit definitions, measuring requests, concurrent, tokens, jobs, and concurrent_jobs.

The profile also includes 2 backoff/retry policies defined and response codes documented for throttled.

Tagged areas include AI, LLM, Inference, Multimodal, and Fine-tuning.

6 Limits Throttle: 429
AILLMInferenceMultimodalFine-tuningRate LimitingQuotasThrottling

Limits

Requests Per Minute (RPM) account
requests
see provider documentation
Per-model RPM, varies by tier and model.
Concurrent Requests account
concurrent
see provider documentation
Concurrency cap per model on serverless.
Tokens Per Minute (TPM) account
tokens
see provider documentation
Per-model TPM, varies by tier and model.
Batch Inference account
jobs
separate from sync limits
Batch runs at 50% discount and does not consume sync RPM/TPM directly.
Fine-Tuning Jobs account
concurrent_jobs
see provider documentation
Concurrency cap on parallel fine-tuning jobs.
On-Demand Deployments deployment
requests
bounded by provisioned GPU capacity
Throughput determined by GPU sizing and autoscaling configuration.

Policies

Tiered Limits
Limits scale up automatically with paid postpaid usage and via Enterprise agreements.
Backoff Strategy
Clients should implement exponential backoff with jitter and honor Retry-After.

Sources

Work with this as data

Every rate limit here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for rate limits

4 MCP tools reach this
  • find_rate_limitsBrowse and filter every rate limit in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools

Call it yourself

curl for this page
This rate limit 
curl "https://apis.io/api/v1/rate-limits/fireworks-ai-rate-limits"
All rate limits 
curl "https://apis.io/api/v1/rate-limits?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.