Nvidia · Rate Limits

Nvidia Rate Limits

NVIDIA's developer API surface is multi-product. build.nvidia.com hosted NIM endpoints have per-account / per-API-key rate limits and free-credit budgets that rotate by promotion; specific RPM/TPM numbers are not consistently published. Self-hosted NIM (via AI Enterprise license) has no NVIDIA-side rate limits — throughput is bounded by the customer's GPU hardware. NGC downloads are throttled per-IP by the catalog CDN.

Nvidia Rate Limits is the machine-readable rate-limit profile for Nvidia on the APIs.io network, conforming to the API Commons Rate Limits specification.

It captures 3 rate-limit definitions, measuring varies and requests_per_second.

The profile also includes 4 backoff/retry policies defined and response codes documented for unauthorized, forbidden, throttled, and serviceUnavailable.

Tagged areas include GPU, AI, Machine Learning, Computing, and Graphics.

3 Limits Throttle: 429
GPUAIMachine LearningComputingGraphicsRate Limiting

Limits

build.nvidia.com hosted endpoints api-key
varies
per-key throttle and free-credit budget; specific RPM/TPM not publicly documented
Self-hosted NIM (AI Enterprise) cluster
requests_per_second
bounded by customer GPU hardware; no NVIDIA-imposed rate limit
NGC Catalog downloads IP
varies
CDN-throttled per-IP; not numerically published

Policies

API key required
All hosted NIM endpoints (build.nvidia.com, integrate.api.nvidia.com) require an NVIDIA developer API key passed via Authorization Bearer header.
Backoff
Implement exponential backoff with jitter on 429 responses. Honor Retry-After when present.
Free-credit exhaustion
When free-trial credits on build.nvidia.com are exhausted, requests return an authorization error rather than a throttle; obtain an AI Enterprise license or cloud-marketplace credentials for production.
Self-host for high throughput
For sustained high-throughput inference, deploy NIM containers on customer GPU infrastructure under AI Enterprise rather than calling hosted endpoints.

Sources

Work with this as data

Every rate limit here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for rate limits

4 MCP tools reach this
  • find_rate_limitsBrowse and filter every rate limit in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools

Call it yourself

curl for this page
This rate limit 
curl "https://apis.io/api/v1/rate-limits/nvidia-rate-limits"
All rate limits 
curl "https://apis.io/api/v1/rate-limits?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.