AI Crawler Index · Rate Limits

Pathwren Rate Limits

Pathwren Rate Limits is the machine-readable rate-limit profile for AI Crawler Index on the APIs.io network, conforming to the API Commons Rate Limits specification.

Tagged areas include AI crawlers, web crawlers, robots.txt, user agents, and bot detection.

0 Limits
AI crawlersweb crawlersrobots.txtuser agentsbot detectionGPTBotClaudeBotcrawler IP rangesllms.txtopen data

Work with this as data

Every rate limit here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for rate limits

4 MCP tools reach this
  • find_rate_limitsBrowse and filter every rate limit in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This rate limit 
curl "https://apis.io/api/v1/rate-limits/pathwren-rate-limits"
All rate limits 
curl "https://apis.io/api/v1/rate-limits?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.