Crawlbase

Crawlbase (formerly ProxyCrawl) is a web crawling and scraping platform that fetches any web page through a large rotating proxy network with optional headless-Chrome JavaScript rendering, returning raw HTML, Markdown, screenshots, or structured JSON. A single token-authenticated REST host (api.crawlbase.com) exposes the Crawling API, a Scraper API of ready-made site extractors, Cloud Storage for crawled pages, a Screenshots API, and a Leads API for domain email discovery.

Crawlbase publishes 5 APIs on the APIs.io network, including Crawling API API, Leads API API, Scraper API API, and 2 more. Tagged areas include Web Scraping, Web Crawling, Web Intelligence, Data Extraction, and Proxy.

Crawlbase’s developer surface includes authentication, documentation, engineering blog, and 8 more developer resources.

🌐 Visit website 📡 Source on GitHub

27.9/100 thin ▼ -10.0 Agent 20/100 agent aware Full breakdown ↓
scored 2026-08-25 · rubric v0.14.0

AccessFreemiumOpenFree trial⚡ Free to try

5 APIs

Web Scraping Web Crawling Web Intelligence Data Extraction Proxy Scraper API Data Collection SERP Web Data

Kin Score

Kin Score How this is scored →
scored 2026-08-25 · rubric v0.14.0

Composite quality — 27.9/100 · thin

Contract Quality 3.4 / 25

Developer Ergonomics 4.8 / 20

Access Clarity 7.9 / 20

Operational Transparency 4.4 / 13

Contract Governance 0.0 / 12

Discoverability 7.4 / 10

Agent readiness — 20/100 · agent aware

Machine-Readable Contract 18 / 18

Agentic Access Contract 10 / 10

Documented Reversibility 0 / 6

MCP Server 0 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 0 / 8

Request/Response Examples 0 / 7

Rate-Limit Signaling 7 / 7

Typed Event Surface 0 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Delegated User Identity 0 / 6

Protected Resource Metadata 0 / 5

Registration Without a Human 0 / 6

Agentic Commerce Surface 0 / 5

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/crawlbase: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

APIs 5

Individual APIs this provider publishes, each with its own machine-readable definition.

Rate Limits 1

Documented rate limits and quota policies.

Crawlbase Rate Limits

4 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Documentation 1

Reference material describing how the API behaves

Documentation

Documentation

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess

AgenticAccess

Build 1

SDKs, sample code, and the tooling you integrate with

GitHubOrganization

GitHubOrganization

Access & Security 2

Authentication, authorization, and security posture

DomainSecurity

DomainSecurity

Authentication

Authentication

Operate 1

Status, limits, changes, and where to get help

RateLimits

RateLimits

Commercial 2

Pricing, plans, and the legal terms of use

Plans

Plans

FinOps

FinOps

Company 3

The organization behind the API

LinkedIn

Website

Website

Blog

Blog

Source (apis.yml)

aid: crawlbase
url: https://raw.githubusercontent.com/api-evangelist/crawlbase/refs/heads/main/apis.yml
name: Crawlbase
kind: company
description: Crawlbase (formerly ProxyCrawl) is a web crawling and scraping platform that fetches any web page through a large
  rotating proxy network with optional headless-Chrome JavaScript rendering, returning raw HTML, Markdown, screenshots, or
  structured JSON. A single token-authenticated REST host (api.crawlbase.com) exposes the Crawling API, a Scraper API of ready-made
  site extractors, Cloud Storage for crawled pages, a Screenshots API, and a Leads API for domain email discovery.
accessModel:
  pricing: freemium
  onboarding: open
  trial: true
  try_now: true
  public: true
  label: Freemium (free trial) · Open access
  confidence: high
  source:
  - plans
  - authentication
  generated: '2026-07-22'
  method: derived
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/crawlbase.png
tags:
- Web Scraping
- Web Crawling
- Web Intelligence
- Data Extraction
- Proxy
- Scraper API
- Data Collection
- SERP
- Web Data
created: '2026-07-12'
modified: '2026-07-12'
specificationVersion: '0.23'
apis:
- aid: crawlbase:crawlbase-crawling-api-api
  name: Crawlbase Crawling API API
  description: Fetch any URL through the rotating proxy network, optionally rendered.
  humanURL: https://crawlbase.com/docs/crawling-api/
  baseURL: https://api.crawlbase.com
  tags:
  - Crawling API
  properties:
  - type: OpenAPI
    url: openapi/crawlbase-crawling-api-api-openapi.yml
  - type: Documentation
    url: https://crawlbase.com/docs/crawling-api/
  - type: APIReference
    url: https://crawlbase.com/docs/crawling-api/parameters/
  - type: PostmanCollection
    url: collections/crawlbase.postman_collection.json
  - type: OpenCollection
    url: collections/crawlbase.opencollection.json
  - type: Documentation
    url: https://crawlbase.com/docs/scraper-api/
  - type: Documentation
    url: https://crawlbase.com/docs/storage-api/
  - type: Documentation
    url: https://crawlbase.com/docs/screenshots-api/
  - type: Documentation
    url: https://crawlbase.com/docs/leads-api/
- aid: crawlbase:crawlbase-leads-api-api
  name: Crawlbase Leads API API
  description: Publicly visible email discovery for a domain (legacy).
  humanURL: https://crawlbase.com/docs/crawling-api/
  baseURL: https://api.crawlbase.com
  tags:
  - Leads API
  properties:
  - type: OpenAPI
    url: openapi/crawlbase-leads-api-api-openapi.yml
  - type: Documentation
    url: https://crawlbase.com/docs/crawling-api/
  - type: APIReference
    url: https://crawlbase.com/docs/crawling-api/parameters/
  - type: PostmanCollection
    url: collections/crawlbase.postman_collection.json
  - type: OpenCollection
    url: collections/crawlbase.opencollection.json
  - type: Documentation
    url: https://crawlbase.com/docs/scraper-api/
  - type: Documentation
    url: https://crawlbase.com/docs/storage-api/
  - type: Documentation
    url: https://crawlbase.com/docs/screenshots-api/
  - type: Documentation
    url: https://crawlbase.com/docs/leads-api/
- aid: crawlbase:crawlbase-scraper-api-api
  name: Crawlbase Scraper API API
  description: Ready-made structured-data extractors for supported sites (legacy).
  humanURL: https://crawlbase.com/docs/crawling-api/
  baseURL: https://api.crawlbase.com
  tags:
  - Scraper API
  properties:
  - type: OpenAPI
    url: openapi/crawlbase-scraper-api-api-openapi.yml
  - type: Documentation
    url: https://crawlbase.com/docs/crawling-api/
  - type: APIReference
    url: https://crawlbase.com/docs/crawling-api/parameters/
  - type: PostmanCollection
    url: collections/crawlbase.postman_collection.json
  - type: OpenCollection
    url: collections/crawlbase.opencollection.json
  - type: Documentation
    url: https://crawlbase.com/docs/scraper-api/
  - type: Documentation
    url: https://crawlbase.com/docs/storage-api/
  - type: Documentation
    url: https://crawlbase.com/docs/screenshots-api/
  - type: Documentation
    url: https://crawlbase.com/docs/leads-api/
- aid: crawlbase:crawlbase-screenshots-api-api
  name: Crawlbase Screenshots API API
  description: Rendered page screenshots in headless Chrome (legacy).
  humanURL: https://crawlbase.com/docs/crawling-api/
  baseURL: https://api.crawlbase.com
  tags:
  - Screenshots API
  properties:
  - type: OpenAPI
    url: openapi/crawlbase-screenshots-api-api-openapi.yml
  - type: Documentation
    url: https://crawlbase.com/docs/crawling-api/
  - type: APIReference
    url: https://crawlbase.com/docs/crawling-api/parameters/
  - type: PostmanCollection
    url: collections/crawlbase.postman_collection.json
  - type: OpenCollection
    url: collections/crawlbase.opencollection.json
  - type: Documentation
    url: https://crawlbase.com/docs/scraper-api/
  - type: Documentation
    url: https://crawlbase.com/docs/storage-api/
  - type: Documentation
    url: https://crawlbase.com/docs/screenshots-api/
  - type: Documentation
    url: https://crawlbase.com/docs/leads-api/
- aid: crawlbase:crawlbase-storage-api-api
  name: Crawlbase Storage API API
  description: Retrieve, list, and delete previously stored crawls.
  humanURL: https://crawlbase.com/docs/crawling-api/
  baseURL: https://api.crawlbase.com
  tags:
  - Storage API
  properties:
  - type: OpenAPI
    url: openapi/crawlbase-storage-api-api-openapi.yml
  - type: Documentation
    url: https://crawlbase.com/docs/crawling-api/
  - type: APIReference
    url: https://crawlbase.com/docs/crawling-api/parameters/
  - type: PostmanCollection
    url: collections/crawlbase.postman_collection.json
  - type: OpenCollection
    url: collections/crawlbase.opencollection.json
  - type: Documentation
    url: https://crawlbase.com/docs/scraper-api/
  - type: Documentation
    url: https://crawlbase.com/docs/storage-api/
  - type: Documentation
    url: https://crawlbase.com/docs/screenshots-api/
  - type: Documentation
    url: https://crawlbase.com/docs/leads-api/
common:
- type: AgenticAccess
  url: agentic-access/crawlbase-agentic-access.yml
- type: DomainSecurity
  url: security/crawlbase-domain-security.yml
- type: Authentication
  url: authentication/crawlbase-authentication.yml
- type: GitHubOrganization
  url: https://github.com/crawlbase
- type: LinkedIn
  url: https://www.linkedin.com/company/crawlbase
- type: Website
  url: https://crawlbase.com/
- type: Documentation
  url: https://crawlbase.com/docs
- type: Plans
  url: plans/crawlbase-plans-pricing.yml
- type: RateLimits
  url: rate-limits/crawlbase-rate-limits.yml
- type: FinOps
  url: finops/crawlbase-finops.yml
- url: https://crawlbase.com/blog
  type: Blog
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this

find_providersBrowse and filter every provider in the catalog.
get_provider_artifactsEvery artifact this provider publishes, grouped by type.
get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
get_provider_ratingPRO — composite, band, trend and facet scores.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools

Call it yourself

curl for this page

This provider

curl "https://apis.io/api/v1/providers/crawlbase"

All providers

curl "https://apis.io/api/v1/providers?limit=25"

Every operation they expose

curl "https://apis.io/api/v1/providers/crawlbase/operations?limit=25"

How their score was established

curl "https://apis.io/api/v1/providers/crawlbase/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.