Crawlbase

Crawlbase (formerly ProxyCrawl) is a web crawling and scraping platform that fetches any web page through a large rotating proxy network with optional headless-Chrome JavaScript rendering, returning raw HTML, Markdown, screenshots, or structured JSON. A single token-authenticated REST host (api.crawlbase.com) exposes the Crawling API, a Scraper API of ready-made site extractors, Cloud Storage for crawled pages, a Screenshots API, and a Leads API for domain email discovery.

Crawlbase publishes 5 APIs on the APIs.io network, including Crawling API API, Leads API API, Scraper API API, and 2 more. Tagged areas include Web Scraping, Web Crawling, Web Intelligence, Data Extraction, and Proxy.

Crawlbase’s developer surface includes authentication, documentation, engineering blog, and 8 more developer resources.

🌐 Visit website 📡 Source on GitHub

39.7/100 thin ▬ flat Agent 31/100 agent aware Full breakdown ↓
scored 2026-08-05 · rubric v0.9.1

AccessFreemiumOpenFree trial⚡ Free to try

5 APIs

Web ScrapingWeb CrawlingWeb IntelligenceData ExtractionProxyScraper APIData CollectionSERPWeb Data

Kin Score

Kin Score How this is scored →
scored 2026-08-05 · rubric v0.9.1

Composite quality — 39.7/100 · thin

Contract Quality 15.3 / 25

Developer Ergonomics 4.3 / 20

Commercial Clarity 7.9 / 20

Operational Transparency 4.8 / 13

Governance 0.0 / 12

Discoverability 7.4 / 10

Agent readiness — 31/100 · agent aware

Machine-Readable Contract 18 / 18

Agentic Access Contract 10 / 10

MCP Server 0 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 0 / 8

Request/Response Examples 0 / 7

Rate-Limit Signaling 7 / 7

Typed Event Surface 0 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/crawlbase: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

APIs 5

Individual APIs this provider publishes, each with its own machine-readable definition.

Rate Limits 1

Documented rate limits and quota policies.

Crawlbase Rate Limits

4 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Documentation 1

Reference material describing how the API behaves

Documentation

Documentation

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess

AgenticAccess

Build 1

SDKs, sample code, and the tooling you integrate with

GitHubOrganization

GitHubOrganization

Access & Security 2

Authentication, authorization, and security posture

DomainSecurity

DomainSecurity

Authentication

Authentication

Operate 1

Status, limits, changes, and where to get help

RateLimits

RateLimits

Commercial 2

Pricing, plans, and the legal terms of use

Plans

Plans

FinOps

FinOps

Company 3

The organization behind the API

LinkedIn

Website

Website

Blog

Blog

Source (apis.yml)

aid: crawlbase
url: https://raw.githubusercontent.com/api-evangelist/crawlbase/refs/heads/main/apis.yml
name: Crawlbase
kind: company
description: Crawlbase (formerly ProxyCrawl) is a web crawling and scraping platform that fetches any web page through a large
  rotating proxy network with optional headless-Chrome JavaScript rendering, returning raw HTML, Markdown, screenshots, or
  structured JSON. A single token-authenticated REST host (api.crawlbase.com) exposes the Crawling API, a Scraper API of ready-made
  site extractors, Cloud Storage for crawled pages, a Screenshots API, and a Leads API for domain email discovery.
accessModel:
  pricing: freemium
  onboarding: open
  trial: true
  try_now: true
  public: true
  label: Freemium (free trial) · Open access
  confidence: high
  source:
  - plans
  - authentication
  generated: '2026-07-22'
  method: derived
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/crawlbase.png
tags:
- Web Scraping
- Web Crawling
- Web Intelligence
- Data Extraction
- Proxy
- Scraper API
- Data Collection
- SERP
- Web Data
created: '2026-07-12'
modified: '2026-07-12'
specificationVersion: '0.19'
apis:
- aid: crawlbase:crawlbase-crawling-api-api
  name: Crawlbase Crawling API API
  description: Fetch any URL through the rotating proxy network, optionally rendered.
  humanURL: https://crawlbase.com/docs/crawling-api/
  baseURL: https://api.crawlbase.com
  tags:
  - Crawling API
  properties:
  - type: OpenAPI
    url: openapi/crawlbase-crawling-api-api-openapi.yml
  - type: Documentation
    url: https://crawlbase.com/docs/crawling-api/
  - type: APIReference
    url: https://crawlbase.com/docs/crawling-api/parameters/
  - type: PostmanCollection
    url: collections/crawlbase.postman_collection.json
  - type: OpenCollection
    url: collections/crawlbase.opencollection.json
  - type: Documentation
    url: https://crawlbase.com/docs/scraper-api/
  - type: Documentation
    url: https://crawlbase.com/docs/storage-api/
  - type: Documentation
    url: https://crawlbase.com/docs/screenshots-api/
  - type: Documentation
    url: https://crawlbase.com/docs/leads-api/
- aid: crawlbase:crawlbase-leads-api-api
  name: Crawlbase Leads API API
  description: Publicly visible email discovery for a domain (legacy).
  humanURL: https://crawlbase.com/docs/crawling-api/
  baseURL: https://api.crawlbase.com
  tags:
  - Leads API
  properties:
  - type: OpenAPI
    url: openapi/crawlbase-leads-api-api-openapi.yml
  - type: Documentation
    url: https://crawlbase.com/docs/crawling-api/
  - type: APIReference
    url: https://crawlbase.com/docs/crawling-api/parameters/
  - type: PostmanCollection
    url: collections/crawlbase.postman_collection.json
  - type: OpenCollection
    url: collections/crawlbase.opencollection.json
  - type: Documentation
    url: https://crawlbase.com/docs/scraper-api/
  - type: Documentation
    url: https://crawlbase.com/docs/storage-api/
  - type: Documentation
    url: https://crawlbase.com/docs/screenshots-api/
  - type: Documentation
    url: https://crawlbase.com/docs/leads-api/
- aid: crawlbase:crawlbase-scraper-api-api
  name: Crawlbase Scraper API API
  description: Ready-made structured-data extractors for supported sites (legacy).
  humanURL: https://crawlbase.com/docs/crawling-api/
  baseURL: https://api.crawlbase.com
  tags:
  - Scraper API
  properties:
  - type: OpenAPI
    url: openapi/crawlbase-scraper-api-api-openapi.yml
  - type: Documentation
    url: https://crawlbase.com/docs/crawling-api/
  - type: APIReference
    url: https://crawlbase.com/docs/crawling-api/parameters/
  - type: PostmanCollection
    url: collections/crawlbase.postman_collection.json
  - type: OpenCollection
    url: collections/crawlbase.opencollection.json
  - type: Documentation
    url: https://crawlbase.com/docs/scraper-api/
  - type: Documentation
    url: https://crawlbase.com/docs/storage-api/
  - type: Documentation
    url: https://crawlbase.com/docs/screenshots-api/
  - type: Documentation
    url: https://crawlbase.com/docs/leads-api/
- aid: crawlbase:crawlbase-screenshots-api-api
  name: Crawlbase Screenshots API API
  description: Rendered page screenshots in headless Chrome (legacy).
  humanURL: https://crawlbase.com/docs/crawling-api/
  baseURL: https://api.crawlbase.com
  tags:
  - Screenshots API
  properties:
  - type: OpenAPI
    url: openapi/crawlbase-screenshots-api-api-openapi.yml
  - type: Documentation
    url: https://crawlbase.com/docs/crawling-api/
  - type: APIReference
    url: https://crawlbase.com/docs/crawling-api/parameters/
  - type: PostmanCollection
    url: collections/crawlbase.postman_collection.json
  - type: OpenCollection
    url: collections/crawlbase.opencollection.json
  - type: Documentation
    url: https://crawlbase.com/docs/scraper-api/
  - type: Documentation
    url: https://crawlbase.com/docs/storage-api/
  - type: Documentation
    url: https://crawlbase.com/docs/screenshots-api/
  - type: Documentation
    url: https://crawlbase.com/docs/leads-api/
- aid: crawlbase:crawlbase-storage-api-api
  name: Crawlbase Storage API API
  description: Retrieve, list, and delete previously stored crawls.
  humanURL: https://crawlbase.com/docs/crawling-api/
  baseURL: https://api.crawlbase.com
  tags:
  - Storage API
  properties:
  - type: OpenAPI
    url: openapi/crawlbase-storage-api-api-openapi.yml
  - type: Documentation
    url: https://crawlbase.com/docs/crawling-api/
  - type: APIReference
    url: https://crawlbase.com/docs/crawling-api/parameters/
  - type: PostmanCollection
    url: collections/crawlbase.postman_collection.json
  - type: OpenCollection
    url: collections/crawlbase.opencollection.json
  - type: Documentation
    url: https://crawlbase.com/docs/scraper-api/
  - type: Documentation
    url: https://crawlbase.com/docs/storage-api/
  - type: Documentation
    url: https://crawlbase.com/docs/screenshots-api/
  - type: Documentation
    url: https://crawlbase.com/docs/leads-api/
common:
- type: AgenticAccess
  url: agentic-access/crawlbase-agentic-access.yml
- type: DomainSecurity
  url: security/crawlbase-domain-security.yml
- type: Authentication
  url: authentication/crawlbase-authentication.yml
- type: GitHubOrganization
  url: https://github.com/crawlbase
- type: LinkedIn
  url: https://www.linkedin.com/company/crawlbase
- type: Website
  url: https://crawlbase.com/
- type: Documentation
  url: https://crawlbase.com/docs
- type: Plans
  url: plans/crawlbase-plans-pricing.yml
- type: RateLimits
  url: rate-limits/crawlbase-rate-limits.yml
- type: FinOps
  url: finops/crawlbase-finops.yml
- url: https://crawlbase.com/blog
  type: Blog
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com

Crawlbase

Kin Score

APIs 5

Crawlbase Crawling API API

Crawlbase Leads API API

Crawlbase Scraper API API

Crawlbase Screenshots API API

Crawlbase Storage API API

Open Collections 1

Crawlbase API

Pricing Plans 1

Crawlbase Plans Pricing

Rate Limits 1

Crawlbase Rate Limits

FinOps 1

Crawlbase Finops

Security Posture 2

Crawlbase Authentication

Crawlbase Domain Security

Agentic Access 1

Crawlbase Agentic Access

Resources