Crawl4AI

Crawl4AI Crawl API

The Crawl API from Crawl4AI — 2 operation(s) for crawl.

GitHub OpenAPI

Operations 2

Each operation below carries the questions people ask an LLM about it and the instructions they give an agent to run it. Generated by API Evangelist overlay

POST /crawl/job Start a crawl job for a list of URLs · Submit Crawl Job #
Ask an LLM
“How do I kick off a Crawl4AI job to scrape a batch of web pages?”
“Can I submit several URLs in one crawl request instead of one at a time?”
Tell an agent
Start a new crawl job for {urls}.
Submit these pages to be crawled and scraped: {urls}.
GET /crawl/job/{jobId} Check a crawl job's status and results · Get Crawl Job Status #
Ask an LLM
“Is my crawl job finished yet, and where do I get the scraped results?”
“What status is a crawl job in after I've submitted it?”
Tell an agent
Check the status of crawl job {jobId}.
Get the results of crawl job {jobId} if it has finished.

Specifications

⚙
OpenAPI
https://raw.githubusercontent.com/api-evangelist/crawl4ai/refs/heads/main/openapi/crawl4ai-crawl-api-openapi.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/crawl4ai:crawl4ai-crawl-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

crawl4ai-crawl-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  version: 1.0.0
  title: Crawl4AI Crawl API
  description: AI-powered web scraping and crawling API
tags:
- name: Crawl
paths:
  /crawl/job:
    post:
      summary: Submit Crawl Job
      description: Submit a new web crawling job
      operationId: submitCrawlJob
      x-zuplo-route:
        corsPolicy: none
        handler:
          export: default
          module: $import(./modules/backend-proxy)
        policies:
          inbound:
          - api-key-auth
          - quota-enforcement
          - rate-limit
          outbound:
          - add-rate-limit-headers
          - quota-headers
          - billing-track
      requestBody:
        required: true
        content:
          application/json:
            schema:
              type: object
              properties:
                urls:
                  type: array
                  items:
                    type: string
                  description: List of URLs to crawl
              required:
              - urls
      responses:
        '200':
          description: Job submitted successfully
        '401':
          description: Unauthorized - Invalid API key
        '429':
          description: Rate limit exceeded
      tags:
      - Crawl
  /crawl/job/{jobId}:
    get:
      summary: Get Crawl Job Status
      description: Get the status and results of a crawl job
      operationId: getCrawlJob
      x-zuplo-route:
        corsPolicy: none
        handler:
          export: default
          module: $import(./modules/backend-proxy)
        policies:
          inbound:
          - api-key-auth
          - quota-enforcement
          - rate-limit
          outbound:
          - add-rate-limit-headers
          - quota-headers
          - billing-track
      parameters:
      - name: jobId
        in: path
        required: true
        schema:
          type: string
        description: Job ID
      responses:
        '200':
          description: Job status and results
        '401':
          description: Unauthorized - Invalid API key
        '404':
          description: Job not found
      tags:
      - Crawl