fastcrw-com · Schema

CrawlRequest

CompanyWeb ScrapingAI AgentsRustOpen SourceSERP

Properties

Name Type Description
url string
maxPages integer
maxDepth integer
headers object Custom HTTP request headers applied to every page the crawl fetches. On a browser render they apply to every request the page makes, subresources included, so avoid cross-origin-sensitive credentials
scrapeOptions object
formats array
onlyMainContent boolean
jsonSchema object
renderJs booleannull
waitFor integer
renderer string
country string 2-letter ISO 3166-1 alpha-2 proxy egress country.
proxyList array
proxyRotation string
View JSON Schema on GitHub

JSON Schema

fastcrw-com-crawl-request-schema.json Raw ↑
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "https://artifacts.apis.io/fastcrw-com/json-schema/fastcrw-com-crawl-request-schema.json",
  "title": "CrawlRequest",
  "x-generated": "2026-10-30",
  "x-method": "derived",
  "x-generator": "derive-json-schema.py",
  "x-source": "openapi/fastcrw-com-openapi.json#/components/schemas/CrawlRequest",
  "type": "object",
  "required": [
    "url"
  ],
  "properties": {
    "url": {
      "type": "string",
      "format": "uri"
    },
    "maxPages": {
      "type": "integer",
      "minimum": 1,
      "default": 100
    },
    "maxDepth": {
      "type": "integer",
      "minimum": 0,
      "default": 2
    },
    "headers": {
      "type": "object",
      "additionalProperties": {
        "type": "string"
      },
      "description": "Custom HTTP request headers applied to every page the crawl fetches. On a browser render they apply to every request the page makes, subresources included, so avoid cross-origin-sensitive credentials here."
    },
    "scrapeOptions": {
      "$ref": "#/$defs/CrawlScrapeOptions"
    },
    "formats": {
      "type": "array",
      "items": {
        "$ref": "#/$defs/CrawlOutputFormat"
      },
      "default": [
        "markdown"
      ]
    },
    "onlyMainContent": {
      "type": "boolean",
      "default": true
    },
    "jsonSchema": {
      "type": "object"
    },
    "renderJs": {
      "type": [
        "boolean",
        "null"
      ]
    },
    "waitFor": {
      "type": "integer",
      "minimum": 0
    },
    "renderer": {
      "type": "string",
      "enum": [
        "auto",
        "lightpanda",
        "chrome",
        "chrome_proxy",
        "playwright",
        "camoufox",
        "impersonated-http"
      ]
    },
    "country": {
      "type": "string",
      "description": "2-letter ISO 3166-1 alpha-2 proxy egress country."
    },
    "proxyList": {
      "type": "array",
      "items": {
        "type": "string"
      }
    },
    "proxyRotation": {
      "type": "string",
      "enum": [
        "round_robin",
        "random",
        "sticky_per_host"
      ]
    }
  },
  "$defs": {
    "CrawlOutputFormat": {
      "type": "string",
      "enum": [
        "markdown",
        "html",
        "rawHtml",
        "plainText",
        "links",
        "images",
        "json"
      ],
      "description": "The crawl path runs extraction and the optional LLM `json` pass. It does not produce `summary`, `screenshot` or inline `changeTracking`; use `/v1/scrape` for those."
    },
    "CrawlScrapeOptions": {
      "type": "object",
      "description": "Per-page scrape settings. Every key here may also be sent at the top level; an explicit top-level value wins.",
      "properties": {
        "formats": {
          "type": "array",
          "items": {
            "$ref": "#/$defs/CrawlOutputFormat"
          },
          "default": [
            "markdown"
          ]
        },
        "onlyMainContent": {
          "type": "boolean",
          "default": true
        },
        "jsonSchema": {
          "type": "object",
          "description": "JSON Schema for structured extraction, with `formats: [\"json\"]`."
        },
        "renderJs": {
          "type": [
            "boolean",
            "null"
          ],
          "description": "null = auto-detect, true = force JS, false = never use a browser tier."
        },
        "waitFor": {
          "type": "integer",
          "minimum": 0,
          "description": "Milliseconds to wait after JS rendering on each page."
        },
        "headers": {
          "type": "object",
          "additionalProperties": {
            "type": "string"
          },
          "description": "Custom HTTP request headers applied to every page the crawl fetches. On a browser render they apply to every request the page makes, subresources included, so avoid cross-origin-sensitive credentials here."
        }
      }
    }
  }
}

Work with this as data

Every JSON Schema here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for schemas

4 MCP tools reach this
  • find_json_schemasBrowse and filter every JSON Schema in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This JSON Schema
curl "https://apis.io/api/v1/json-schemas/fastcrw-com-crawl-request"
All schemas
curl "https://apis.io/api/v1/json-schemas?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.