fastcrw-com

fastcrw-com Map API

URL discovery without full scraping

Documentation GitHub OpenAPI

Operations 1

POST /v1/map Discover URLs on a site #

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this

find_apisBrowse and filter every API in the catalog.
get_api_artifactsOne API's artifacts, grouped by type.
get_openapiThe primary OpenAPI for this API.
find_similar_apisAPIs that look like this one.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This API

curl "https://apis.io/api/v1/apis/fastcrw-com:fastcrw-com-map-api"

All apis

curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

openapi: 3.2.0
info:
  title: CRW REST Map API
  version: 0.39.1
  description: Firecrawl-compatible web scraping, crawling, mapping, search, and extraction API. Hosted at https://api.fastcrw.com; self-host with `docker run -p 3000:3000 ghcr.io/fastcrw/crw:latest`.
  license:
    name: AGPL-3.0
    url: https://opensource.org/licenses/AGPL-3.0
  contact:
    url: https://github.com/fastcrw/crw
servers:
- url: https://api.fastcrw.com
  description: Hosted (requires Bearer token)
- url: http://localhost:3000
  description: Self-hosted (no auth by default)
security:
- bearerAuth: []
- {}
tags:
- name: Map
  description: URL discovery without full scraping
paths:
  /v1/map:
    post:
      tags:
      - Map
      summary: Discover URLs on a site
      operationId: map
      requestBody:
        required: true
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/MapRequest'
      responses:
        '200':
          description: List of URLs
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/MapResponse'
components:
  schemas:
    MapResponse:
      type: object
      required:
      - success
      - data
      properties:
        success:
          type: boolean
        data:
          type: object
          required:
          - links
          properties:
            links:
              type: array
              items:
                type: string
                format: uri
            droppedActionCount:
              type: integer
            strippedTrackingCount:
              type: integer
            sitemaps:
              description: Sitemap documents discovered and parsed while mapping the site (e.g. /sitemap.xml, /sitemap_index.xml). Not included in links, because a sitemap file is not a page.
              type: array
              items:
                type: string
                format: uri
    MapRequest:
      type: object
      required:
      - url
      properties:
        url:
          type: string
          format: uri
        maxDepth:
          type: integer
          minimum: 0
          description: Maximum link-follow depth from the start URL
        useSitemap:
          type: boolean
          default: true
          description: Fetch and parse sitemap.xml first
        crawlFallback:
          type: boolean
          default: true
          description: Fall back to BFS crawl when sitemap is missing or sparse
        timeout:
          type: integer
          description: 'Custom timeout in seconds (default: 120)'
  securitySchemes:
    bearerAuth:
      type: http
      scheme: bearer
      bearerFormat: API key
      description: Hosted only. Get a key at https://fastcrw.com/register.