Bright Data Scrape API

Trigger and monitor asynchronous scraping jobs.

Operations 3

POST /datasets/v3/scrape Trigger a Web Scraper Job #
GET /datasets/v3/progress/{snapshot_id} Get Scrape Progress #
GET /datasets List Available Datasets #

Documentation

Specifications

Schemas & Data

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API
curl "https://apis.io/api/v1/apis/bright-data-scrape-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

bright-data-scrape-api-openapi.yml Raw ↑
openapi: 3.2.0
info:
  title: Bright Data Web Scraper Scrape API
  description: 'Bright Data''s Web Scraper API exposes asynchronous scraping jobs (snapshots) backed by 660+

    pre-built dataset endpoints plus custom collectors. Trigger a scrape, poll progress, list snapshots,

    cancel or rerun, and download results in JSON, NDJSON, CSV, or JSONL — optionally compressed.

    Snapshots can be pushed to S3, Azure Blob, GCS, Snowflake, or a webhook.


    Authentication uses a Bearer API token issued from the Bright Data control panel.

    '
  version: v3
  contact:
    name: Bright Data
    url: https://docs.brightdata.com
  license:
    name: Bright Data API Terms of Service
    url: https://brightdata.com/legal/tos
servers:
- url: https://api.brightdata.com
  description: Production
security:
- BearerAuth: []
tags:
- name: Scrape
  description: Trigger and monitor asynchronous scraping jobs.
paths:
  /datasets/v3/scrape:
    post:
      summary: Trigger a Web Scraper Job
      description: 'Trigger an asynchronous scraping job against a Bright Data dataset. Pass the `dataset_id` of

        the target collector and the per-record input payload as a JSON array. Returns a `snapshot_id`

        used to poll progress and download results.

        '
      operationId: triggerScrape
      tags:
      - Scrape
      parameters:
      - name: dataset_id
        in: query
        required: true
        schema:
          type: string
        description: Bright Data dataset identifier (e.g. `gd_l1viktl72bvl7bjuj0`).
      - name: include_errors
        in: query
        schema:
          type: boolean
      - name: notify
        in: query
        schema:
          type: string
          format: uri
        description: Webhook URL Bright Data calls when the snapshot completes.
      - name: format
        in: query
        schema:
          type: string
          enum:
          - json
          - ndjson
          - csv
          - jsonl
      - name: limit_per_input
        in: query
        schema:
          type: integer
      - name: limit_multiple_results
        in: query
        schema:
          type: integer
      requestBody:
        required: true
        content:
          application/json:
            schema:
              type: array
              items:
                type: object
                additionalProperties: true
      responses:
        '200':
          description: Job submitted.
          content:
            application/json:
              schema:
                type: object
                properties:
                  snapshot_id:
                    type: string
  /datasets/v3/progress/{snapshot_id}:
    parameters:
    - name: snapshot_id
      in: path
      required: true
      schema:
        type: string
    get:
      summary: Get Scrape Progress
      operationId: getScrapeProgress
      tags:
      - Scrape
      responses:
        '200':
          description: Progress.
          content:
            application/json:
              schema:
                type: object
                properties:
                  status:
                    type: string
                    enum:
                    - running
                    - ready
                    - failed
                    - building
                    - collecting
                    - cancelled
                  records:
                    type: integer
                  errors:
                    type: integer
  /datasets:
    get:
      summary: List Available Datasets
      operationId: listDatasets
      tags:
      - Scrape
      responses:
        '200':
          description: List of datasets the caller is entitled to query.
          content:
            application/json:
              schema:
                type: array
                items:
                  type: object
                  properties:
                    id:
                      type: string
                    name:
                      type: string
                    description:
                      type: string
components:
  securitySchemes:
    BearerAuth:
      type: http
      scheme: bearer