spicrawl-com

spicrawl-com Batch API

Scrape many URLs as one asynchronous job.

GitHub OpenAPI

Operations 9

POST /v1/batch Submit a batch job #
GET /v1/batch List batch jobs #
GET /v1/batch/{batchID} Get a batch job and its progress #
GET /v1/batch/{batchID}/results Page through a job's finished items (JSONL) #
GET /v1/batch/{batchID}/tasks/{seq}/content Get one item's payload #
POST /v1/batch/{batchID}/cancel Cancel a batch job #
POST /v1/batch/{batchID}/retry Re-run a job's failed items #
POST /v1/batch/{batchID}/items Append items to an open job #
POST /v1/batch/{batchID}/close Stop an open job accepting items #

Specifications

⚙
OpenAPI
https://artifacts.apis.io/spicrawl-com/openapi/spicrawl-com-batch-api-openapi.yml

Schemas & Data

📊
JSONSchema
https://artifacts.apis.io/spicrawl-com/json-schema/spicrawl-com-scrape-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/spicrawl-com/json-schema/spicrawl-com-batch-job-schema.json
📊
JSONSchema
https://artifacts.apis.io/spicrawl-com/json-schema/spicrawl-com-batch-result-line-schema.json
📊
JSONSchema
https://artifacts.apis.io/spicrawl-com/json-schema/spicrawl-com-batch-create-request-schema.json
📊
JSONSchema
https://artifacts.apis.io/spicrawl-com/json-schema/spicrawl-com-session-schema.json
📊
JSONSchema
https://artifacts.apis.io/spicrawl-com/json-schema/spicrawl-com-session-create-request-schema.json

Other Resources

🔗
APIsJSON
https://artifacts.apis.io/spicrawl-com/apis.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/spicrawl-com:spicrawl-com-batch-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

spicrawl-com-batch-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Spicrawl Com Batch API
  version: 1.0.0
  contact:
    name: Spicrawl support
    url: https://docs.spicrawl.com
  description: 'Operations tagged Batch across 2 of this provider''s published API definitions: spicrawl-openapi.yaml, spicrawl-com-openapi.yaml. Each path carries the servers of the definition it was published in.'
servers:
- url: https://api.spicrawl.com
  description: Production
- url: http://localhost:8080
  description: Local development
security:
- bearerAuth: []
tags:


# --- truncated at 32 KB (112 KB total) ---
# Full source: https://artifacts.apis.io/spicrawl-com/openapi/spicrawl-com-batch-api-openapi.yml