Context.dev

Context.dev Web Scraping API

The Web Scraping API from Context.dev — 7 operation(s) for web scraping.

GitHub OpenAPI

Operations 4

Each operation below carries the questions people ask an LLM about it and the instructions they give an agent to run it. Generated by API Evangelist overlay

POST /web/scrape Scrape Anything #
GET /web/urls Map URLs #
POST /web/crawl Crawl a site and scrape many pages to Markdown · Crawl a website #
Ask an LLM
“Can I crawl a whole docs site from one starting URL and get every page back as Markdown?”
“What's the maximum number of pages a multi-page crawl will scrape?”
Tell an agent
Crawl starting at {url} and return every page as Markdown.
Crawl {url} up to {maxPages} pages and depth {maxDepth}, scraping each to Markdown.
POST /web/search Search the web and optionally scrape results · Search the web #
Ask an LLM
“Can I run a web search and get each result scraped into Markdown in one call?”
“Is it possible to limit web search results to certain domains or recent content?”
Tell an agent
Search the web for {query}.
Search for {query} only on {includeDomains} published within {freshness}.

Documentation

📖
APIReference
https://docs.context.dev
📖
Documentation
https://docs.context.dev/introduction

Specifications

⚙
OpenAPI
https://artifacts.apis.io/contextdev/openapi/contextdev-web-scraping-api-openapi.yml

Other Resources

🔗
Webhooks
https://artifacts.apis.io/contextdev/asyncapi/contextdev-webhooks.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/contextdev:contextdev-web-scraping-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

contextdev-web-scraping-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Context.dev Web Scraping API
  description: Scrape, crawl, search, and monitor websites, and retrieve brand, people, and news data.
  version: 1.0.0
servers:
- url: https://api.context.dev/v1
tags:


# --- truncated at 32 KB (156 KB total) ---
# Full source: https://artifacts.apis.io/contextdev/openapi/contextdev-web-scraping-api-openapi.yml