established · 0.6 marketcapability domainschema

Web Scraping

Score 24.6 / 100 63 providers +2 via APIs 26 APIs Search apis.io →

Providers using this tag (63)

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 4 Complete, well-documented, and agent-ready
Browser UseAI AutomationBrowser AutomationWeb Agents6 APIs70.8Cracked APIAI AgentsAgent ToolsMCPTool Router2 APIs70.3Crawl4AIAI AutomationWeb CrawlingData Extraction1 API68.6Context.devBrand IntelligenceData EnrichmentAI Agents1 API67.2
Strong 20 Solid coverage with minor gaps
ValueSERPSERPSearch Engine ResultsGoogle SearchSearch API1 API66.2Virix LabsBrowser AutomationCloud BrowserAI AgentsA2A1 API65.7StructifyCompanyArtificial IntelligenceData1 API64.5WebCrawlerAPIWeb CrawlingData ExtractionMarkdown3 APIs64.5ChocodataData ExtractionSERPE-Commerce Data1 API61.7Abstract APIAvatarsCompany EnrichmentContactsCurrency13 APIs61.6GeekflareDevelopmentPublic APIsSearch1 API61.5Social FetchSocial MediaData ExtractionSocial Listening1 API61.2Amazon Scraper APIData ExtractionE-Commerce DataAmazon1 API60.9WebScraping.AIData ExtractionProxiesArtificial Intelligence1 API60.0PagesnapDeveloper Toolsweb-to-markdownscreenshot-api1 API58.5MERCURYCompanyAgentsA2AMCP2 APIs58.0APIFreaks - API Hub for DevelopersIP IntelligenceGeolocationWHOISDomain Intelligence104 APIs57.9ReefAPIWeb DataData AggregationSERP1 API57.7ZyteCrawlingData ExtractionScraping2 APIs57.3TrueProxiesProxiesResidential ProxiesDatacenter Proxies1 API56.5ZenserpSERPSearch Engine ResultsGoogle Search1 API56.0NimblewayCompanyWeb DataData Extraction1 API55.7BrowserbaseHeadless BrowserBrowser InfrastructureWeb AutomationAI Agents1 API55.2BrowserlessHeadless BrowserBrowser InfrastructureWeb AutomationAI Agents1 API54.9
Developing 16 Usable, with meaningful gaps to close
SearchApiSearchSERP APIGoogle Search3 APIs54.1Webz.ioNews DataWeb DataDark Web13 APIs54.0HyperbrowserHeadless BrowserBrowser InfrastructureWeb Crawling1 API52.3MCP360MCPMCP ServerMCP GatewayAI Agents38 APIs51.8ScrapingAntData ExtractionProxiesScraping2 APIs51.2The HogCompanyGTM IntelligenceSales IntelligenceData Enrichment1 API50.6Bright DataWeb DataProxyResidential Proxy10 APIs49.6OpenSERPCompanySearchSERPSearch API1 API49.3Automation Preflight APIAutomationIntegrationDeveloper ToolsReadiness2 APIs49.2TinyFishCompanyArtificial IntelligenceAI AgentsWeb Automation4 APIs46.5InterfazeCompanyArtificial IntelligenceMachine LearningLLM1 API46.1ScrapingBeeAI ExtractionAnti-BotData AggregationData Extraction1 API41.4SOAXProxyResidential ProxiesMobile Proxies1 API41.2ZenRowsData ExtractionAnti-BotProxies1 API40.9WarpPay402 Studiox402MicropaymentsAI AgentsMCP2 APIs40.5SnapAPIScreenshotsWebsite ScreenshotsMetadata ExtractionText Extraction1 API39.6
Thin 13 Limited public surface area
ThordataProxy NetworkData ExtractionSERP2 APIs38.2ApifyActorsBrowser AutomationCrawlingData Aggregation6 APIs37.0BardeenAI AutomationWorkflow AutomationData Enrichment1 API35.9ZenscrapeProxyHTMLData Extraction1 API35.7CrawlbaseWeb CrawlingWeb IntelligenceData Extraction1 API35.4AirtopBrowser AutomationAI AgentsCloud Browser1 API35.3ScrapflyArtificial IntelligenceData ExtractionScreenshots1 API34.6SmartproxyProxiesData CollectionResidential Proxies1 API31.5Import.ioData AggregationData ExtractionData IntegrationPricing Intelligence1 API31.1Snap APIscreenshot-apiDeveloper ToolsWeb Capturen8n1 API30.8AgentQLAgentsArtificial IntelligenceData Extraction5 APIs30.3SnapAPIScreenshotsPDFVideo1 API29.1LightpandaHeadless BrowserBrowser AutomationWebSocketAI Agents1 API27.6
Emerging 7 Early or largely undocumented
CheerioData ExtractionDOMHTMLHTML Parsing1 API23.7digiantnzCompanyA2AAgentsWeb Search1 API20.7RankFabrikDataLocal BusinessPlaces4 APIs20.5StrawberryCompanyArtificial IntelligenceAgentic BrowserAI Agents19.3Wynd NetworkCompanyDePINBandwidth18.2Beautiful SoupData ExtractionHTML ParsingPythonScraping1 API14.5FoodsparkDataFoodGroceriesMenus1 API12.8
Minimal 3 Almost no public developer surface
StableBrowseCompanyAI AgentsBrowser InfrastructureWeb Automation3.4DapperCompanyAdvertisingAdTech0.0Kimono LabsCompanyDeveloper ToolsData Extraction0.0

APIs with this tag (23)

Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →

Exemplar 1 Complete, well-documented, and agent-ready
Context.dev Web Scraping APIThe Web Scraping API from Context.dev — 7 operation(s) for web scraping.67.2
Strong 5 Solid coverage with minor gaps
WebCrawlerAPI MCP ServerOfficial Model Context Protocol server distributed as the npm package webcrawler-mcp (npx -y webcrawler-mcp...64.5WebScraping.AI MCP ServerHosted remote Model Context Protocol server exposing the same seven capabilities as tools to AI assistants....60.0MERCURY Web Fetch A2A AgentAgent-to-Agent (A2A 0.3.0) surface for "MERCURY Web Fetch", published as a conformant agent card at https:/...58.0ReefAPI MCP ServerHosted MCP server over streamable-HTTP with 5 discovery-first tools (search_engines, get_catalog, get_engin...57.7Monocrawl Web Scraping APIThe Web Scraping API from Monocrawl — 16 operation(s) for web scraping.57.2
Developing 7 Usable, with meaningful gaps to close
Webz.io APIToken-authenticated REST endpoints under https://api.webz.io covering seven products: News, Blogs and Forum...54.0Hyperbrowser Scrape APISingle-page and batch scrape jobs returning HTML, Markdown, links, and screenshots with asynchronous status...52.3MCP360 Web Scraping APIThe web-scraping API from MCP360 — 1 operation(s) for web-scraping.51.8ScrapingAntScrapingAnt is a web scraping API service that handles proxy rotation, headless browsers, and CAPTCHA solvi...51.2ScrapingAnt Scraping APIThe ScrapingAnt web scraping endpoint. GET/POST/PUT/PATCH/DELETE /v2/general renders a target URL in headle...51.2SOAX Web Data APIThe SOAX Web Data API extracts fully rendered HTML, screenshots, XHR responses, and structured data from an...41.2ZenRows Scraper APIsVertical, structured-data scraper endpoints for major commerce and real-estate sites, sharing the api.zenro...40.9
Thin 4 Limited public surface area
BardeenBardeen is an AI-powered automation platform for automating repetitive tasks across web applications.35.9Scrapfly Screenshot APICapture screenshots of web pages with full-page or element-specific capture using CSS selectors. Supports J...34.6SteadyAPIREST/JSON API providing stock market, options, crypto, real estate, sports, e-commerce, social media, trave...32.3Snap APIREST/HTTP screenshot and rendering API. GET /v1/take (alias /v1/render) captures screenshots and PDFs; /v1/...30.8
Emerging 6 Early or largely undocumented
a2a-browser A2A AgentPay-per-search web agent (version 0.1.0-alpha) served from a2a-browser.digiant.nz: a JSON-RPC 2.0 POST endp...20.7CaptionsTimestamped/segmented video transcript retrieval, up to 50 videos per call. Billed per transcript returned.20.5JobsJob posting collection that segments by publish window/area to exceed the public 1,000-result cap. Billed p...20.5PlacesLocal business data collection via geo point + radius sweep with deduplication on place ID; optional email ...20.5VerifyEmail verification via syntax, disposable-domain, MX and SMTP dialogue checks (no message sent), up to 100 ...20.5Beautiful SoupBeautiful Soup 4 is a Python library providing a parse tree API for HTML and XML documents. It exposes Tag,...14.5

Companies reaching this through an API (2)

These companies publish an API, specification or operation carrying “Web Scraping” but do not classify their business under it. Listed unranked and kept out of the count above, because one tagged operation is not a statement about what a company does.

Monocrawl SteadyAPI

Score breakdown

Frequency
53.1
log-scaled weighted occurrences
Breadth
1.6
spread across providers
Quality lift
54.4
mean composite of providers using it
Cohesion
0.0
strength of nearest seed neighbor

Related tags

Data Extraction 28 co-occurrences SERP 12 co-occurrences Web Data 11 co-occurrences Proxies 11 co-occurrences Browser Automation 12 co-occurrences Headless Browser 8 co-occurrences Screenshots 10 co-occurrences Web Crawling 6 co-occurrences

Where this tag comes from

Provider tag63
Api tag26
Openapi tag1
Openapi op tag2

Cohort brief

Auto-generated

The 61 providers in the APIs.io catalog tagged Web Scraping, scored on the Kin Score. Every figure below is computed from the catalog — nothing here is written.

Providers
61
all scored
Mean Kin Score
45.8
+22.9 vs catalog 22.9
Mean Agent Readiness
32
+20.1 vs catalog 11.9
Spread
3.4–70.8
median 49.6 · σ 16.2
How the 61 split by band
Exemplar 4Strong 20Developing 16Thin 13Emerging 7Minimal 1
Facet averages, against the whole catalog
FacetThis cohortCatalogDifferenceScored
Access Clarity 56.8 26.5 +30.3 61
Developer Ergonomics 51.3 23.2 +28.1 61
Contract Quality 41 17.6 +23.4 61
Operational Transparency 36.9 13.7 +23.2 61
Discoverability 70.2 58.1 +12.1 61
Contract Governance 12.8 6.3 +6.5 61

A facet is averaged over the members that carry it, not over the whole cohort — the “Scored” column is that count. Averaging an absent facet as zero would score our own coverage gaps as the providers’ posture.

What this cohort publishes
ArtifactThis cohortCatalogDifference
MCP server (any) 54% 14% +40
MCP server (first-party) 51% 12% +39
Agent Skills 0% 0% 0
OAuth scopes 15% 11% +4
Security 98% 98% 0
Arazzo workflows 7% 2% +5
Governance rules 28% 14% +14

mcp_pct counts any mcp/ artifact including ones API Evangelist derived from the provider OpenAPI; mcp_first_party_pct counts only servers the provider publishes. Prefer the latter.

Top by Kin Score
  1. 1 Browser Use 70.8
  2. 2 Cracked API 70.3
  3. 3 Crawl4AI 68.6
  4. 4 Context.dev 67.2
  5. 5 ValueSERP 66.2
  6. 6 Virix Labs 65.7
  7. 7 Structify 64.5
  8. 8 WebCrawlerAPI 64.5
  9. 9 Chocodata 61.7
  10. 10 Abstract API 61.6
Top by Agent Readiness
  1. 1 Cracked API 68.5
  2. 2 The Hog 65.5
  3. 3 WebScraping.AI 65
  4. 4 SearchApi 60.2
  5. 5 Browser Use 59.6
  6. 6 Nimbleway 58
  7. 7 Social Fetch 56.2
  8. 8 Virix Labs 53.8
  9. 9 Apify 52.9
  10. 10 Context.dev 51.4
All 63 members of this roster resolve to a scored provider in the catalog.Generated from the catalog build of 5 October 2026, across 29093 providers, using the same computation served by the APIs.io cohort API. Briefs are published for rosters of 5 or more scored providers; below that a distribution is not meaningful.

Work with this as data

Every tag here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for tags

7 MCP tools reach this
  • find_tagsBrowse and filter every tag in the catalog.
  • get_cohortThis tag as a scored cohort — every provider carrying it, with scores.
  • cohort_statsPRO — the distribution across this tag: mean, median, band split, adoption rates.
  • cohort_rankingsPRO — the leaderboard, on composite AND agent-readiness axes.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This tag 
curl "https://apis.io/api/v1/tags/web-scraping"
All tags 
curl "https://apis.io/api/v1/tags?limit=25"
As a scored cohort 
curl "https://apis.io/api/v1/cohorts/tag/web-scraping"
The distribution (Pro) 
curl "https://apis.io/api/v1/cohorts/tag/web-scraping/stats" \
  -H "X-API-Key: $APIS_IO_KEY"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.