emerging · -0.7 marketcapability domainschema

Web Scraping

Score 23.9 / 100 87 providers +8 via APIs 48 APIs Search apis.io →
Variants seen in the corpus: ScrapingData ScrapingWeb Scraping

Providers using this tag (87)

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 8 Complete, well-documented, and agent-ready
DiffbotExtractionHarvestingWeb9 APIs73.8MrScraperCompanyData ExtractionProxies2 APIs71.3cloroCompanySearchArtificial Intelligence1 API74.6Search1APICompanySearchWeb SearchCrawling1 API71.0Cracked APIAI AgentsAgent ToolsMCPTool Router1 API69.9Context.devBrand IntelligenceData EnrichmentAI Agents1 API67.7Crawl4AIAI AutomationWeb CrawlingData Extraction1 API67.1StructifyCompanyArtificial IntelligenceData1 API66.6
Strong 21 Solid coverage with minor gaps
WebCrawlerAPIWeb CrawlingData ExtractionMarkdown3 APIs64.6ChocodataData ExtractionSERPE-Commerce Data1 API61.8GeekflareDevelopmentPublic APIsSearch1 API61.6WebScraping.AIData ExtractionProxiesArtificial Intelligence1 API60.0ZyteCrawlingData ExtractionProxies2 APIs55.8Virix LabsBrowser AutomationCloud BrowserAI AgentsA2A1 API66.1ValueSERPSERPSearch Engine ResultsGoogle SearchSEO1 API64.9KonbiniAPISocial MediaInstagramTikTokX2 APIs63.5Abstract APIAvatarsCompany EnrichmentContactsCurrency13 APIs61.7Social FetchSocial MediaData ExtractionSocial Listening1 API61.3Amazon Scraper APIData ExtractionE-Commerce DataAmazon1 API61.0SerpWowSearchSERPWeb Data1 API60.7MERCURYCompanyAgentsA2AMCP1 API58.6PagesnapDeveloper Toolsweb-to-markdownScreenshots1 API58.6APIFreaks - API Hub for DevelopersIP IntelligenceGeolocationWHOISDomain Intelligence104 APIs58.4ReefAPIWeb DataData AggregationSERP1 API57.8NimblewayCompanyWeb DataData Extraction1 API55.7TrueProxiesProxiesResidential ProxiesDatacenter Proxies1 API55.0SerperSearchSERPGoogle SearchArtificial Intelligence2 APIs54.8SearchApiSearchSERPGoogle Search3 APIs54.6ZenserpSERPSearch Engine ResultsGoogle Search1 API54.4
Developing 20 Usable, with meaningful gaps to close
ScrapingAntData ExtractionProxiesBrowser Automation2 APIs49.7HyperbrowserBrowser AutomationBrowser InfrastructureWeb Crawling1 API46.3Ziddecsocial-media-dataAnalytics1 API41.6FirecrawlCrawlingData ExtractionURLs1 API41.5ScrapingBeeAI ExtractionAnti-BotData AggregationData Extraction1 API39.9Webz.ioNews DataWeb DataDark Web13 APIs54.0LitescrapeCompanySERPSearch1 API53.1InterfazeCompanyArtificial IntelligenceMachine LearningLLM1 API52.1MCP360MCPMCP ServerMCP GatewayAI Agents38 APIs51.8BrowserbaseBrowser AutomationBrowser InfrastructureAI Agents1 API50.9OxylabsAI Web ScrapingBot Mitigation BypassCAPTCHA SolvingData Extraction1 API50.6The HogCompanyGTM IntelligenceSales IntelligenceData Enrichment1 API50.6Automation Preflight APIAutomationIntegrationDeveloper ToolsReadiness2 APIs49.3OpenSERPCompanySearchSERP1 API49.3TinyFishCompanyArtificial IntelligenceAI AgentsBrowser Automation4 APIs46.6Bright DataWeb DataProxyResidential Proxy10 APIs45.8shveikCompanyAI Agentsx4025 APIs45.0WarpPay402 Studiox402MicropaymentsAI AgentsMCP2 APIs40.6SOAXProxyResidential ProxiesMobile Proxies1 API39.7ScavioCompanyDataArtificial Intelligence2 APIs39.4
Thin 20 Limited public surface area
AgentQLAgentsArtificial IntelligenceData Extraction1 API38.9YepAPISEOSERPAI Models5 APIs37.7ApifyActorsBrowser AutomationCrawlingData Aggregation6 APIs36.9APRYCOCompanyMarketplaceData2 APIs35.6OctoparseHarvesting1 API35.1BardeenAI AutomationWorkflow AutomationData Enrichment1 API34.4ZenRowsData ExtractionAnti-BotProxies1 API33.6ScrapflyArtificial IntelligenceData ExtractionScreenshots1 API33.1SpiderCrawlingData ExtractionURLs1 API31.9RapidProxy (RAPID TERMINAL UK NETWORK LIMITED)ProxyResidentialData Collection1 API31.3SmartproxyProxiesData CollectionResidential Proxies1 API30.2FrostbyteDeveloper ToolsUtility APIsGeolocationCryptocurrency7 APIs29.7ZenscrapeProxyHTMLData Extraction1 API27.5CrawlbaseWeb CrawlingWeb IntelligenceData Extraction1 API27.1CrawleeApache 2.0ApifyBrowser AutomationCrawlers2 APIs26.8ThordataProxy NetworkData ExtractionSERP2 APIs38.2NotteArtificial IntelligenceWeb AgentsBrowser AutomationSessions1 API32.9SnapAPIScreenshotsWebsite ScreenshotsMetadata ExtractionText Extraction1 API31.3Snap APIScreenshotsDeveloper ToolsWeb Capturen8n1 API30.9SnapAPIScreenshotsPDFVideo1 API29.2
Emerging 12 Early or largely undocumented
NubelaCompaniesDataPeople4 APIs24.0ScraperAPIData ExtractionProxies1 API23.8CheerioData ExtractionDOMHTMLHTML Parsing1 API22.1ParseHubData ExtractionVisual Scraping1 API21.1Beautiful SoupData ExtractionHTML ParsingPython1 API13.0SteelBrowserBrowser AutomationAI Agents1 API25.9LightpandaBrowser AutomationWebSocketAI Agents1 API22.9digiantnzCompanyA2AAgentsWeb Search1 API20.8RankFabrikDataLocal BusinessPlaces4 APIs20.6StrawberryCompanyArtificial IntelligenceAgentic BrowserAI Agents19.4Wynd NetworkCompanyDePINBandwidth18.2FoodsparkDataFoodGroceriesMenus1 API11.3
Minimal 6 Almost no public developer surface
PuppeteerBrowser Automation1 API9.8ScrapingData ExtractionProxy NetworkSERP API9.6ScrapyCrawlingData Extraction1 API10.5StableBrowseCompanyAI AgentsBrowser InfrastructureBrowser Automation3.9DapperCompanyAdvertisingAdTech0.0Kimono LabsCompanyDeveloper ToolsData Extraction0.0

APIs with this tag (48)

Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →

Exemplar 5 Complete, well-documented, and agent-ready
Diffbot Crawl APIDiffbot Crawl API is a powerful tool that automates the process of extracting content and data from website...73.8Diffbot Crawl/Bulk Job APIThe Diffbot Crawl/Bulk Job API is a powerful tool that allows users to automatically extract and organize l...73.8Diffbot Extract APIDiffbot Extract API is a powerful tool that allows users to automatically extract multiple types of data fr...73.8Diffbot Natural Language APIDiffbot Natural Language API allows users to extract and analyze textual content from websites. By utilizin...73.8Context.dev Web Scraping APIThe Web Scraping API from Context.dev — 7 operation(s) for web scraping.67.7
Strong 7 Solid coverage with minor gaps
WebCrawlerAPI MCP ServerOfficial Model Context Protocol server distributed as the npm package webcrawler-mcp (npx -y webcrawler-mcp...64.6Clay Chrome ExtensionBrowser extension for scraping LinkedIn profiles and other web pages directly into Clay Tables, used to boo...64.1APIVerve Data Scraping APIThe Data Scraping API from APIVerve — 5 operation(s) for data scraping.60.9WebScraping.AI MCP ServerHosted remote Model Context Protocol server exposing the same seven capabilities as tools to AI assistants....60.0MERCURY Web Fetch A2A AgentAgent-to-Agent (A2A 0.3.0) surface for "MERCURY Web Fetch", published as a conformant agent card at https:/...58.6ReefAPI MCP ServerHosted MCP server over streamable-HTTP with 5 discovery-first tools (search_engines, get_catalog, get_engin...57.8Monocrawl Web Scraping APIThe Web Scraping API from Monocrawl — 16 operation(s) for web scraping.57.3
Developing 11 Usable, with meaningful gaps to close
Webz.io APIToken-authenticated REST endpoints under https://api.webz.io covering seven products: News, Blogs and Forum...54.0MCP360 Web Scraping APIThe web-scraping API from MCP360 — 1 operation(s) for web-scraping.51.8ScrapingAntScrapingAnt is a web scraping API service that handles proxy rotation, headless browsers, and CAPTCHA solvi...49.7ScrapingAnt MCP ServerFirst-party hosted remote MCP server at https://api.scrapingant.com/mcp/ exposing get_web_page_html, get_we...49.7ScrapingAnt Scraping APIThe ScrapingAnt web scraping endpoint. GET/POST/PUT/PATCH/DELETE /v2/general renders a target URL in headle...49.7Zoca Scraping APIThe Scraping API from Zoca — 6 operation(s) for scraping.47.8Hyperbrowser Scrape APISingle-page and batch scrape jobs returning HTML, Markdown, links, and screenshots with asynchronous status...46.3Bright Data Scraping Browser (Browser API) CDP WebSocketBright Data's Scraping Browser / Browser API: a cloud headless-browser fleet that speaks the Chrome DevTool...45.8shveik Scraping APISynchronous data retrieval; each request completes in the HTTP response.45.0Firecrawl Scraping APIThe Scraping API from Firecrawl — 6 operation(s) for scraping.41.5SOAX Web Data APIThe SOAX Web Data API extracts fully rendered HTML, screenshots, XHR responses, and structured data from an...39.7
Thin 12 Limited public surface area
Prometheus Exposition Format / OpenMetricsThe text-based exposition format that every instrumented target exposes (typically on /metrics) and that th...35.4BardeenBardeen is an AI-powered automation platform for automating repetitive tasks across web applications.34.4ZenRows Scraper APIsVertical, structured-data scraper endpoints for major commerce and real-estate sites, sharing the api.zenro...33.6Scrapfly Scraping APIThe Scraping API from Scrapfly — 1 operation(s) for scraping.33.1Scrapfly Screenshot APICapture screenshots of web pages with full-page or element-specific capture using CSS selectors. Supports J...33.1Notte Scraping APIOne-shot scraping of a URL or raw HTML, plus AI web search.32.9SteadyAPIREST/JSON API providing stock market, options, crypto, real estate, sports, e-commerce, social media, trave...32.8Spider Cloud MCP ServerSpider's hosted Model Context Protocol server exposes 22 tools — eight core operations (crawl, scrape, sear...31.9Spider Scraping APIExtract content from individual web pages.31.9Snap APIREST/HTTP screenshot and rendering API. GET /v1/take (alias /v1/render) captures screenshots and PDFs; /v1/...30.9Crawlee JavaScript SDKThe Crawlee JavaScript SDK is a Node.js/TypeScript library for building reliable web scrapers and crawlers....26.8Crawlee Python SDKThe Crawlee Python SDK is a Python library for building reliable web scrapers and crawlers. It offers Basic...26.8
Emerging 11 Early or largely undocumented
ScraperAPIScraperAPI is a web scraping API that manages proxies, browsers, and CAPTCHAs to extract HTML from any web ...23.8DataDome Bot ProtectBot Protect is DataDome's core bot management product, scoring every request against the platform's threat ...22.9CheerioCheerio implements a subset of core jQuery designed for the server. It parses markup into a traversable, ma...22.1a2a-browser A2A AgentPay-per-search web agent (version 0.1.0-alpha) served from a2a-browser.digiant.nz: a JSON-RPC 2.0 POST endp...20.8CaptionsTimestamped/segmented video transcript retrieval, up to 50 videos per call. Billed per transcript returned.20.6JobsJob posting collection that segments by publish window/area to exceed the public 1,000-result cap. Billed p...20.6PlacesLocal business data collection via geo point + radius sweep with deduplication on place ID; optional email ...20.6VerifyEmail verification via syntax, disposable-domain, MX and SMTP dialogue checks (no message sent), up to 100 ...20.6HUMAN Bot DefenderBot Defender (formerly PerimeterX Bot Defender) is HUMAN's flagship product for stopping automated traffic ...13.7HUMAN Scraper ProtectionScraper Protection targets large-scale content scraping by automated agents, including LLM training scraper...13.7Beautiful SoupBeautiful Soup 4 is a Python library providing a parse tree API for HTML and XML documents. It exposes Tag,...13.0
Minimal 2 Almost no public developer surface
ScrapyScrapy is an open-source Python web crawling framework for extracting structured data from websites using s...10.5PuppeteerPuppeteer is a Node.js library providing a high-level API to control headless Chrome or Chromium browsers f...9.8

Companies reaching this through an API (8)

These companies publish an API, specification or operation carrying “Web Scraping” but do not classify their business under it. Listed unranked and kept out of the count above, because one tagged operation is not a statement about what a company does.

APIVerve Clay DataDome HUMAN Security Monocrawl Prometheus SteadyAPI Zoca

Score breakdown

Frequency
58.1
log-scaled weighted occurrences
Breadth
2.0
spread across providers
Quality lift
44.4
mean composite of providers using it
Cohesion
0.0
strength of nearest seed neighbor

Where this tag sits

Data Extraction broader

Related tags

Data Extraction 41 co-occurrences SERP 21 co-occurrences Browser Automation 23 co-occurrences Proxies 16 co-occurrences Web Data 14 co-occurrences Screenshots 13 co-occurrences Residential Proxies 8 co-occurrences Web Crawling 7 co-occurrences

Where this tag comes from

Provider tag92
Api tag48
Openapi tag7
Openapi op tag20

Markets provisional

Kin Score markets whose measured providers carry this tag. Share is the fraction of the market's measured providers that carry it — it describes the market, not this tag.

MarketShare of the market's providers
News and Media22%

Cohort brief

Auto-generated

The 85 providers in the APIs.io catalog tagged Web Scraping, scored on the Kin Score. Every figure below is computed from the catalog — nothing here is written.

Providers
85
of 87 in the catalog
Mean Kin Score
43.3
+21.1 vs catalog 22.2
Mean Agent Readiness
31.5
+19.5 vs catalog 12
Spread
3.9–74.6
median 45 · σ 17.6
How the 85 split by band
Exemplar 8Strong 21Developing 20Thin 20Emerging 12Minimal 4
Facet averages, against the whole catalog
FacetThis cohortCatalogDifferenceScored
Developer Ergonomics 51.1 23.2 +27.9 85
Access Clarity 48.9 23.9 +25 85
Contract Quality 40.4 17.2 +23.2 85
Operational Transparency 32.8 13 +19.8 85
Discoverability 68.3 57.9 +10.4 85
Contract Governance 12.4 6.5 +5.9 85

A facet is averaged over the members that carry it, not over the whole cohort — the “Scored” column is that count. Averaging an absent facet as zero would score our own coverage gaps as the providers’ posture.

What this cohort publishes
ArtifactThis cohortCatalogDifference
MCP server (any) 51% 13% +38
MCP server (first-party) 49% 12% +37
Agent Skills 0% 0% 0
OAuth scopes 14% 11% +3
Security 98% 98% 0
Arazzo workflows 5% 2% +3
Governance rules 33% 16% +17

mcp_pct counts any mcp/ artifact including ones API Evangelist derived from the provider OpenAPI; mcp_first_party_pct counts only servers the provider publishes. Prefer the latter.

Top by Kin Score
  1. 1 cloro 74.6
  2. 2 Diffbot 73.8
  3. 3 MrScraper 71.3
  4. 4 Search1API 71
  5. 5 Cracked API 69.9
  6. 6 Context.dev 67.7
  7. 7 Crawl4AI 67.1
  8. 8 Structify 66.6
  9. 9 Virix Labs 66.1
  10. 10 ValueSERP 64.9
Top by Agent Readiness
  1. 1 Cracked API 69.2
  2. 2 cloro 67
  3. 3 The Hog 65.6
  4. 4 WebScraping.AI 63.3
  5. 5 SearchApi 60.2
  6. 6 Virix Labs 59.7
  7. 7 Nimbleway 58.6
  8. 8 Context.dev 57.8
  9. 9 Search1API 57.6
  10. 10 Social Fetch 57.1
All 87 members of this roster resolve to a provider in the catalog; 85 carry a score (98%). The figures above describe the scored members only.
Coverage caveat. 47 of 85 scored members had under half their catalog-attributable points satisfied at all (catalog_earned / catalog_max < 0.5). They are INCLUDED in the mean above. A large share here means the cohort mean is partly a measurement of how far our enrichment reached, not only of how these providers publish.Generated from the catalog build of 24 October 2026, across 31984 providers, using the same computation served by the APIs.io cohort API. Briefs are published for rosters of 5 or more scored providers; below that a distribution is not meaningful.

Work with this as data

Every tag here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for tags

7 MCP tools reach this
  • find_tagsBrowse and filter every tag in the catalog.
  • get_cohortThis tag as a scored cohort — every provider carrying it, with scores.
  • cohort_statsPRO — the distribution across this tag: mean, median, band split, adoption rates.
  • cohort_rankingsPRO — the leaderboard, on composite AND agent-readiness axes.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This tag 
curl "https://apis.io/api/v1/tags/web-scraping"
All tags 
curl "https://apis.io/api/v1/tags?limit=25"
As a scored cohort 
curl "https://apis.io/api/v1/cohorts/tag/web-scraping"
The distribution (Pro) 
curl "https://apis.io/api/v1/cohorts/tag/web-scraping/stats" \
  -H "X-API-Key: $APIS_IO_KEY"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.