emerging · -1.3 capabilitymarket actiondomainresource

Web Scraping

Score 23.9 / 100 133 providers +10 via APIs 55 APIs Search apis.io →
Variants seen in the corpus: ScrapingData ScrapingWeb Scraping

Providers using this tag (133)

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 11 Complete, well-documented, and agent-ready
DiffbotExtractionHarvestingWeb9 APIs76.3SerpApiBingGoogleSearchSearch Engines10 APIs74.3MrScraperCompanyData ExtractionProxies2 APIs70.4ZyteCrawlingData ExtractionProxies2 APIs67.0Cloro Incorporation Ltd.CompanySearchArtificial Intelligence3 APIs77.4Search1APICompanySearchWeb SearchCrawling1 API73.0Browser UseAI AutomationBrowser AutomationWeb Agents1 API71.1Context.devBrand IntelligenceData EnrichmentAI Agents1 API70.4Crawl4AIAI AutomationWeb CrawlingData Extraction1 API69.6Cracked APIAI AgentsAgent ToolsMCPTool Router1 API68.6Social FetchSocial MediaData ExtractionSocial Listening1 API67.6
Strong 36 Solid coverage with minor gaps
WebCrawlerAPIWeb CrawlingData ExtractionMarkdown3 APIs65.8AnyAPIDeveloper ToolsDataSearch1 API65.0GeekflareDevelopmentPublic APIsSearch1 API64.8ChocodataData ExtractionSERPE-Commerce Data1 API64.0fastcrw-comCompanyAI AgentsRust1 API63.9finedata-aiCompanyArtificial IntelligenceData Extraction1 API63.5StringData ExtractionMarkdownJSON3 APIs61.0WebScraping.AIData ExtractionProxiesArtificial Intelligence1 API60.9stophy-devCompanyAI AgentsSERP1 API54.3NimblewayCompanyWeb DataData Extraction1 API64.3KonbiniAPISocial MediaInstagramTikTokX2 APIs64.1Amazon Scraper APIData ExtractionE-Commerce DataAmazon1 API63.6SerpWowSearchSERPWeb Data1 API63.0spicrawl-comCompanyData ExtractionAutomation1 API62.7MERCURYCompanyAgentsA2AMCP1 API62.3ValueSERPSERPSearch Engine ResultsGoogle SearchSEO1 API62.3APIFreaks - API Hub for DevelopersIP IntelligenceGeolocationWHOISDomain Intelligence104 APIs61.6Abstract APIAvatarsCompany EnrichmentContactsCurrency13 APIs61.4StructifyCompanyArtificial IntelligenceData1 API61.3scrapefield-comDataSocial MediaAutomation1 API61.0ReefAPIWeb DataData AggregationSERP1 API60.7ContrieCompanyData ExtractionAI Agents1 API58.8PagesnapDeveloper Toolsweb-to-markdownScreenshots1 API58.5BrowserbaseBrowser AutomationBrowser InfrastructureAI Agents1 API58.0OpenSERPCompanySearchSERP1 API57.2BrowserlessBrowser AutomationBrowser InfrastructureAI Agents1 API56.5SearchApiSearchSERPGoogle Search3 APIs56.4InterfazeCompanyArtificial IntelligenceMachine LearningLLM1 API56.3TrueProxiesProxiesResidential ProxiesDatacenter Proxies1 API56.3OxylabsAI Web ScrapingBot Mitigation BypassCAPTCHA SolvingData Extraction1 API55.8HProxyProxySoftware-as-a-ServiceDeveloper Tools1 API55.6SerperSearchSERPGoogle SearchArtificial Intelligence2 APIs55.4LitescrapeCompanySERPSearch1 API54.5The HogCompanyGTM IntelligenceSales IntelligenceData Enrichment1 API54.5MCP360MCPMCP ServerMCP GatewayAI Agents38 APIs54.3Webz.ioNews DataWeb DataDark Web13 APIs54.3
Developing 36 Usable, with meaningful gaps to close
hydrafetch-comData ExtractionAutomationMarkdown1 API53.9crawlora-netCompanyArtificial IntelligenceData2 APIs53.7ScrapingAntData ExtractionProxiesBrowser Automation2 APIs52.0HyperbrowserBrowser AutomationBrowser InfrastructureWeb Crawling1 API51.9FirecrawlCrawlingData ExtractionURLs1 API49.9snoopscan-comAI AgentsMCPData Extraction1 API49.9ScrapingBeeAI ExtractionAnti-BotData AggregationData Extraction1 API48.4ragfeed-deAi DataEU HostingCompliance1 API47.9FastAFSERPDeveloper ToolsAI Integration1 API47.6fastcrawl-netArtificial IntelligenceContent ExtractionREST API1 API47.5ApifyActorsBrowser AutomationCrawlingData Aggregation1 API47.2PiloterrData ExtractionDeveloper ToolsBrowser Automation1 API47.2crawio-comProxyAnti-BotData Extraction2 APIs44.4scrapingbot-ioCompanyArtificial IntelligenceData Extraction2 APIs44.3IPMuskProxyData CollectionDeveloper Tools1 API41.6getapi-nlCompanyDutchData Validation1 API41.2octocrawl-devCompanyData ExtractionSoftware-as-a-Service2 APIs41.0Ziddecsocial-media-dataAnalytics1 API41.0pulpminer-comReal-TimeJSONLow-Code2 APIs39.4IrmuDeveloper ToolsAutomationData Extraction1 API53.5ZenserpSERPSearch Engine ResultsGoogle Search1 API52.5Bright DataWeb DataProxyResidential Proxy10 APIs50.2Automation Preflight APIAutomationIntegrationDeveloper ToolsReadiness2 APIs49.3easyparser-comCompanyAmazonReal-Time1 API49.1TinyFishCompanyArtificial IntelligenceAI AgentsBrowser Automation4 APIs49.1scraper-api-comData APISocial MediaJSON1 API48.5InsightSocialSocial MediaBrowser ExtensionFree Tier1 API48.4ShveikCompanyAI Agentsx40213 APIs47.3WarpPay402 Studiox402MicropaymentsAI AgentsMCP2 APIs44.8urlpipe-devCompanyWeb DataMarkdown1 API44.7SOAXProxyResidential ProxiesMobile Proxies1 API43.1Scrappy.ggCloud BrowserAutomationLead GenerationAI Agents2 APIs42.9ujeebu-comCompanyData ExtractionSoftware-as-a-Service1 API40.5ScavioCompanyDataArtificial Intelligence2 APIs40.2ThordataProxy NetworkData ExtractionSERP2 APIs40.2wyndpath-comCompanyDataAutomation1 API39.3
Thin 30 Limited public surface area
YepAPISEOSERPAI Models5 APIs38.9upscrape-comCompanyData ExtractionAI Integration1 API38.0APRYCOCompanyMarketplaceData2 APIs37.2AgentQLAgentsArtificial IntelligenceData Extraction1 API37.1OctoparseHarvesting1 API36.9hasdata-comData PipelineArtificial IntelligenceAutomation6 APIs36.6scrollport-comAI AgentsAPI ToolsPay-per-useSearch2 APIs35.3BardeenAI AutomationWorkflow AutomationData Enrichment1 API34.6scrappa-coData APISearchAutomation1 API33.2ZenRowsData ExtractionAnti-BotProxies1 API33.1ScrapflyArtificial IntelligenceData ExtractionScreenshots1 API32.3SpiderCrawlingData ExtractionURLs1 API32.3FrostbyteDeveloper ToolsUtility APIsGeolocationCryptocurrency7 APIs29.8SmartproxyProxiesData CollectionResidential Proxies1 API29.2RapidProxy (RAPID TERMINAL UK NETWORK LIMITED)ProxyResidentialData Collection1 API27.9ZenscrapeProxyHTMLData Extraction1 API27.8CrawlbaseWeb CrawlingWeb IntelligenceData Extraction1 API27.7CrawleeApache 2.0ApifyBrowser AutomationCrawlers2 APIs27.4scrapewhale-devDataMarketingArtificial Intelligence1 API38.0agenttoolworks-comCompanyArtificial IntelligenceVerificationData Tools2 APIs37.6ProxmintCompanyProxyBilling1 API36.1CraloCompanyAI AgentsAgent ToolsPay-per-use2 APIs35.4NotteArtificial IntelligenceWeb AgentsBrowser AutomationSessions1 API32.4Import.ioData AggregationData ExtractionData IntegrationPricing Intelligence1 API30.0Snap APIScreenshotsDeveloper ToolsWeb Capturen8n1 API29.6SnapAPIScreenshotsPDFVideo1 API29.5SnapAPIScreenshotsWebsite ScreenshotsMetadata ExtractionText Extraction1 API29.5AirtopBrowser AutomationAI AgentsCloud Browser1 API29.1G Maps ExtractorData ExtractionGoogle MapsCSV Export2 APIs26.9SteelBrowserBrowser AutomationAI Agents1 API26.5
Emerging 13 Early or largely undocumented
NubelaCompaniesDataPeople4 APIs24.6ScraperAPIData ExtractionProxies1 API24.4BizcrawAI SalesLead GenerationCRM Integration24.0CheerioData ExtractionDOMHTMLHTML Parsing1 API23.4ParseHubData ExtractionVisual Scraping1 API21.4CroxyProxyResidential ProxyDeveloper Tools1 API16.4Beautiful SoupData ExtractionHTML ParsingPython1 API12.0LightpandaBrowser AutomationWebSocketAI Agents1 API22.0RankFabrikDataLocal BusinessPlaces4 APIs18.9Wynd NetworkCompanyDePINBandwidth18.9digiantnzCompanyA2AAgentsWeb Search1 API18.4StrawberryCompanyArtificial IntelligenceAgentic BrowserAI Agents18.1PhantomJS CloudBrowser APIRenderingAutomation1 API13.6
Minimal 7 Almost no public developer surface
PuppeteerBrowser Automation1 API8.8FoodsparkDataFoodGroceriesMenus1 API9.7ScrapyCrawlingData Extraction1 API9.5FreshRSSRSS AggregatorSelf‑Hosted SoftwareFeed Reader1 API5.9StableBrowseCompanyAI AgentsBrowser InfrastructureBrowser Automation3.0DapperCompanyAdvertisingAdTech0.0Kimono LabsCompanyDeveloper ToolsData Extraction0.0

APIs with this tag (55)

Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →

Exemplar 8 Complete, well-documented, and agent-ready
Diffbot Crawl APIDiffbot Crawl API is a powerful tool that automates the process of extracting content and data from website...76.3Diffbot Crawl/Bulk Job APIThe Diffbot Crawl/Bulk Job API is a powerful tool that allows users to automatically extract and organize l...76.3Diffbot Extract APIDiffbot Extract API is a powerful tool that allows users to automatically extract multiple types of data fr...76.3Diffbot Natural Language APIDiffbot Natural Language API allows users to extract and analyze textual content from websites. By utilizin...76.3SerpApi Extract APISerpApi Extract API (engine=extract): GET https://serpapi.com/search?engine=extract&url= returns the page a...74.3SerpApi Search APISerpApi Search API: GET https://serpapi.com/search with engine=74.3APIVerve Data Scraping APIThe Data Scraping API from APIVerve — 5 operation(s) for data scraping.73.9Context.dev Web Scraping APIThe Web Scraping API from Context.dev — 7 operation(s) for web scraping.70.4
Strong 9 Solid coverage with minor gaps
WebCrawlerAPI MCP ServerOfficial Model Context Protocol server distributed as the npm package webcrawler-mcp (npx -y webcrawler-mcp...65.8Clay Chrome ExtensionBrowser extension for scraping LinkedIn profiles and other web pages directly into Clay Tables, used to boo...65.0finedata-ai Web Scraping APICore endpoint. Scrape any URL with antibot bypass, JS rendering, and proxy rotation.63.5MERCURY Web Fetch A2A AgentAgent-to-Agent (A2A 0.3.0) surface for "MERCURY Web Fetch", published as a conformant agent card at https:/...62.3WebScraping.AI MCP ServerHosted remote Model Context Protocol server exposing the same seven capabilities as tools to AI assistants....60.9ReefAPI MCP ServerHosted MCP server over streamable-HTTP with 5 discovery-first tools (search_engines, get_catalog, get_engin...60.7Monocrawl Web Scraping APIThe Web Scraping API from Monocrawl — 16 operation(s) for web scraping.58.4MCP360 Web Scraping APIThe web-scraping API from MCP360 — 1 operation(s) for web-scraping.54.3Webz.io APIToken-authenticated REST endpoints under https://api.webz.io covering seven products: News, Blogs and Forum...54.3
Developing 13 Usable, with meaningful gaps to close
ScrapingAntScrapingAnt is a web scraping API service that handles proxy rotation, headless browsers, and CAPTCHA solvi...52.0ScrapingAnt MCP ServerFirst-party hosted remote MCP server at https://api.scrapingant.com/mcp/ exposing get_web_page_html, get_we...52.0ScrapingAnt Scraping APIThe ScrapingAnt web scraping endpoint. GET/POST/PUT/PATCH/DELETE /v2/general renders a target URL in headle...52.0Hyperbrowser Scrape APISingle-page and batch scrape jobs returning HTML, Markdown, links, and screenshots with asynchronous status...51.9Bright Data Scraping Browser (Browser API) CDP WebSocketBright Data's Scraping Browser / Browser API: a cloud headless-browser fleet that speaks the Chrome DevTool...50.2proweblook-com Scraping APISocial media scraping (Reddit, X/Twitter, LinkedIn), Google SERP, and URL scrape50.0Firecrawl Scraping APIThe Scraping API from Firecrawl — 6 operation(s) for scraping.49.9Zoca Scraping APIThe Scraping API from Zoca — 6 operation(s) for scraping.49.5FastAF Web Scraping APIThe web-scraping API from FastAF — 1 operation(s) for web-scraping.47.6shveik Scraping APISynchronous data retrieval; each request completes in the HTTP response.47.3DATPAQ Web Scraping APIHeadless scrape, batch, crawl, and site-map extraction45.5ScrapingBot APIWeb scraping API with AI and stealth features.44.3SOAX Web Data APIThe SOAX Web Data API extracts fully rendered HTML, screenshots, XHR responses, and structured data from an...43.1
Thin 12 Limited public surface area
Prometheus Exposition Format / OpenMetricsThe text-based exposition format that every instrumented target exposes (typically on /metrics) and that th...35.9BardeenBardeen is an AI-powered automation platform for automating repetitive tasks across web applications.34.6ZenRows Scraper APIsVertical, structured-data scraper endpoints for major commerce and real-estate sites, sharing the api.zenro...33.1Notte Scraping APIOne-shot scraping of a URL or raw HTML, plus AI web search.32.4Scrapfly Scraping APIThe Scraping API from Scrapfly — 1 operation(s) for scraping.32.3Scrapfly Screenshot APICapture screenshots of web pages with full-page or element-specific capture using CSS selectors. Supports J...32.3Spider Cloud MCP ServerSpider's hosted Model Context Protocol server exposes 22 tools — eight core operations (crawl, scrape, sear...32.3Spider Scraping APIExtract content from individual web pages.32.3SteadyAPIREST/JSON API providing stock market, options, crypto, real estate, sports, e-commerce, social media, trave...31.7Snap APIREST/HTTP screenshot and rendering API. GET /v1/take (alias /v1/render) captures screenshots and PDFs; /v1/...29.6Crawlee JavaScript SDKThe Crawlee JavaScript SDK is a Node.js/TypeScript library for building reliable web scrapers and crawlers....27.4Crawlee Python SDKThe Crawlee Python SDK is a Python library for building reliable web scrapers and crawlers. It offers Basic...27.4
Emerging 11 Early or largely undocumented
DataDome Bot ProtectBot Protect is DataDome's core bot management product, scoring every request against the platform's threat ...24.4ScraperAPIScraperAPI is a web scraping API that manages proxies, browsers, and CAPTCHAs to extract HTML from any web ...24.4CheerioCheerio implements a subset of core jQuery designed for the server. It parses markup into a traversable, ma...23.4CaptionsTimestamped/segmented video transcript retrieval, up to 50 videos per call. Billed per transcript returned.18.9JobsJob posting collection that segments by publish window/area to exceed the public 1,000-result cap. Billed p...18.9PlacesLocal business data collection via geo point + radius sweep with deduplication on place ID; optional email ...18.9VerifyEmail verification via syntax, disposable-domain, MX and SMTP dialogue checks (no message sent), up to 100 ...18.9a2a-browser A2A AgentPay-per-search web agent (version 0.1.0-alpha) served from a2a-browser.digiant.nz: a JSON-RPC 2.0 POST endp...18.4HUMAN Bot DefenderBot Defender (formerly PerimeterX Bot Defender) is HUMAN's flagship product for stopping automated traffic ...13.0HUMAN Scraper ProtectionScraper Protection targets large-scale content scraping by automated agents, including LLM training scraper...13.0Beautiful SoupBeautiful Soup 4 is a Python library providing a parse tree API for HTML and XML documents. It exposes Tag,...12.0
Minimal 2 Almost no public developer surface
ScrapyScrapy is an open-source Python web crawling framework for extracting structured data from websites using s...9.5PuppeteerPuppeteer is a Node.js library providing a high-level API to control headless Chrome or Chromium browsers f...8.8

Companies reaching this through an API (10)

These companies publish an API, specification or operation carrying “Web Scraping” but do not classify their business under it. Listed unranked and kept out of the count above, because one tagged operation is not a statement about what a company does.

APIVerve Clay DataDome DATPAQ HUMAN Security Monocrawl Prometheus proweblook-com SteadyAPI Zoca

Score breakdown

Frequency
58.4
log-scaled weighted occurrences
Breadth
1.7
spread across providers
Quality lift
44.2
mean composite of providers using it
Cohesion
0.0
strength of nearest seed neighbor

Where this tag sits

Data Extraction broader

Related tags

Data Extraction 57 co-occurrences SERP 25 co-occurrences Browser Automation 25 co-occurrences Web Data 16 co-occurrences Proxies 16 co-occurrences Screenshots 18 co-occurrences Crawl 11 co-occurrences

Where this tag comes from

Provider tag133
Api tag55
Openapi tag11
Openapi op tag35

Markets provisional

Kin Score markets whose measured providers carry this tag. Share is the fraction of the market's measured providers that carry it — it describes the market, not this tag.

MarketShare of the market's providers
News and Media22%

Cohort brief

Auto-generated

The 129 providers in the APIs.io catalog tagged Web Scraping, scored on the Kin Score. Every figure below is computed from the catalog — nothing here is written.

Providers
129
of 133 in the catalog
Mean Kin Score
45
+20.9 vs catalog 24.1
Mean Agent Readiness
33.5
+19.4 vs catalog 14.1
Spread
3–77.4
median 47.5 · σ 17.1
How the 129 split by band
Exemplar 11Strong 36Developing 36Thin 28Emerging 13Minimal 5
Facet averages, against the whole catalog
FacetThis cohortCatalogDifferenceScored
Access Clarity 56.2 30 +26.2 129
Developer Ergonomics 50.6 24.5 +26.1 129
Contract Quality 40.8 18.6 +22.2 129
Operational Transparency 30.3 13.2 +17.1 129
Contract Governance 19.2 9.7 +9.5 129
Discoverability 68.4 59.1 +9.3 129

A facet is averaged over the members that carry it, not over the whole cohort — the “Scored” column is that count. Averaging an absent facet as zero would score our own coverage gaps as the providers’ posture.

What this cohort publishes
ArtifactThis cohortCatalogDifference
MCP server (any) 52% 18% +34
MCP server (first-party) 50% 16% +34
Agent Skills 0% 0% 0
OAuth scopes 26% 13% +13
Security 99% 99% 0
Arazzo workflows 4% 1% +3
Governance rules 81% 36% +45

mcp_pct counts any mcp/ artifact including ones API Evangelist derived from the provider OpenAPI; mcp_first_party_pct counts only servers the provider publishes. Prefer the latter.

Top by Kin Score
  1. 1 Cloro Incorporation Ltd. 77.4
  2. 2 Diffbot 76.3
  3. 3 SerpApi 74.3
  4. 4 Search1API 73
  5. 5 Browser Use 71.1
  6. 6 Context.dev 70.4
  7. 7 MrScraper 70.4
  8. 8 Crawl4AI 69.6
  9. 9 Cracked API 68.6
  10. 10 Social Fetch 67.6
Top by Agent Readiness
  1. 1 AnyAPI 73.5
  2. 2 Cloro Incorporation Ltd. 69.3
  3. 3 Cracked API 69.2
  4. 4 The Hog 65.6
  5. 5 Social Fetch 64.1
  6. 6 WebScraping.AI 63.3
  7. 7 hydrafetch-com 63.1
  8. 8 Browser Use 61.4
  9. 9 String 60.7
  10. 10 SearchApi 60.2
All 133 members of this roster resolve to a provider in the catalog; 129 carry a score (97%). The figures above describe the scored members only.Generated from the catalog build of 14 November 2026, across 41591 providers, using the same computation served by the APIs.io cohort API. Briefs are published for rosters of 5 or more scored providers; below that a distribution is not meaningful.

Work with this as data

Every tag here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for tags

7 MCP tools reach this
  • find_tagsBrowse and filter every tag in the catalog.
  • get_cohortThis tag as a scored cohort — every provider carrying it, with scores.
  • cohort_statsPRO — the distribution across this tag: mean, median, band split, adoption rates.
  • cohort_rankingsPRO — the leaderboard, on composite AND agent-readiness axes.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This tag 
curl "https://apis.io/api/v1/tags/web-scraping"
All tags 
curl "https://apis.io/api/v1/tags?limit=25"
As a scored cohort (paid plan)
The distribution (Pro)

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.