niche · 1.8

Scraping

Score 20.1 / 100 25 providers 28 APIs Search apis.io →

Providers using this tag (25)

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 1 Complete, well-documented, and agent-ready
KonbiniAPISocial-MediaInstagramTikTokX6 APIs73.7
Strong 3 Solid coverage with minor gaps
ClayProspectingGo-To-MarketSalesEnrichment8 APIs61.3SerperSearchSERPGoogle SearchArtificial Intelligence14 APIs59.7OxylabsAI Web ScrapingBot Mitigation BypassCAPTCHA SolvingData Extraction15 APIs54.7
Developing 2 Usable, with meaningful gaps to close
SpiderCrawlingData ExtractionURLs10 APIs48.3FirecrawlCrawlingData ExtractionURLs10 APIs43.1
Thin 9 Limited public surface area
NotteArtificial IntelligenceWeb AgentsBrowser AutomationSessions7 APIs37.6FrostbyteDeveloper ToolsUtility APIsGeolocationCryptocurrency10 APIs37.1PrometheusMonitoringMetricsObservabilityTime Series21 APIs37.1SteelBrowserWeb AutomationAI Agents4 APIs36.4OctoparseHarvesting19 APIs36.2DiffbotExtractionHarvestingWeb11 APIs34.6DataDomeBot MitigationFraud ProtectionAccount ProtectionAd Fraud17 APIs33.6ScrapflyArtificial IntelligenceData ExtractionScreenshotsWeb Scraping7 APIs33.3NubelaCompaniesDataPeople4 APIs27.5
Emerging 9 Early or largely undocumented
ScraperAPIData ExtractionProxies3 APIs26.1ScrapingAntData ExtractionProxies2 APIs25.4ParseHubData ExtractionVisual Scraping2 APIs25.2HUMAN SecurityBot MitigationAccount TakeoverAd FraudClient-Side Security5 APIs19.9CheerioData ExtractionDOMHTMLHTML Parsing1 API16.8CrawleeApache 2.0ApifyBrowser AutomationCrawlers2 APIs15.4Beautiful SoupData ExtractionHTML ParsingPython1 API13.8ZyteCrawlingData Extraction1 API11.7ScrapyCrawlingData Extraction1 API11.2
Minimal 1 Almost no public developer surface
PuppeteerBrowser AutomationHeadless Browsers1 API10.5

APIs with this tag (28)

Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →

Strong 2 Solid coverage with minor gaps
Clay Chrome ExtensionBrowser extension for scraping LinkedIn profiles and other web pages directly into Clay Tables, used to boo...61.3Serper Webpage Scrape APIFetch and extract the contents of a URL, optionally as markdown with images, links and videos. Served from ...59.7
Developing 3 Usable, with meaningful gaps to close
Spider Cloud MCP ServerSpider's hosted Model Context Protocol server exposes 22 tools — eight core operations (crawl, scrape, sear...48.3Spider Scraping APIExtract content from individual web pages.48.3Firecrawl Scraping APIThe Scraping API from Firecrawl — 6 operation(s) for scraping.43.1
Thin 11 Limited public surface area
Notte Scraping APIOne-shot scraping of a URL or raw HTML, plus AI web search.37.6Prometheus Exposition Format / OpenMetricsThe text-based exposition format that every instrumented target exposes (typically on /metrics) and that th...37.1Diffbot Bulk Extract APIDiffbot Bulk Extract API is a tool that allows users to extract data at scale from a variety of sources, in...34.6Diffbot Crawl APIThe Crawl API from Diffbot — 2 operation(s) for crawl.34.6Diffbot Crawl/Bulk Job APIThe Diffbot Crawl/Bulk Job API is a powerful tool that allows users to automatically extract and organize l...34.6Diffbot DQL APIThe Diffbot DQL API is a powerful tool that allows users to query and retrieve data from the web in a struc...34.6Diffbot Enhance APIDiffbot Enhance API enhances data by providing additional context and insights. By analyzing text and image...34.6Diffbot Extract APIThe Extract API from Diffbot — 9 operation(s) for extract.34.6Diffbot Natural Language APIThe Natural Language API from Diffbot — 1 operation(s) for natural language.34.6DataDome Bot ProtectBot Protect is DataDome's core bot management product, scoring every request against the platform's threat ...33.6Scrapfly Scraping APIThe Scraping API from Scrapfly — 1 operation(s) for scraping.33.3
Emerging 11 Early or largely undocumented
ScraperAPIScraperAPI is a web scraping API that manages proxies, browsers, and CAPTCHAs to extract HTML from any web ...26.1ScrapingAntScrapingAnt is a web scraping API service that handles proxy rotation, headless browsers, and CAPTCHA solvi...25.4ScrapingAnt Scraping APIThe Scraping API from ScrapingAnt — 1 operation(s) for scraping.25.4HUMAN Bot DefenderBot Defender (formerly PerimeterX Bot Defender) is HUMAN's flagship product for stopping automated traffic ...19.9HUMAN Scraper ProtectionScraper Protection targets large-scale content scraping by automated agents, including LLM training scraper...19.9CheerioCheerio implements a subset of core jQuery designed for the server. It parses markup into a traversable, ma...16.8Crawlee JavaScript SDKThe Crawlee JavaScript SDK is a Node.js/TypeScript library for building reliable web scrapers and crawlers....15.4Crawlee Python SDKThe Crawlee Python SDK is a Python library for building reliable web scrapers and crawlers. It offers Basic...15.4Beautiful SoupBeautiful Soup 4 is a Python library providing a parse tree API for HTML and XML documents. It exposes Tag,...13.8ZyteZyte is a web data extraction platform providing APIs, smart proxy management, and AI-powered data extracti...11.7ScrapyScrapy is an open-source Python web crawling framework for extracting structured data from websites using s...11.2
Minimal 1 Almost no public developer surface
PuppeteerPuppeteer is a Node.js library providing a high-level API to control headless Chrome or Chromium browsers f...10.5

Score breakdown

Frequency
47.2
log-scaled weighted occurrences
Breadth
0.7
spread across providers
Quality lift
40.0
mean composite of providers using it
Cohesion
0.9
strength of nearest seed neighbor

Related tags

Crawling 5 co-occurrences Data Extraction 12 co-occurrences Proxies 5 co-occurrences Browser Automation 6 co-occurrences Agents 6 co-occurrences Search 5 co-occurrences Artificial Intelligence 6 co-occurrences

Where this tag comes from

Provider tag20
Api tag28
Openapi tag5
Openapi op tag15

Cohort brief

Auto-generated

The 25 providers in the APIs.io catalog tagged Scraping, scored on the Kin Score. Every figure below is computed from the catalog — nothing here is written.

Providers
25
all scored
Mean Kin Score
33.2
+12.5 vs catalog 20.7
Mean Agent Readiness
18.7
+9.0 vs catalog 9.7
Spread
10.5–73.7
median 33.6 · σ 16.5
How the 25 split by band
Exemplar 1Strong 3Developing 2Thin 9Emerging 9Minimal 1
Facet averages, against the whole catalog
FacetThis cohortCatalogDifferenceScored
Contract Quality 38.4 17.5 +20.9 25
Access Clarity 35.2 22.3 +12.9 25
Developer Ergonomics 30.7 17.9 +12.8 25
Operational Transparency 23 11.3 +11.7 25
Discoverability 64.5 60.4 +4.1 25
Contract Governance 5.2 6.4 -1.2 25

A facet is averaged over the members that carry it, not over the whole cohort — the “Scored” column is that count. Averaging an absent facet as zero would score our own coverage gaps as the providers’ posture.

What this cohort publishes
ArtifactThis cohortCatalogDifference
MCP server (any) 20% 16% +4
MCP server (first-party) 8% 7% +1
Agent Skills 0% 0% 0
OAuth scopes 8% 9% -1
Security 100% 88% +12
Arazzo workflows 4% 2% +2
Governance rules 20% 13% +7

mcp_pct counts any mcp/ artifact including ones API Evangelist derived from the provider OpenAPI; mcp_first_party_pct counts only servers the provider publishes. Prefer the latter.

Top by Kin Score
  1. 1 KonbiniAPI 73.7
  2. 2 Clay 61.3
  3. 3 Serper 59.7
  4. 4 Oxylabs 54.7
  5. 5 Spider 48.3
  6. 6 Firecrawl 43.1
  7. 7 Notte 37.6
  8. 8 Frostbyte 37.1
  9. 9 Prometheus 37.1
  10. 10 Steel 36.4
Top by Agent Readiness
  1. 1 Clay 41.9
  2. 2 KonbiniAPI 36.9
  3. 3 Serper 28.6
  4. 4 Frostbyte 28.1
  5. 5 Oxylabs 28.1
  6. 6 Scrapfly 25.5
  7. 7 Firecrawl 24.8
  8. 8 Octoparse 24.8
  9. 9 Spider 23.2
  10. 10 Nubela 22.9
All 25 members of this roster resolve to a scored provider in the catalog.Generated from the catalog build of 25 August 2026, across 26891 providers, using the same computation served by the APIs.io cohort API. Briefs are published for rosters of 5 or more scored providers; below that a distribution is not meaningful.

Work with this as data

Every tag here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for tags

7 MCP tools reach this
  • find_tagsBrowse and filter every tag in the catalog.
  • get_cohortThis tag as a scored cohort — every provider carrying it, with scores.
  • cohort_statsPRO — the distribution across this tag: mean, median, band split, adoption rates.
  • cohort_rankingsPRO — the leaderboard, on composite AND agent-readiness axes.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools

Call it yourself

curl for this page
This tag 
curl "https://apis.io/api/v1/tags/scraping"
All tags 
curl "https://apis.io/api/v1/tags?limit=25"
As a scored cohort 
curl "https://apis.io/api/v1/cohorts/tag/scraping"
The distribution (Pro) 
curl "https://apis.io/api/v1/cohorts/tag/scraping/stats" \
  -H "X-API-Key: $APIS_IO_KEY"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.