established · 1.8 capabilitymarket

Harvesting

Score 24.4 / 100 5 providers +43 via APIs 59 APIs Search apis.io →

Providers using this tag (5)

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 1 Complete, well-documented, and agent-ready

DiffbotExtractionWeb ScrapingWeb9 APIs77.1

Developing 1 Usable, with meaningful gaps to close

ZenodoResearchOpen DataRepositoryDOI1 API40.1

Thin 2 Limited public surface area

OctoparseWeb Scraping1 API36.7 CrawleeApache 2.0ApifyBrowser AutomationCrawlers2 APIs26.8

Unrated 1 Not yet scored

Advanced Farm TechnologiesCompanyAgricultureAgricultural RoboticsRobotics

APIs with this tag (59)

Ranked by the provider's API Evangelist rating — the Kin Score is scored per provider, not per API, so every API of a provider shares its band. How the rating works →

Exemplar 4 Complete, well-documented, and agent-ready

Diffbot Crawl APIDiffbot Crawl API is a powerful tool that automates the process of extracting content and data from website...77.1 Diffbot Crawl/Bulk Job APIThe Diffbot Crawl/Bulk Job API is a powerful tool that allows users to automatically extract and organize l...77.1 Diffbot Extract APIDiffbot Extract API is a powerful tool that allows users to automatically extract multiple types of data fr...77.1 Diffbot Natural Language APIDiffbot Natural Language API allows users to extract and analyze textual content from websites. By utilizin...77.1

Developing 10 Usable, with meaningful gaps to close

Helda OAI-PMH Metadata InterfaceOAI-PMH 2.0 harvesting endpoint for Helda. Identify returns repositoryName "Helda" with an earliest datesta...49.2 HY Data Catalogue OAI-PMH InterfaceOAI-PMH 2.0 endpoint for the HY Data Catalogue. Identify returns repositoryName "HyDatacatalogue", adminEma...49.2 Abacus OAI-PMH Metadata Harvesting EndpointA working OAI-PMH 2.0 archive on UBC Library's own host. Verified live 2026-08-19: verb=Identify returns re...45.9 Rice Research Repository (DSpaceDirect tenancy) — OAI-PMHOAI-PMH 2.0 harvesting endpoint for the Rice Research Repository. Identify returns repositoryName "Rice Res...43.4 Dane Badawcze UW OAI-PMH EndpointOAI-PMH 2.0 metadata harvesting endpoint for the University of Warsaw Research Data Repository (Dataverse)....43.1 ReIn UW OAI-PMH EndpointOAI-PMH 2.0 metadata harvesting endpoint for the Institutional Repository of the University of Warsaw. verb...43.1 Taylor's e-Repository OAI-PMHOAI-PMH 2.0 data provider for the DSpace CRIS e-Repository, Identifying as repositoryName "Taylor's Univers...40.2 Taylor's Library OAI-PMHOAI-PMH 2.0 data provider exposed by the Koha-powered Taylor's Library catalog for harvesting bibliographic...40.2 Zenodo OAI-PMH APIOpen Archives Initiative Protocol for Metadata Harvesting endpoint that allows bulk harvesting of Zenodo me...40.1 Elmi Research Portal — OAI-PMHHBKU's research information system, Elmi, runs Elsevier Pure on the university's own subdomain and exposes ...39.8

Thin 18 Limited public surface area

TU Wien Research Data OAI-PMHOAI-PMH 2.0 harvesting interface for the TU Wien Research Data repository. Verified live on 2026-08-30 with...38.2 ResearchSpace OAI-PMH 2.0 ServiceLive OAI-PMH 2.0 metadata harvesting endpoint for ResearchSpace, the University's self-hosted DSpace instit...36.1 Macquarie University Harvesting APIOAI-PMH 2.0 verbs for incremental metadata harvesting.33.5 PHAIDRA OAI-PMH EndpointOAI-PMH 2.0 metadata harvesting interface for PHAIDRA, the University of Vienna's own institutional reposit...33.4 FDAT Repository OAI-PMHOAI-PMH 2.0 metadata harvesting provider for the FDAT research data repository. Verified live 2026-09-01 — ...31.4 DIAL.mem OAI-PMHOAI-PMH 2.0 harvesting endpoint for DIAL.mem, UCLouvain's master's-thesis repository. Identify returns repo...30.9 DIAL.pr OAI-PMHOAI-PMH 2.0 harvesting endpoint for DIAL.pr, UCLouvain's research-publications repository. Identify returns...30.9 OER-UCLouvain OAI-PMHOER-UCLouvain is the institution's open educational resources repository, running DSpace JSPUI on oer.uclou...30.9 Open Data @ UCLouvain Dataverse OAI-PMHOAI-PMH 2.0 metadata-harvesting endpoint for the UCLouvain research-data repository. Identify returns repos...30.9 OAI-PMH Harvesting APIStandards-based bulk harvesting endpoint implementing the Open Archives Initiative Protocol for Metadata Ha...30.6 edoc OAI-PMHOAI-PMH 2.0 metadata harvesting interface for edoc. Identify reports repositoryName "edoc: Open Access Repo...29.9 UCSF scholarly output via eScholarship OAI-PMHUCSF's open-access scholarly output is harvestable as a named OAI-PMH set on the University of California's...29.9 Maastricht University Harvesting APIOAI-PMH 2.0 verbs. Every response is an application/xml OAI-PMH envelope.29.2 NYCU Dataverse OAI-PMH EndpointAnonymous OAI-PMH 2.0 metadata-harvesting endpoint over the NYCU Dataverse research-data repository ("NYCU ...28.8 NYCU Institutional Repository OAI-PMH EndpointAnonymous OAI-PMH 2.0 harvesting endpoint over the NYCU institutional repository (國立陽明交通大學機構典藏), running ba...28.8 Politecnico di Milano Harvesting APIThe six OAI-PMH 2.0 verbs.27.8 ZFDM Repository OAI-PMHOAI-PMH 2.0 harvesting interface of the ZFDM Research Data Repository. Verified live 2026-09-01: repository...27.6 OPARA OAI-PMH Harvesting InterfaceThe standards-based harvesting interface for OPARA — how TU Dresden's research data reaches OpenAIRE, BASE,...27.0

Emerging 15 Early or largely undocumented

Yareta OAI-PMH Provider APIThe OAI-PMH provider-information surface of the Yareta access module — sets, metadata formats and provider ...25.8 TUdatalib OAI-PMHOAI-PMH 2.0 metadata harvesting interface for TUdatalib. Verified live 2026-09-01: Identify returns reposit...24.0 CaltechDATA OAI-PMHOAI-PMH 2.0 metadata harvesting endpoint for CaltechDATA. Verified live 2026-08-19 via the Identify verb (r...22.4 Aarhus University OAI-PMH Metadata ServiceOpen Archives Initiative Protocol for Metadata Harvesting 2.0 service for Aarhus University's research reco...21.8 HAL OAI-PMH — ens-lyon collectionOAI-PMH 2.0 harvesting endpoint scoped to ENS de Lyon's named collection on HAL, the French national open a...20.1 AUB ScholarWorks OAI-PMHOAI-PMH 2.0 metadata harvesting endpoint for AUB ScholarWorks. Identify returns repositoryName "AUB Scholar...19.6 IIT Delhi Institutional Repository OAI-PMHOAI-PMH 2.0 metadata-harvesting interface for the IIT Delhi DSpace 8 institutional repository, on the insti...19.6 Data.gov Harvester (datagov-harvester)The Data.gov harvester service ingests dataset metadata from federal, state, local, and tribal data.json en...19.3 TAU Libraries Alma OAI-PMH Metadata HarvestingOpen Archives Initiative Protocol for Metadata Harvesting 2.0 service for the Tel Aviv University library r...19.1 University of Navarra Harvesting APIOAI-PMH 2.0 verbs for harvesting scholarly metadata18.7 Griffith Research Online OAI-PMHOAI-PMH 2.0 metadata harvesting endpoint for Griffith Research Online. The Identify response returns reposi...18.3 Biblos-e Archivo OAI-PMH EndpointOAI-PMH 2.0 metadata-harvesting endpoint for Biblos-e Archivo. Identify returns repositoryName "Biblos-e Ar...18.0 Portal de Revistas Electrónicas de la UAM — OAI-PMH EndpointOAI-PMH 2.0 endpoint over the university's Open Journal Systems 3.3.0.6 installation, which hosts UAM's ele...18.0 HIT Research Portal OAI-PMH EndpointOAI-PMH 2.0 harvesting endpoint for HIT's research outputs, persons and datasets, on HIT's own hostname and...16.7 UChile Research Data Repository OAI-PMHOAI-PMH 2.0 provider on the University of Chile Dataverse installation. Confirmed live on 2026-09-01: ?verb...16.0

Unrated 12 Not yet scored

Australian National University Harvesting APIOAI-PMH verbs for metadata harvesting.Docta Complutense OAI-PMH EndpointOAI-PMH 2.0 harvesting endpoint for Docta Complutense, on UCM's own host. Probed 2026-08-30: verb=Identify ...Harvard Dataverse OAI-PMHOAI-PMH 2.0 metadata harvesting endpoint for Harvard Dataverse. Identify returns repositoryName "Harvard Da...IRIS PoliTO OAI-PMH Metadata Service (CINECA deployment)OAI-PMH 2.0 harvesting service over IRIS, Politecnico di Torino's institutional research repository, reacha...Lund University Publications OAI-PMHOAI-PMH 2.0 metadata-harvesting endpoint for the LUP research-output repository. Identify confirms reposito...LUP Student Papers OAI-PMHOAI-PMH 2.0 harvesting endpoint for the LUP Student Papers repository. Identify confirms repositoryName "Lu...MSU Libraries Catalog OAI-PMHOAI-PMH 2.0 metadata harvesting provider over the MSU Libraries catalog, on the university's own host. Veri...MSU Libraries Digital Repository OAI-PMHOAI-PMH 2.0 provider over the MSU Libraries Digital Repository at d.lib.msu.edu. Verified live on 2026-08-3...Peking University Harvesting APIOAI-PMH 2.0 verbs for harvesting repository metadata.PKU Open Research Data Platform (OAI-PMH)OAI-PMH 2.0 metadata-harvesting endpoint for the Open Research Data Platform, verified responding to the Id...PMC OAI-PMH APIThe PMC OAI-PMH (Open Archives Initiative Protocol for Metadata Harvesting) API enables systematic harvesti...ScholarBank@NUS OAI-PMH InterfaceOAI-PMH 2.0 metadata harvesting endpoint for ScholarBank@NUS, advertising twelve metadata formats including...

Companies reaching this through an API (43)

These companies publish an API, specification or operation carrying “Harvesting” but do not classify their business under it. Listed unranked and kept out of the count above, because one tagged operation is not a statement about what a company does.

Aarhus University American University of Beirut Australian National University Autonomous University of Madrid California Institute of Technology Complutense University of Madrid Data.gov Griffith University Hamad Bin Khalifa University Harbin Institute of Technology Harvard University Indian Institute of Technology Delhi Lund University Maastricht University Macquarie University Michigan State University National University of Singapore National Yang Ming Chiao Tung University Peking University Politecnico di Milano Politecnico di Torino PubMed Rice University Rijksmuseum Taylor's University Technical University of Darmstadt Tel Aviv University TU Dresden TU Wien UCLouvain University of Auckland University of Basel University of British Columbia University of California, San Francisco University of Chile University of Geneva University of Helsinki University of Navarra University of Tübingen University of Vienna University of Warsaw Universität Hamburg École Normale Supérieure de Lyon

Score breakdown

Frequency

46.0

log-scaled weighted occurrences

Breadth

0.1

spread across providers

Quality lift

47.3

mean composite of providers using it

Cohesion

22.9

strength of nearest seed neighbor

Where this tag comes from

Api tag59

Provider tag5

Openapi tag6

Openapi op tag6

Work with this as data

Every tag here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for tags

7 MCP tools reach this

find_tagsBrowse and filter every tag in the catalog.
get_cohortThis tag as a scored cohort — every provider carrying it, with scores.
cohort_statsPRO — the distribution across this tag: mean, median, band split, adoption rates.
cohort_rankingsPRO — the leaderboard, on composite AND agent-readiness axes.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This tag

curl "https://apis.io/api/v1/tags/harvesting"

All tags

curl "https://apis.io/api/v1/tags?limit=25"

As a scored cohort

curl "https://apis.io/api/v1/cohorts/tag/harvesting"

The distribution (Pro)

curl "https://apis.io/api/v1/cohorts/tag/harvesting/stats" \
  -H "X-API-Key: $APIS_IO_KEY"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.