Data.gov

Data.gov Harvester (datagov-harvester)

The Data.gov harvester service ingests dataset metadata from federal, state, local, and tribal data.json endpoints, CKAN sources, and other CSW/WAF sources on a scheduled cadence and writes records into the central catalog. It is a publisher-facing service (not a public API for consumers) but its source code is open at GSA/datagov-harvester and it documents the harvest source types, job schedules, and validation rules used by Data.gov.

GitHub

Other Resources

🔗
SourceCode
https://github.com/GSA/datagov-harvester
🔗
Portal
https://harvest.data.gov/

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/datajson-harvester"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

API entry from apis.yml

apis.yml Raw ↑ 
aid: data-gov:datajson-harvester
name: Data.gov Harvester (datagov-harvester)
tags:
- Harvesting
- Catalog
- Ingestion
humanURL: https://harvest.data.gov/
properties:
- url: https://github.com/GSA/datagov-harvester
  type: SourceCode
- url: https://harvest.data.gov/
  type: Portal
description: The Data.gov harvester service ingests dataset metadata from federal, state, local, and tribal
  data.json endpoints, CKAN sources, and other CSW/WAF sources on a scheduled cadence and writes records
  into the central catalog. It is a publisher-facing service (not a public API for consumers) but its
  source code is open at GSA/datagov-harvester and it documents the harvest source types, job schedules,
  and validation rules used by Data.gov.