Apache Hadoop

Apache Hadoop is an open-source framework for distributed storage and processing of large datasets across clusters of computers using simple programming models. It includes HDFS for distributed storage, YARN for resource management, and MapReduce for parallel data processing.

Apache Hadoop publishes 4 APIs on the APIs.io network, including WebHDFS API, YARN Applications API, YARN Cluster API, and 1 more. Tagged areas include Big Data, Data Processing, Distributed Computing, HDFS, and MapReduce.

Apache Hadoop’s developer surface includes documentation, getting-started guide, changelog, and 8 more developer resources.

🌐 Visit website 📡 Source on GitHub

29.1/100 thin ▬ flat Agent 17/100 agent aware saas Full breakdown ↓
scored 2026-09-08 · rubric v0.20.0

AccessFreemium

1 APIs

Big Data Data Processing Distributed ComputingHDFSMapReduce Open-Source

Kin Score

Kin Score How this is scored →
scored 2026-09-08 · rubric v0.20.0

Composite quality — 29.1/100 · thin

Contract Quality 9.4 / 23

Developer Ergonomics 4.3 / 18

Access Clarity 4.7 / 18

Operational Transparency 3.1 / 12

Contract Governance 0.0 / 11

Discoverability 5.3 / 9

Create-or-Update Ergonomics 0.0 / 10

Agent readiness — 17/100 · agent aware

Machine-Readable Contract 18 / 18

Agentic Access Contract 10 / 10

Documented Reversibility 0 / 6

MCP Server 0 / 12

Machine-Readable Auth 0 / 10

Idempotency 0 / 9

Stable Error Semantics 0 / 8

Request/Response Examples 0 / 7

Rate-Limit Signaling 7 / 7

Typed Event Surface 0 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Delegated User Identity 0 / 6

Protected Resource Metadata 0 / 5

Registration Without a Human 0 / 6

Agentic Commerce Well-Known Document 0 / 5

Create-or-Update Ergonomics applies to this provider. This API accepts writes, so it carries 10 points of the composite. It is scored from the published contracts themselves: whether a caller can create-or-update in one call, whether the write accepts a key the caller already holds, and whether the response says which branch ran. Without that, every write needs a search-and-branch in front of it, and the first time that check is skipped a duplicate record is created. Scored against the observed mean rather than raw — a provider at the catalog average is unchanged by this facet, not penalised by it.

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from github.com/api-evangelist/hadoop: open an issue to ask a question, or submit a pull request to add artifacts. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

APIs 6

Individual APIs this provider publishes, each with its own machine-readable definition.

MapReduce History Server REST API

REST API for accessing MapReduce job history and statistics.

HttpFS REST API

HTTP REST API gateway supporting both webhdfs and httpfs operations for HDFS access.

Apache Hadoop WebHDFS API

HDFS filesystem REST operations under /webhdfs/v1.

Apache Hadoop YARN Applications API

Application listing, submission, and lifecycle.

Apache Hadoop YARN Cluster API

Cluster information and metrics.

Apache Hadoop YARN Nodes API

Cluster node listing and resource updates.

Open Collections 6

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

API Collection

OPEN COLLECTION

Apache Hadoop REST APIs WebHDFS API

OPEN COLLECTION

Apache Hadoop REST APIs WebHDFS YARN Applications API

OPEN COLLECTION

Apache Hadoop REST APIs WebHDFS YARN Cluster API

OPEN COLLECTION

Apache Hadoop REST APIs WebHDFS YARN Nodes API

OPEN COLLECTION

Apache Hadoop REST APIs

OPEN COLLECTION

Pricing Plans 1

Published pricing tiers and plan structures.

Hadoop Plans Pricing

3 plans

PLANS

Rate Limits 1

Documented rate limits and quota policies.

Hadoop Rate Limits

5 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Hadoop Finops

FINOPS

Security Posture 2

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Hadoop Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Hadoop Vulnerability Disclosure

security.txt · contact published

SECURITY

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Hadoop Agentic Access

17 operations · 7 acting

AGENTIC

Resources

Get Started 1

Portal, sign-up, and the first successful call

GettingStarted

GettingStarted

Documentation 1

Reference material describing how the API behaves

Documentation

Documentation

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess

AgenticAccess

Build 1

SDKs, sample code, and the tooling you integrate with

GitHubOrganization

GitHubOrganization

Access & Security 2

Authentication, authorization, and security posture

VulnerabilityDisclosure

VulnerabilityDisclosure

DomainSecurity

DomainSecurity

Operate 2

Status, limits, changes, and where to get help

Community

Community

ChangeLog

ChangeLog

Commercial 1

Pricing, plans, and the legal terms of use

TermsOfService

TermsOfService

Company 2

The organization behind the API

LinkedIn

Website

Website

Source (apis.yml)

aid: hadoop
name: Apache Hadoop
description: Apache Hadoop is an open-source framework for distributed storage and processing of large datasets across clusters
  of computers using simple programming models. It includes HDFS for distributed storage, YARN for resource management, and
  MapReduce for parallel data processing.
deliveryModel:
  model: saas
  open_source: false
  commercial: true
  callable_host: false
  label: Hosted service · you call their endpoint
  confidence: medium
  source:
  - openapi
  - pricing
  generated: '2026-08-28'
  method: derived
accessModel:
  pricing: freemium
  onboarding: unknown
  trial: false
  try_now: false
  public: false
  label: Freemium
  confidence: medium
  source:
  - plans
  generated: '2026-07-22'
  method: derived
image: https://hadoop.apache.org/hadoop-logo.jpg
url: https://raw.githubusercontent.com/api-evangelist/hadoop/refs/heads/main/apis.yml
type: Index
created: '2024-01-15'
modified: '2026-05-19'
specificationVersion: '0.23'
tags:
- Big Data
- Data Processing
- Distributed Computing
- HDFS
- MapReduce
- Open-Source
tags_raw:
- Big Data
- Data Processing
- Distributed Computing
- HDFS
- MapReduce
- Open Source
apis:
- aid: hadoop:mapreduce-history-server-api
  name: MapReduce History Server REST API
  description: REST API for accessing MapReduce job history and statistics.
  humanURL: https://hadoop.apache.org/docs/stable/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html
  tags:
  - Job History
  - MapReduce
  - REST API
  properties:
  - type: Documentation
    url: https://hadoop.apache.org/docs/stable/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html
- aid: hadoop:httpfs-rest-api
  name: HttpFS REST API
  description: HTTP REST API gateway supporting both webhdfs and httpfs operations for HDFS access.
  humanURL: https://hadoop.apache.org/docs/stable/hadoop-hdfs-httpfs/index.html
  baseURL: http://httpfs-host:port/webhdfs/v1/
  tags:
  - Filesystem
  - Gateway
  - REST API
  tags_raw:
  - File System
  - Gateway
  - REST API
  properties:
  - type: Documentation
    url: https://hadoop.apache.org/docs/stable/hadoop-hdfs-httpfs/index.html
- aid: hadoop:hadoop-webhdfs-api
  name: Apache Hadoop WebHDFS API
  description: HDFS filesystem REST operations under /webhdfs/v1.
  humanURL: https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html
  baseURL: http://host:port/webhdfs/v1/
  tags:
  - WebHDFS
  properties:
  - type: OpenAPI
    url: openapi/hadoop-webhdfs-api-openapi.yml
  - type: Documentation
    url: https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html
  - type: Rules
    url: https://raw.githubusercontent.com/api-evangelist/hadoop/refs/heads/main/hadoop-rules.yml
  - type: Documentation
    url: https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html
- aid: hadoop:hadoop-yarn-applications-api
  name: Apache Hadoop YARN Applications API
  description: Application listing, submission, and lifecycle.
  humanURL: https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html
  baseURL: http://host:port/webhdfs/v1/
  tags:
  - YARN Applications
  properties:
  - type: OpenAPI
    url: openapi/hadoop-yarn-applications-api-openapi.yml
  - type: Documentation
    url: https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html
  - type: Rules
    url: https://raw.githubusercontent.com/api-evangelist/hadoop/refs/heads/main/hadoop-rules.yml
  - type: Documentation
    url: https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html
- aid: hadoop:hadoop-yarn-cluster-api
  name: Apache Hadoop YARN Cluster API
  description: Cluster information and metrics.
  humanURL: https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html
  baseURL: http://host:port/webhdfs/v1/
  tags:
  - YARN Cluster
  properties:
  - type: OpenAPI
    url: openapi/hadoop-yarn-cluster-api-openapi.yml
  - type: Documentation
    url: https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html
  - type: Rules
    url: https://raw.githubusercontent.com/api-evangelist/hadoop/refs/heads/main/hadoop-rules.yml
  - type: Documentation
    url: https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html
- aid: hadoop:hadoop-yarn-nodes-api
  name: Apache Hadoop YARN Nodes API
  description: Cluster node listing and resource updates.
  humanURL: https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html
  baseURL: http://host:port/webhdfs/v1/
  tags:
  - YARN Nodes
  properties:
  - type: OpenAPI
    url: openapi/hadoop-yarn-nodes-api-openapi.yml
  - type: Documentation
    url: https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html
  - type: Rules
    url: https://raw.githubusercontent.com/api-evangelist/hadoop/refs/heads/main/hadoop-rules.yml
  - type: Documentation
    url: https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html
common:
- type: AgenticAccess
  url: agentic-access/hadoop-agentic-access.yml
- type: VulnerabilityDisclosure
  url: security/hadoop-vulnerability-disclosure.yml
- type: DomainSecurity
  url: security/hadoop-domain-security.yml
- type: LinkedIn
  url: https://www.linkedin.com/showcase/hadoop
- type: Website
  url: https://hadoop.apache.org/
- type: Documentation
  url: https://hadoop.apache.org/docs/stable/
- type: GettingStarted
  url: https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/SingleCluster.html
- type: GitHubOrganization
  url: https://github.com/apache/hadoop
- type: Community
  url: https://hadoop.apache.org/mailing_lists.html
- type: ChangeLog
  url: https://hadoop.apache.org/releases.html
- type: TermsOfService
  url: https://www.apache.org/licenses/LICENSE-2.0
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this

find_providersBrowse and filter every provider in the catalog.
get_provider_artifactsEvery artifact this provider publishes, grouped by type.
get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
get_provider_ratingPRO — composite, band, trend and facet scores.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This provider

curl "https://apis.io/api/v1/providers/hadoop"

All providers

curl "https://apis.io/api/v1/providers?limit=25"

Every operation they expose

curl "https://apis.io/api/v1/providers/hadoop/operations?limit=25"

How their score was established

curl "https://apis.io/api/v1/providers/hadoop/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.