Google Cloud Dataproc website screenshot

Google Cloud Dataproc

Google Cloud Dataproc is a fully managed and highly scalable service for running Apache Spark, Apache Hadoop, Apache Flink, Presto, and other open-source data processing frameworks. It enables batch processing, querying, streaming, and machine learning use cases with cluster management that takes seconds instead of minutes, along with per-second billing and autoscaling capabilities.

Google Cloud Dataproc publishes 3 APIs on the APIs.io network: Clusters API, Jobs API, and WorkflowTemplates API. Tagged areas include Big Data, Data Processing, Google Cloud, Hadoop, and Spark.

The Google Cloud Dataproc catalog on APIs.io includes 1 JSON-LD context and 1 Spectral governance ruleset.

Google Cloud Dataproc’s developer surface includes authentication, developer portal, getting-started guide, documentation, pricing, support, and 11 more developer resources.

🌐 Visit website 📡 Source on GitHub
62.6/100 strong ▬ flat Agent 31/100 agent aware Full breakdown ↓
scored 2026-07-28 · rubric v0.6
AccessFreemiumSelf serve⚡ Free to try
3 APIs
Big DataData ProcessingGoogle CloudHadoopSpark

Kin Score

Kin Score Kin Score How this is scored →
scored 2026-07-28 · rubric v0.6
Composite quality — 62.6/100 · strong
Contract Quality 17.6 / 25
Developer Ergonomics 9.6 / 20
Commercial Clarity 14.2 / 20
Operational Transparency 6.8 / 13
Governance 7.0 / 12
Discoverability 7.4 / 10
Agent readiness — 31/100 · agent aware
Machine-Readable Contract 18 / 18
Agentic Access Contract 10 / 10
MCP Server 0 / 12
Machine-Readable Auth 10 / 10
Idempotency 0 / 9
Stable Error Semantics 0 / 8
Request/Response Examples 0 / 7
Rate-Limit Signaling 7 / 7
Typed Event Surface 0 / 6
Agent Skills 0 / 5
Well-Known Catalog 0 / 4
Consent & Bot Identity 0 / 3
A2A Agent Card 0 / 8
Dry-Run / Simulate Mode 0 / 4
Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/google-cloud-dataproc: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

APIs 3

Individual APIs this provider publishes, each with its own machine-readable definition.

Google Cloud Dataproc Clusters API

Operations on Dataproc clusters

Google Cloud Dataproc Jobs API

Operations on Dataproc jobs

Google Cloud Dataproc WorkflowTemplates API

Operations on workflow templates

Postman Collections 3

Ready-to-run Postman collections for exercising this provider's APIs.

Google Cloud Dataproc Clusters API

POSTMAN

Google Cloud Dataproc Clusters Jobs API

POSTMAN

Google Cloud Dataproc Clusters WorkflowTemplates API

POSTMAN

Open Collections 1

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

Google Cloud Dataproc API

OPEN COLLECTION

Pricing Plans 1

Published pricing tiers and plan structures.

Google Cloud Dataproc Plans Pricing

3 plans

PLANS

Rate Limits 1

Documented rate limits and quota policies.

Google Cloud Dataproc Rate Limits

5 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Google Cloud Dataproc Finops

FINOPS

Semantic Vocabularies 1

JSON-LD contexts and semantic vocabularies used across these APIs.

Google Cloud Dataproc Context

21 classes · 0 properties

JSON-LD

Spectral Rules 1

Spectral governance rulesets for linting and validating these APIs.

Google Cloud Dataproc API Rules

5 rules · 3 warnings 2 info

SPECTRAL

JSON Schema 1

Standalone JSON Schema definitions for this provider's data models.

Google Cloud Dataproc Cluster

6 properties

JSON SCHEMA

Security Posture 3

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Google Cloud Dataproc Authentication

oauth2 · 1 scheme

SECURITY

Google Cloud Dataproc Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Google Cloud Dataproc Vulnerability Disclosure

security.txt · contact published

SECURITY

Scopes 1

OAuth scopes governing access to this provider's APIs.

Google Cloud Dataproc Scopes

1 scope · authorizationCode

1 scopes

SCOPES

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Google Cloud Dataproc Agentic Access

12 operations · 7 acting

12 operations · 7 acting

AGENTIC

Resources

Get Started 2

Portal, sign-up, and the first successful call

Portal
Portal
 GettingStarted
GettingStarted

Documentation 1

Reference material describing how the API behaves

Documentation
Documentation

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess
AgenticAccess

Design & Contract 1

Pagination, idempotency, versioning, errors, and events

JSONLD
JSONLD

Build 2

SDKs, sample code, and the tooling you integrate with

PostmanWorkspace
PostmanWorkspace
 GitHubOrganization
GitHubOrganization

Access & Security 5

Authentication, authorization, and security posture

VulnerabilityDisclosure
VulnerabilityDisclosure
 DomainSecurity
DomainSecurity
 Authentication
Authentication
 OAuthScopes
OAuthScopes
 Authentication
Authentication

Operate 2

Status, limits, changes, and where to get help

StatusPage
StatusPage
 Support
Support

Commercial 3

Pricing, plans, and the legal terms of use

Pricing
Pricing
 TermsOfService
TermsOfService
 PrivacyPolicy
PrivacyPolicy

Source (apis.yml)

apis.yml Raw ↑ 
aid: google-cloud-dataproc
name: Google Cloud Dataproc
description: Google Cloud Dataproc is a fully managed and highly scalable service for running Apache Spark, Apache Hadoop,
  Apache Flink, Presto, and other open-source data processing frameworks. It enables batch processing, querying, streaming,
  and machine learning use cases with cluster management that takes seconds instead of minutes, along with per-second billing
  and autoscaling capabilities.
accessModel:
  pricing: freemium
  onboarding: self-serve
  trial: false
  try_now: true
  public: false
  label: Freemium · Self-serve signup
  confidence: high
  source:
  - plans
  - authentication
  generated: '2026-07-22'
  method: derived
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/google-cloud-dataproc.png
url: https://raw.githubusercontent.com/api-evangelist/google-cloud-dataproc/refs/heads/main/apis.yml
created: '2026-03-13'
modified: '2026-05-19'
specificationVersion: '0.19'
type: Index
tags:
- Big Data
- Data Processing
- Google Cloud
- Hadoop
- Spark
apis:
- aid: google-cloud-dataproc:google-cloud-dataproc-clusters-api
  name: Google Cloud Dataproc Clusters API
  description: Operations on Dataproc clusters
  humanURL: https://cloud.google.com/dataproc/docs
  baseURL: https://dataproc.googleapis.com/v1
  tags:
  - Clusters
  properties:
  - type: OpenAPI
    url: openapi/google-cloud-dataproc-clusters-api-openapi.yml
  - type: Documentation
    url: https://cloud.google.com/dataproc/docs/reference/rest
  - type: Authentication
    url: https://cloud.google.com/dataproc/docs/concepts/iam
  - type: GettingStarted
    url: https://cloud.google.com/dataproc/docs/quickstarts
  - type: JSONSchema
    url: json-schema/cluster-schema.json
- aid: google-cloud-dataproc:google-cloud-dataproc-jobs-api
  name: Google Cloud Dataproc Jobs API
  description: Operations on Dataproc jobs
  humanURL: https://cloud.google.com/dataproc/docs
  baseURL: https://dataproc.googleapis.com/v1
  tags:
  - Jobs
  properties:
  - type: OpenAPI
    url: openapi/google-cloud-dataproc-jobs-api-openapi.yml
  - type: Documentation
    url: https://cloud.google.com/dataproc/docs/reference/rest
  - type: Authentication
    url: https://cloud.google.com/dataproc/docs/concepts/iam
  - type: GettingStarted
    url: https://cloud.google.com/dataproc/docs/quickstarts
  - type: JSONSchema
    url: json-schema/cluster-schema.json
- aid: google-cloud-dataproc:google-cloud-dataproc-workflowtemplates-api
  name: Google Cloud Dataproc WorkflowTemplates API
  description: Operations on workflow templates
  humanURL: https://cloud.google.com/dataproc/docs
  baseURL: https://dataproc.googleapis.com/v1
  tags:
  - WorkflowTemplates
  properties:
  - type: OpenAPI
    url: openapi/google-cloud-dataproc-workflowtemplates-api-openapi.yml
  - type: Documentation
    url: https://cloud.google.com/dataproc/docs/reference/rest
  - type: Authentication
    url: https://cloud.google.com/dataproc/docs/concepts/iam
  - type: GettingStarted
    url: https://cloud.google.com/dataproc/docs/quickstarts
  - type: JSONSchema
    url: json-schema/cluster-schema.json
common:
- type: PostmanWorkspace
  url: https://www.postman.com/kinlaneapi/google-cloud-dataproc/overview
- type: AgenticAccess
  url: agentic-access/google-cloud-dataproc-agentic-access.yml
- type: VulnerabilityDisclosure
  url: security/google-cloud-dataproc-vulnerability-disclosure.yml
- type: DomainSecurity
  url: security/google-cloud-dataproc-domain-security.yml
- type: Authentication
  url: authentication/google-cloud-dataproc-authentication.yml
- type: OAuthScopes
  url: scopes/google-cloud-dataproc-scopes.yml
- type: GitHubOrganization
  url: https://github.com/GoogleCloudDataproc
- type: Portal
  url: https://cloud.google.com/dataproc
- type: GettingStarted
  url: https://cloud.google.com/dataproc/docs/quickstarts
- type: Documentation
  url: https://cloud.google.com/dataproc/docs
- type: Authentication
  url: https://cloud.google.com/dataproc/docs/concepts/iam
- type: Pricing
  url: https://cloud.google.com/dataproc/pricing
- type: TermsOfService
  url: https://cloud.google.com/terms
- type: PrivacyPolicy
  url: https://policies.google.com/privacy
- type: StatusPage
  url: https://status.cloud.google.com/
- type: Support
  url: https://cloud.google.com/dataproc/docs/support
- type: JSONLD
  url: json-ld/google-cloud-dataproc-context.jsonld
- type: Integrations
  url: https://cloud.google.com/marketplace
integrations:
- name: Become a Partner
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com