Google Cloud Dataproc

Google Cloud Dataproc is a fully managed and highly scalable service for running Apache Spark, Apache Hadoop, Apache Flink, Presto, and other open-source data processing frameworks. It enables batch processing, querying, streaming, and machine learning use cases with cluster management that takes seconds instead of minutes, along with per-second billing and autoscaling capabilities.

Google Cloud Dataproc publishes 3 API contracts indexed on the APIs.io network: Clusters API, Jobs API, and Workflow Templates API. Tagged areas include Big Data, Data Processing, Google Cloud, Hadoop, and Spark.

The Google Cloud Dataproc catalog on APIs.io includes 1 JSON-LD context and 1 Spectral governance ruleset.

Google Cloud Dataproc’s developer surface includes authentication, developer portal, getting-started guide, documentation, pricing, support, and 16 more developer resources.

🌐 Visit website 📡 Profile data on GitHub

54.3/100 strong ▬ flat Agent 26/100 agent aware Heartbeat 100/100 alive saas Full breakdown ↓
scored 2026-11-06 · rubric v0.27.0 · Show this score on your site →

AccessFreemiumSelf serve⚡ Free to try

1 published contract

Big Data Data Processing Google Cloud Hadoop Spark

What this lets a business do 1

Business capabilities this provider's published APIs can perform, derived from its own contracts. Browse all capabilities →

Information Technology Management

BC-600

Clusters

POST /projects/{project}/regions/{region}/clusters

Kin Score

Kin Score How this is scored →
scored 2026-11-06 · rubric v0.27.0

Composite quality — 54.3/100 · strong

Contract Quality 11.0 / 19

Developer Ergonomics 7.3 / 15

Access Clarity 10.7 / 15

Operational Transparency 3.6 / 10

Contract Governance 0.9 / 9

Discoverability 5.0 / 8

Regulatory Posture 6.0 / 15

Create-or-Update Ergonomics 0.0 / 10

Agent readiness — 26/100 · agent aware

Machine-Readable Contract 18 / 18

Agentic Access Contract 10 / 10

Documented Reversibility 6 / 6

MCP Server 0 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 0 / 8

Request/Response Examples 0 / 7

Rate-Limit Signaling 7 / 7

Typed Event Surface 0 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Delegated User Identity 6 / 6

Protected Resource Metadata 0 / 5

Registration Without a Human 0 / 6

Agentic Commerce Well-Known Document 0 / 5

Pagination 5 / 5

Distinct Operations 3 / 3

MCP Tool Quality 6 / 6

Regulatory Posture applies to this provider. Its tags matched the Horizontal (data, software, accessibility, platform) regime, so Regulatory Posture carries 15 points of the composite. If this regime is wrong for your business, say so on your provider repo — the applicability map is public and we will correct it.

Create-or-Update Ergonomics applies to this provider. This API accepts writes, so it carries 10 points of the composite. It is scored from the published contracts themselves: whether a caller can create-or-update in one call, whether the write accepts a key the caller already holds, and whether the response says which branch ran. Without that, every write needs a search-and-branch in front of it, and the first time that check is skipped a duplicate record is created. Scored against the observed mean rather than raw — a provider at the catalog average is unchanged by this facet, not penalised by it.

The six quality facets above are damped to 75 points between them, because the conditional facet above carries the other 25. That is why each facet's contribution is shown against a damped maximum: raising a quality facet moves the composite by 75% of its nominal weight, not 100%. The full arithmetic is at apis.io/rating/.

Show this score on your site.

It updates itself when the score changes. Paste this where you link to your API docs:

<a href="https://apis.io/providers/google-cloud-dataproc/"><img src="https://apis.io/badge/google-cloud-dataproc/card.svg" alt="Google Cloud Dataproc on APIs.io — Kin Score by API Evangelist"></a>

Other styles, a README pill and a shields.io endpoint are on the badge page.

Raise your score.

Agent readiness — checks not met, largest first (exact, from this profile):

MCP Server +12 pts — deployment.mode + probe verdict on the mcp/ manifest, not the pointer; an unprobed slug falls back to authorship
Idempotency +9 pts — OpenAPI mutating operations declare an idempotency key — a header, a request-body property, or a named de-duplication token whose own description says so (verified); else common[].type matches /idempoten/i (documented)
Stable Error Semantics +8 pts — OpenAPI $refs a shared error schema across 4xx/5xx responses (verified), else common[].type includes ErrorCatalog / ErrorCodes / DeclineCodes
A2A Agent Card +8 pts — a2a/-a2a.yml manifest, graded on conformance.grade against A2A 1.0.0
Request/Response Examples +7 pts — share of operations carrying request/response examples; else an Examples / Code Samples link
Registration Without a Human +6 pts — a `registration_endpoint` in the served RFC 8414 / OIDC discovery document

7 more unmet checks in the Agent Readiness table above.

Kin Score — facets with the most composite points still available (weight × headroom):

Contract Governance scores 9.8 — up to +10.8 composite points
Contract Quality scores 58.7 — up to +10.3 composite points
Developer Ergonomics scores 48.8 — up to +10.2 composite points

Each check links to what satisfies it. Publish the artifact, or tell us where it already lives, and the score moves on the next scoring run.

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from the provider profile at artifacts.apis.io/google-cloud-dataproc/apis.yml: open an issue on github.com/api-evangelist/google-cloud-dataproc to ask a question or point us at an artifact you publish. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

Standards implemented 2

Standards this provider implements or carries. De facto ones are profiled and measured by the API Commons; formal ones come from the standards directory and are linked by the provider's own tags. The evidence column says how each claim was established — not that it was made.

OpenAPI

measured — observed by APIs.io (published)

OAuth 2.0

measured — observed by APIs.io (declared)

APIs 3

Individual APIs this provider publishes, each with its own machine-readable definition.

Google Cloud Dataproc Clusters API

Operations on Dataproc clusters

Google Cloud Dataproc Jobs API

Operations on Dataproc jobs

Google Cloud Dataproc Workflow Templates API

Operations on workflow templates

Postman Collections 3

Ready-to-run Postman collections for exercising this provider's APIs.

Google Cloud Dataproc Clusters API

POSTMAN

Google Cloud Dataproc Clusters Jobs API

POSTMAN

Google Cloud Dataproc Clusters WorkflowTemplates API

POSTMAN

Open Collections 4

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

Google Cloud Dataproc API

OPEN COLLECTION

Google Cloud Dataproc Clusters API

OPEN COLLECTION

Google Cloud Dataproc Clusters Jobs API

OPEN COLLECTION

Google Cloud Dataproc Clusters WorkflowTemplates API

OPEN COLLECTION

Google Cloud Dataproc API pricing

Prices published by Google Cloud Dataproc, read 2026-10-28 from cloud.google.com/products/managed-service-for-apache-spar....

Plan	Price
Data Compute Unit (standard)	$0.06 per hour
Data Compute Unit (premium)	$0.089 per hour
Data Compute Unit (standard) - BigQuery CUD 1 Year	$0.054 per hour
Data Compute Unit (standard) - BigQuery CUD 3 Year	$0.048 per hour
Data Compute Unit (premium) - BigQuery CUD 1 Year	$0.0801 per hour
Data Compute Unit (premium) - BigQuery CUD 3 Year	$0.0712 per hour
Shuffle Storage (standard)	$0.000054795/ 1 gibibyte hour
Shuffle Storage (premium)	$0.000136986/ 1 gibibyte hour

All 14 plans, limits and sources →

Rate limits

Free Tier Default: 10 requests per minute
Free Tier Monthly Quota: 1000 requests per month
Professional Tier Default: 100 requests per minute

Compiled by API Evangelist, not yet checked against Google Cloud Dataproc's documentation. All 5 limits →

Billed by: hour · FinOps profile →

Pricing Plans 1

Published pricing tiers and plan structures.

Google Cloud Dataproc Plans Pricing

14 plans

PLANS

Rate Limits 1

Documented rate limits and quota policies.

Google Cloud Dataproc Rate Limits

5 limits

RATE LIMITS

Service Levels 1

Uptime the provider promises or reports, as SLA4OAI. Read from its own pages; APIs.io runs no monitors.

Google Cloud Dataproc

SLA

FinOps 1

Cost, billing, and metering signals for API financial operations.

Google Cloud Dataproc Finops

FINOPS

Semantic Vocabularies 1

JSON-LD contexts and semantic vocabularies used across these APIs.

Google Cloud Dataproc Context

21 classes · 0 properties

JSON-LD

Spectral Rules 1

Spectral governance rulesets for linting and validating these APIs.

Google Cloud Dataproc — jsonschema rules

5 rules · 3 warnings 2 info

SPECTRAL

JSON Schema 1

Standalone JSON Schema definitions for this provider's data models.

Google Cloud Dataproc Cluster

6 properties

JSON SCHEMA

Security Posture 3

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Google Cloud Dataproc Authentication

oauth2 · 1 scheme

SECURITY

Google Cloud Dataproc Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Google Cloud Dataproc Vulnerability Disclosure

security.txt · contact published

SECURITY

Scopes 1

OAuth scopes governing access to this provider's APIs.

Google Cloud Dataproc Scopes

1 scope · authorizationCode

1 scopes

SCOPES

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Google Cloud Dataproc Agentic Access

12 operations · 7 acting

AGENTIC

Resources

Get Started 2

Portal, sign-up, and the first successful call

Portal

Portal

GettingStarted

GettingStarted

Documentation 1

Reference material describing how the API behaves

Documentation

Documentation

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess

AgenticAccess

Design & Contract 1

Pagination, idempotency, versioning, errors, and events

JSONLD

JSONLD

Build 2

SDKs, sample code, and the tooling you integrate with

PostmanWorkspace

PostmanWorkspace

GitHubOrganization

GitHubOrganization

Access & Security 5

Authentication, authorization, and security posture

VulnerabilityDisclosure

VulnerabilityDisclosure

DomainSecurity

Authentication

OAuthScopes

Authentication

Operate 3

Status, limits, changes, and where to get help

RateLimits

RateLimits

StatusPage

StatusPage

Support

Support

Commercial 5

Pricing, plans, and the legal terms of use

Plans

FinOps

Pricing

TermsOfService

PrivacyPolicy

Company 1

The organization behind the API

Website

Website

Other 1

Properties that don't map to a standard resource type

CapabilityMap

CapabilityMap

Source (apis.yml)

aid: google-cloud-dataproc
name: Google Cloud Dataproc
description: Google Cloud Dataproc is a fully managed and highly scalable service for running Apache Spark, Apache Hadoop,
  Apache Flink, Presto, and other open-source data processing frameworks. It enables batch processing, querying, streaming,
  and machine learning use cases with cluster management that takes seconds instead of minutes, along with per-second billing
  and autoscaling capabilities.
deliveryModel:
  model: saas
  open_source: false
  commercial: true
  callable_host: true
  label: Hosted service · you call their endpoint
  confidence: high
  source:
  - openapi
  - pricing
  generated: '2026-08-28'
  method: derived
accessModel:
  pricing: freemium
  onboarding: self-serve
  trial: false
  try_now: true
  public: false
  gated: none
  gated_source:
  - onboarding
  label: Freemium · Self-serve signup
  confidence: medium
  source:
  - plans
  - authentication
  - security
  generated: '2026-11-06'
  method: derived
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/google-cloud-dataproc.png
url: https://raw.githubusercontent.com/api-evangelist/google-cloud-dataproc/refs/heads/main/apis.yml
created: '2026-03-13'
modified: '2026-05-19'
specificationVersion: '0.23'
type: Index
tags:
- Big Data
- Data Processing
- Google Cloud
- Hadoop
- Spark
apis:
- aid: google-cloud-dataproc:google-cloud-dataproc-clusters-api
  name: Google Cloud Dataproc Clusters API
  description: Operations on Dataproc clusters
  humanURL: https://cloud.google.com/dataproc/docs
  baseURL: https://dataproc.googleapis.com/v1
  tags:
  - Cluster
  tags_raw:
  - Clusters
  properties:
  - type: OpenAPI
    url: openapi/google-cloud-dataproc-clusters-api-openapi.yml
  - type: Documentation
    url: https://cloud.google.com/dataproc/docs/reference/rest
  - type: Authentication
    url: https://cloud.google.com/dataproc/docs/concepts/iam
  - type: GettingStarted
    url: https://cloud.google.com/dataproc/docs/quickstarts
  - type: JSONSchema
    url: json-schema/cluster-schema.json
- aid: google-cloud-dataproc:google-cloud-dataproc-jobs-api
  name: Google Cloud Dataproc Jobs API
  description: Operations on Dataproc jobs
  humanURL: https://cloud.google.com/dataproc/docs
  baseURL: https://dataproc.googleapis.com/v1
  tags:
  - Job
  tags_raw:
  - Jobs
  properties:
  - type: OpenAPI
    url: openapi/google-cloud-dataproc-jobs-api-openapi.yml
  - type: Documentation
    url: https://cloud.google.com/dataproc/docs/reference/rest
  - type: Authentication
    url: https://cloud.google.com/dataproc/docs/concepts/iam
  - type: GettingStarted
    url: https://cloud.google.com/dataproc/docs/quickstarts
  - type: JSONSchema
    url: json-schema/cluster-schema.json
- aid: google-cloud-dataproc:google-cloud-dataproc-workflow-templates-api
  name: Google Cloud Dataproc Workflow Templates API
  description: Operations on workflow templates
  humanURL: https://cloud.google.com/dataproc/docs
  baseURL: https://dataproc.googleapis.com/v1
  tags:
  - WorkflowTemplates
  tags_raw:
  - Workflow Templates
  properties:
  - type: OpenAPI
    url: openapi/google-cloud-dataproc-workflow-templates-api-openapi.yml
  - type: Documentation
    url: https://cloud.google.com/dataproc/docs/reference/rest
  - type: Authentication
    url: https://cloud.google.com/dataproc/docs/concepts/iam
  - type: GettingStarted
    url: https://cloud.google.com/dataproc/docs/quickstarts
  - type: JSONSchema
    url: json-schema/cluster-schema.json
common:
- type: Plans
  url: plans/google-cloud-dataproc-plans-pricing.yml
- type: RateLimits
  url: rate-limits/google-cloud-dataproc-rate-limits.yml
- type: FinOps
  url: finops/google-cloud-dataproc-finops.yml
- type: CapabilityMap
  url: capabilities/google-cloud-dataproc-capability-edges.yml
  name: Google Cloud Dataproc Business Capability Map
- type: Website
  url: https://www.google.com/
- type: PostmanWorkspace
  url: https://www.postman.com/kinlaneapi/google-cloud-dataproc/overview
- type: AgenticAccess
  url: agentic-access/google-cloud-dataproc-agentic-access.yml
- type: VulnerabilityDisclosure
  url: security/google-cloud-dataproc-vulnerability-disclosure.yml
- type: DomainSecurity
  url: security/google-cloud-dataproc-domain-security.yml
- type: Authentication
  url: authentication/google-cloud-dataproc-authentication.yml
- type: OAuthScopes
  url: scopes/google-cloud-dataproc-scopes.yml
- type: GitHubOrganization
  url: https://github.com/GoogleCloudDataproc
- type: Portal
  url: https://cloud.google.com/dataproc
- type: GettingStarted
  url: https://cloud.google.com/dataproc/docs/quickstarts
- type: Documentation
  url: https://cloud.google.com/dataproc/docs
- type: Authentication
  url: https://cloud.google.com/dataproc/docs/concepts/iam
- type: Pricing
  url: https://cloud.google.com/dataproc/pricing
- type: TermsOfService
  url: https://cloud.google.com/terms
- type: PrivacyPolicy
  url: https://policies.google.com/privacy
- type: StatusPage
  url: https://status.cloud.google.com/
- type: Support
  url: https://cloud.google.com/dataproc/docs/support
- type: JSONLD
  url: json-ld/google-cloud-dataproc-context.jsonld
- type: Integrations
  url: https://cloud.google.com/marketplace
integrations:
- name: Become a Partner
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
x-parent: google-cloud-platform
x-relationship: product

Google Cloud Dataproc API — frequently asked questions

Does Google Cloud Dataproc have an API?

Yes. APIs.io lists 3 APIs from Google Cloud Dataproc, including Google Cloud Dataproc Clusters API, Google Cloud Dataproc Jobs API and Google Cloud Dataproc Workflow Templates API.

Is there an OpenAPI specification for the Google Cloud Dataproc API?

Yes. APIs.io indexes 3 OpenAPI specifications for Google Cloud Dataproc, each linked for download from this page.

How do I authenticate with the Google Cloud Dataproc API?

Google Cloud Dataproc documents its authentication (oauth2 · 1 scheme). The details are profiled on APIs.io as Google Cloud Dataproc Authentication.

How much does the Google Cloud Dataproc API cost?

Google Cloud Dataproc publishes its prices; its Data Compute Unit (standard) plan is $0.06 per hour as of 2026-10-28. APIs.io lists 14 pricing plans for Google Cloud Dataproc, with each plan's price, limits and inclusions under Pricing on this page.

Is the Google Cloud Dataproc API ready for AI agents?

Google Cloud Dataproc has a Kin Score of 54.3 out of 100 (strong) and an Agent Readiness score of 26.3 (agent-aware), scored by API Evangelist on 2026-11-06.

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this

find_providersBrowse and filter every provider in the catalog.
get_provider_artifactsEvery artifact this provider publishes, grouped by type.
get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
get_provider_ratingPRO — composite, band, trend and facet scores.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This provider

curl "https://apis.io/api/v1/providers/google-cloud-dataproc"

All providers

curl "https://apis.io/api/v1/providers?limit=25"

Every operation they expose

curl "https://apis.io/api/v1/providers/google-cloud-dataproc/operations?limit=25"

How their score was established

curl "https://apis.io/api/v1/providers/google-cloud-dataproc/evidence"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.