Google Cloud Dataflow Jobs API

Operations for creating, managing, and monitoring Dataflow jobs.

Operations 10

GET /v1b3/projects/{projectId}/jobs:aggregated Google Cloud Dataflow List aggregated jobs across all regions #
GET /v1b3/projects/{projectId}/jobs Google Cloud Dataflow List jobs in a project #
POST /v1b3/projects/{projectId}/jobs Google Cloud Dataflow Create a Dataflow job in a project #
GET /v1b3/projects/{projectId}/jobs/{jobId} Google Cloud Dataflow Get a Dataflow job in a project #
PUT /v1b3/projects/{projectId}/jobs/{jobId} Google Cloud Dataflow Update a Dataflow job in a project #
GET /v1b3/projects/{projectId}/locations/{location}/jobs Google Cloud Dataflow List jobs in a specific location #
POST /v1b3/projects/{projectId}/locations/{location}/jobs Google Cloud Dataflow Create a Dataflow job in a specific location #
GET /v1b3/projects/{projectId}/locations/{location}/jobs/{jobId} Google Cloud Dataflow Get a Dataflow job in a specific location #
PUT /v1b3/projects/{projectId}/locations/{location}/jobs/{jobId} Google Cloud Dataflow Update a Dataflow job in a specific location #
GET /v1b3/projects/{projectId}/locations/{location}/jobs/{jobId}/executionDetails Google Cloud Dataflow Get execution details for a Dataflow job #

Documentation

Specifications

Schemas & Data

Other Resources

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API
curl "https://apis.io/api/v1/apis/google-cloud-dataflow-jobs-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

google-cloud-dataflow-jobs-api-openapi.yml Raw ↑
openapi: 3.2.0
info:
  title: Google Cloud Dataflow Debug Jobs API
  description: Manages Google Cloud Dataflow projects on Google Cloud Platform for creating and managing data processing pipelines, including job submission, monitoring, and resource management for both batch and streaming workloads.
  version: v1b3
  termsOfService: https://cloud.google.com/terms
  contact:
    name: Google Cloud Support
    url: https://cloud.google.com/dataflow/docs/support
  license:
    name: Creative Commons Attribution 4.0
    url: https://creativecommons.org/licenses/by/4.0/
servers:
- url: https://dataflow.googleapis.com
  description: Google Cloud Dataflow API production endpoint
security:
- oauth2: []
- apiKey: []
tags:
- name: Jobs
  description: Operations for creating, managing, and monitoring Dataflow jobs.
paths:
  /v1b3/projects/{projectId}/jobs:aggregated:
    get:
      operationId: listAggregatedJobs
      summary: Google Cloud Dataflow List aggregated jobs across all regions
      description: Lists all Dataflow jobs associated with the specified project across all regions. Returns a paginated list of jobs including their current state, type, and metadata.
      tags:
      - Jobs
      parameters:
      - $ref: '#/components/parameters/projectId'
      - $ref: '#/components/parameters/pageToken'
      - $ref: '#/components/parameters/pageSize'
      - $ref: '#/components/parameters/jobView'
      - $ref: '#/components/parameters/jobFilter'
      - $ref: '#/components/parameters/jobName'
      responses:
        '200':
          description: Successful response containing the list of jobs.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ListJobsResponse'
        '400':
          $ref: '#/components/responses/BadRequest'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '404':
          $ref: '#/components/responses/NotFound'
        '429':
          $ref: '#/components/responses/TooManyRequests'
        '500':
          $ref: '#/components/responses/InternalServerError'
  /v1b3/projects/{projectId}/jobs:
    get:
      operationId: listProjectJobs
      summary: Google Cloud Dataflow List jobs in a project
      description: Lists all Dataflow jobs associated with the specified project. Returns a paginated list that can be filtered by state and name. Use the location- specific endpoint for regional job listing.
      tags:
      - Jobs
      parameters:
      - $ref: '#/components/parameters/projectId'
      - $ref: '#/components/parameters/pageToken'
      - $ref: '#/components/parameters/pageSize'
      - $ref: '#/components/parameters/jobView'
      - $ref: '#/components/parameters/jobFilter'
      - $ref: '#/components/parameters/jobName'
      - $ref: '#/components/parameters/location'
      responses:
        '200':
          description: Successful response containing the list of jobs.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ListJobsResponse'
        '400':
          $ref: '#/components/responses/BadRequest'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '429':
          $ref: '#/components/responses/TooManyRequests'
        '500':
          $ref: '#/components/responses/InternalServerError'
    post:
      operationId: createProjectJob
      summary: Google Cloud Dataflow Create a Dataflow job in a project
      description: Creates a new Dataflow job in the specified project. The job definition includes the pipeline configuration, environment settings, and execution parameters for batch or streaming workloads.
      tags:
      - Jobs
      parameters:
      - $ref: '#/components/parameters/projectId'
      - $ref: '#/components/parameters/jobView'
      - name: replaceJobId
        in: query
        description: Deprecated. The ID of the job to replace when updating a pipeline.
        schema:
          type: string
      - $ref: '#/components/parameters/location'
      requestBody:
        required: true
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/Job'
      responses:
        '200':
          description: Successful response containing the created job.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Job'
        '400':
          $ref: '#/components/responses/BadRequest'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '409':
          $ref: '#/components/responses/Conflict'
        '429':
          $ref: '#/components/responses/TooManyRequests'
        '500':
          $ref: '#/components/responses/InternalServerError'
  /v1b3/projects/{projectId}/jobs/{jobId}:
    get:
      operationId: getProjectJob
      summary: Google Cloud Dataflow Get a Dataflow job in a project
      description: Retrieves the state of a specified Dataflow job in the given project. Returns the full job resource including current state, pipeline description, environment, and metadata.
      tags:
      - Jobs
      parameters:
      - $ref: '#/components/parameters/projectId'
      - $ref: '#/components/parameters/jobId'
      - $ref: '#/components/parameters/jobView'
      - $ref: '#/components/parameters/location'
      responses:
        '200':
          description: Successful response containing the job details.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Job'
        '400':
          $ref: '#/components/responses/BadRequest'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '404':
          $ref: '#/components/responses/NotFound'
        '429':
          $ref: '#/components/responses/TooManyRequests'
        '500':
          $ref: '#/components/responses/InternalServerError'
    put:
      operationId: updateProjectJob
      summary: Google Cloud Dataflow Update a Dataflow job in a project
      description: Updates the state of an existing Dataflow job in the specified project. This is primarily used to change the requested state of a job, such as cancelling or draining a running job.
      tags:
      - Jobs
      parameters:
      - $ref: '#/components/parameters/projectId'
      - $ref: '#/components/parameters/jobId'
      - $ref: '#/components/parameters/location'
      - name: updateMask
        in: query
        description: The list of fields to update relative to the job. If empty, only the requestedState field will be considered.
        schema:
          type: string
      requestBody:
        required: true
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/Job'
      responses:
        '200':
          description: Successful response containing the updated job.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Job'
        '400':
          $ref: '#/components/responses/BadRequest'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '404':
          $ref: '#/components/responses/NotFound'
        '429':
          $ref: '#/components/responses/TooManyRequests'
        '500':
          $ref: '#/components/responses/InternalServerError'
  /v1b3/projects/{projectId}/locations/{location}/jobs:
    get:
      operationId: listLocationJobs
      summary: Google Cloud Dataflow List jobs in a specific location
      description: Lists all Dataflow jobs associated with the specified project in the given regional location. Returns a paginated list that can be filtered by state and name.
      tags:
      - Jobs
      parameters:
      - $ref: '#/components/parameters/projectId'
      - $ref: '#/components/parameters/locationPath'
      - $ref: '#/components/parameters/pageToken'
      - $ref: '#/components/parameters/pageSize'
      - $ref: '#/components/parameters/jobView'
      - $ref: '#/components/parameters/jobFilter'
      - $ref: '#/components/parameters/jobName'
      responses:
        '200':
          description: Successful response containing the list of jobs.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ListJobsResponse'
        '400':
          $ref: '#/components/responses/BadRequest'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '429':
          $ref: '#/components/responses/TooManyRequests'
        '500':
          $ref: '#/components/responses/InternalServerError'
    post:
      operationId: createLocationJob
      summary: Google Cloud Dataflow Create a Dataflow job in a specific location
      description: Creates a new Dataflow job in the specified project and regional location. The job definition includes the pipeline configuration, environment settings, and execution parameters.
      tags:
      - Jobs
      parameters:
      - $ref: '#/components/parameters/projectId'
      - $ref: '#/components/parameters/locationPath'
      - $ref: '#/components/parameters/jobView'
      - name: replaceJobId
        in: query
        description: Deprecated. The ID of the job to replace when updating a pipeline.
        schema:
          type: string
      requestBody:
        required: true
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/Job'
      responses:
        '200':
          description: Successful response containing the created job.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Job'
        '400':
          $ref: '#/components/responses/BadRequest'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '409':
          $ref: '#/components/responses/Conflict'
        '429':
          $ref: '#/components/responses/TooManyRequests'
        '500':
          $ref: '#/components/responses/InternalServerError'
  /v1b3/projects/{projectId}/locations/{location}/jobs/{jobId}:
    get:
      operationId: getLocationJob
      summary: Google Cloud Dataflow Get a Dataflow job in a specific location
      description: Retrieves the state of a specified Dataflow job in the given project and regional location. Returns the full job resource including current state, pipeline description, environment, and metadata.
      tags:
      - Jobs
      parameters:
      - $ref: '#/components/parameters/projectId'
      - $ref: '#/components/parameters/locationPath'
      - $ref: '#/components/parameters/jobId'
      - $ref: '#/components/parameters/jobView'
      responses:
        '200':
          description: Successful response containing the job details.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Job'
        '400':
          $ref: '#/components/responses/BadRequest'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '404':
          $ref: '#/components/responses/NotFound'
        '429':
          $ref: '#/components/responses/TooManyRequests'
        '500':
          $ref: '#/components/responses/InternalServerError'
    put:
      operationId: updateLocationJob
      summary: Google Cloud Dataflow Update a Dataflow job in a specific location
      description: Updates the state of an existing Dataflow job in the specified project and regional location. This is primarily used to change the requested state of a job, such as cancelling or draining a running job.
      tags:
      - Jobs
      parameters:
      - $ref: '#/components/parameters/projectId'
      - $ref: '#/components/parameters/locationPath'
      - $ref: '#/components/parameters/jobId'
      - name: updateMask
        in: query
        description: The list of fields to update relative to the job. If empty, only the requestedState field will be considered.
        schema:
          type: string
      requestBody:
        required: true
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/Job'
      responses:
        '200':
          description: Successful response containing the updated job.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/Job'
        '400':
          $ref: '#/components/responses/BadRequest'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '404':
          $ref: '#/components/responses/NotFound'
        '429':
          $ref: '#/components/responses/TooManyRequests'
        '500':
          $ref: '#/components/responses/InternalServerError'
  /v1b3/projects/{projectId}/locations/{location}/jobs/{jobId}/executionDetails:
    get:
      operationId: getLocationJobExecutionDetails
      summary: Google Cloud Dataflow Get execution details for a Dataflow job
      description: Retrieves detailed execution status information for a specified Dataflow job in the given project and regional location. Returns information about the stages of the pipeline and their execution status.
      tags:
      - Jobs
      parameters:
      - $ref: '#/components/parameters/projectId'
      - $ref: '#/components/parameters/locationPath'
      - $ref: '#/components/parameters/jobId'
      - $ref: '#/components/parameters/pageToken'
      - $ref: '#/components/parameters/pageSize'
      responses:
        '200':
          description: Successful response containing the job execution details.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/JobExecutionDetails'
        '400':
          $ref: '#/components/responses/BadRequest'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '404':
          $ref: '#/components/responses/NotFound'
        '429':
          $ref: '#/components/responses/TooManyRequests'
        '500':
          $ref: '#/components/responses/InternalServerError'
components:
  responses:
    NotFound:
      description: The requested resource was not found. Verify the project ID, job ID, or other resource identifiers.
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Status'
    Unauthorized:
      description: Authentication credentials were missing or invalid. Provide valid OAuth 2.0 credentials or API key.
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Status'
    Conflict:
      description: The request conflicts with the current state of the resource, such as attempting to create a job with a name that already exists.
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Status'
    InternalServerError:
      description: An internal server error occurred. Retry the request using exponential backoff.
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Status'
    Forbidden:
      description: The caller does not have sufficient permissions to perform this operation. Verify IAM roles and permissions.
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Status'
    BadRequest:
      description: The request was invalid or malformed. Check the request parameters and body for errors.
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Status'
    TooManyRequests:
      description: The request was rate-limited. Retry the request after a brief delay using exponential backoff.
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Status'
  schemas:
    JobType:
      type: string
      description: The type of Dataflow job, indicating batch or streaming execution.
      enum:
      - JOB_TYPE_UNKNOWN
      - JOB_TYPE_BATCH
      - JOB_TYPE_STREAMING
    MetricStructuredName:
      type: object
      description: Identifies a metric, using both the key and the context in which it appears.
      properties:
        origin:
          type: string
          description: Origin (namespace) of metric name. May be blank for user-defined metrics. Typical values are dataflow/v1b3 and user.
        name:
          type: string
          description: Worker-defined metric name.
        context:
          type: object
          description: Zero or more labeled fields that identify the part of the job this metric is associated with.
          additionalProperties:
            type: string
    ComponentSource:
      type: object
      description: An identification of a collection produced or consumed by a component transform.
      properties:
        userName:
          type: string
          description: Human-readable name for this source.
        name:
          type: string
          description: Dataflow service generated name for this source.
        originalTransformOrCollection:
          type: string
          description: User name for the original user transform or collection this source corresponds to.
    StragglerSummary:
      type: object
      description: Summarizes straggler information within a stage.
      properties:
        totalStragglerCount:
          type: string
          format: int64
          description: The total count of stragglers.
        stragglerDelineation:
          type: array
          description: The straggler delineation, per straggler cause.
          items:
            $ref: '#/components/schemas/StragglerDelineation'
    ExecutionStageState:
      type: object
      description: Describes the state of a particular execution stage within a Dataflow job.
      properties:
        executionStageName:
          type: string
          description: The name of the execution stage.
        executionStageState:
          $ref: '#/components/schemas/JobState'
        currentStateTime:
          type: string
          format: date-time
          description: The time at which the stage entered its current state.
    RuntimeUpdatableParams:
      type: object
      description: Additional job parameters that can be updated during execution without stopping the job.
      properties:
        maxNumWorkers:
          type: integer
          format: int32
          description: The maximum number of workers for autoscaling.
        minNumWorkers:
          type: integer
          format: int32
          description: The minimum number of workers for autoscaling.
        workerUtilizationHint:
          type: number
          format: double
          description: Target worker utilization between 0.1 and 0.9, used by the autoscaler to determine when to scale.
    StageSummary:
      type: object
      description: Information about a particular execution stage of a job.
      properties:
        stageId:
          type: string
          description: ID of this stage.
        state:
          $ref: '#/components/schemas/ExecutionState'
        startTime:
          type: string
          format: date-time
          description: Start time of this stage.
        endTime:
          type: string
          format: date-time
          description: End time of this stage. Not set if the stage is still running.
        progress:
          $ref: '#/components/schemas/ProgressTimeseries'
        metrics:
          type: array
          description: Metrics for this stage.
          items:
            $ref: '#/components/schemas/MetricUpdate'
        stragglerSummary:
          $ref: '#/components/schemas/StragglerSummary'
    TransformSummary:
      type: object
      description: Description of a transform executed as part of a Dataflow job.
      properties:
        kind:
          type: string
          description: The type of transform.
          enum:
          - UNKNOWN_KIND
          - PAR_DO_KIND
          - GROUP_BY_KEY_KIND
          - FLATTEN_KIND
          - READ_KIND
          - WRITE_KIND
          - CONSTANT_KIND
          - SINGLETON_KIND
          - SHUFFLE_KIND
        id:
          type: string
          description: SDK-generated unique identifier of the transform.
        name:
          type: string
          description: User-provided name of the transform.
        displayData:
          type: array
          description: Transform-specific display data.
          items:
            $ref: '#/components/schemas/DisplayData'
        outputCollectionName:
          type: array
          description: User names for the output collections of this transform.
          items:
            type: string
        inputCollectionName:
          type: array
          description: User names for the input collections of this transform.
          items:
            type: string
    Environment:
      type: object
      description: Describes the environment in which a Dataflow job runs, including worker pool configuration, networking, and runtime settings.
      properties:
        tempStoragePrefix:
          type: string
          description: The prefix of the Cloud Storage path for temporary storage used during job execution.
        clusterManagerApiService:
          type: string
          description: The type of cluster manager API to use for managing workers.
        experiments:
          type: array
          description: A list of experiment flags passed to the SDK and Dataflow service for enabling experimental features.
          items:
            type: string
        serviceOptions:
          type: array
          description: A list of service-level feature flags for the Dataflow service.
          items:
            type: string
        serviceKmsKeyName:
          type: string
          description: 'The Cloud KMS key used for encrypting data at rest. Format: projects/{project}/locations/{location}/keyRings/{keyRing}/cryptoKeys/{key}.'
        workerPools:
          type: array
          description: The worker pool configuration for the job. Each pool defines the machine type, disk, network, and autoscaling settings.
          items:
            $ref: '#/components/schemas/WorkerPool'
        userAgent:
          type: object
          description: A structure describing the SDK and its version used by the job.
          additionalProperties: true
        version:
          type: object
          description: A structure describing which version of the Dataflow service the job requires.
          additionalProperties: true
        dataset:
          type: string
          description: 'The BigQuery dataset for workflow logging tables. Format: bigquery.googleapis.com/projects/{project}/datasets/{dataset}.'
        sdkPipelineOptions:
          type: object
          description: The Cloud Dataflow SDK pipeline options specified by the user, passed through to the SDK without modification.
          additionalProperties: true
        serviceAccountEmail:
          type: string
          description: The email address of the service account to run the workers as.
        flexResourceSchedulingGoal:
          type: string
          description: Which Flexible Resource Scheduling mode to run in for Flex RS jobs.
          enum:
          - FLEXRS_UNSPECIFIED
          - FLEXRS_SPEED_OPTIMIZED
          - FLEXRS_COST_OPTIMIZED
        workerRegion:
          type: string
          description: The Compute Engine region where workers should be created. Overrides the default location.
        workerZone:
          type: string
          description: The specific Compute Engine zone where workers should be created.
        shuffleMode:
          type: string
          description: The shuffle mode for the job, set by the service.
          readOnly: true
          enum:
          - SHUFFLE_MODE_UNSPECIFIED
          - VM_BASED
          - SERVICE_BASED
        debugOptions:
          $ref: '#/components/schemas/DebugOptions'
        streamingMode:
          type: string
          description: The streaming mode for the job, specifying the message processing guarantee.
          enum:
          - STREAMING_MODE_UNSPECIFIED
          - STREAMING_MODE_EXACTLY_ONCE
          - STREAMING_MODE_AT_LEAST_ONCE
    StragglerDelineation:
      type: object
      description: Information useful for straggler identification and debugging.
      properties:
        stragglerCause:
          type: string
          description: The straggler cause.
          enum:
          - STRAGGLER_CAUSE_UNKNOWN
          - STRAGGLER_CAUSE_KEY
        stragglerCount:
          type: string
          format: int64
          description: The number of stragglers of this type.
    BigTableIODetails:
      type: object
      description: Metadata for a Cloud Bigtable connector used by the job.
      properties:
        projectId:
          type: string
          description: ProjectId accessed in the connection.
        instanceId:
          type: string
          description: InstanceId accessed in the connection.
        tableId:
          type: string
          description: TableId accessed in the connection.
    ListJobsResponse:
      type: object
      description: Response to a request to list Dataflow jobs. This may be a partial response, requiring pagination to retrieve all jobs.
      properties:
        jobs:
          type: array
          description: A subset of the requested job information.
          items:
            $ref: '#/components/schemas/Job'
        nextPageToken:
          type: string
          description: Set if there may be more results than have been returned. Provide this value as the pageToken in a subsequent request to retrieve additional results.
        failedLocation:
          type: array
          description: Zero or more regional endpoints that failed to respond to the list request.
          items:
            $ref: '#/components/schemas/FailedLocation'
    FailedLocation:
      type: object
      description: Indicates which regional endpoint failed to respond.
      properties:
        name:
          type: string
          description: The name of the failed location, typically a regional endpoint such as us-central1.
    AutoscalingSettings:
      type: object
      description: Settings for autoscaling the number of worker instances in a pool.
      properties:
        algorithm:
          type: string
          description: The autoscaling algorithm to use.
          enum:
          - AUTOSCALING_ALGORITHM_UNKNOWN
          - AUTOSCALING_ALGORITHM_NONE
          - AUTOSCALING_ALGORITHM_BASIC
        maxNumWorkers:
          type: integer
          format: int32
          description: The maximum number of workers to scale up to.
    JobMetadata:
      type: object
      description: Metadata available primarily for filtering jobs. Represents information about the external data sources and sinks used by the job.
      properties:
        sdkVersion:
          $ref: '#/components/schemas/SdkVersion'
        spannerDetails:
          type: array
          description: Identification of Cloud Spanner sources used by this job.
          items:
            $ref: '#/components/schemas/SpannerIODetails'
        bigqueryDetails:
          type: array
          description: Identification of BigQuery sources used by this job.
          items:
            $ref: '#/components/schemas/BigQueryIODetails'
        bigTableDetails:
          type: array
          description: Identification of Cloud Bigtable sources used by this job.
          items:
            $ref: '#/components/schemas/BigTableIODetails'
        pubsubDetails:
          type: array
          description: Identification of Pub/Sub sources used by this job.
          items:
            $ref: '#/components/schemas/PubSubIODetails'
        fileDetails:
          type: array
          description: Identification of file-based sources used by this job.
          items:
            $ref: '#/components/schemas/FileIODetails'
        datastoreDetails:
          type: array
          description: Identification of Datastore sources used by this job.
          items:
            $ref: '#/components/schemas/DatastoreIODetails'
        userDisplayProperties:
          type: object
          description: User-supplied properties for display in the Dataflow monitoring UI.
          additionalProperties:
            type: string
    PubSubIODetails:
      type: object
      description: Metadata for a Pub/Sub connector used by the job.
      properties:
        topic:
          type: string
          description: Topic accessed in the connection.
        subscription:
          type: string
          description: Subscription used in the connection.
    Package:
      type: object
      description: Describes a package to be installed on worker instances.
      properties:
        name:
          type: string
          description: The name of the package.
        location:
          type: string
          description: The Cloud Storage location of the package.
    PipelineDescription:
      type: object
      description: A descriptive representation of a pipeline, providing structural information about the stages and transforms in the pipeline graph.
      properties:
        originalPipelineTransform:
          type: array
          description: Description of each transform in the pipeline as provided by the user.
          items:
            $ref: '#/components/schemas/TransformSummary'
        executionPipelineStage:
          type: array
          description: Description of each stage of execution after the pipeline has been optimized by the service.
          items:
            $ref: '#/components/schemas/ExecutionStageSummary'
        displayData:
          type: array
          description: Pipeline level display data.
          items:
            $ref: '#/components/schemas/DisplayData'
    DebugOptions:
      type: object
      description: Describes debugging options for a Dataflow job.
      properties:
        enableHotKeyLogging:
          type: boolean
          description: When true, enables logging of hot key detections during job execution.
    BigQueryIODetails:
      type: object
      description: Metadata for a BigQuery connector used by the job.
      properties:
        table:
          type: string
          description: Table accessed in the connection.
        dataset:
          type: string
          description: Dataset accessed in the connection.
        projectId:
          type: string
          description: Project accessed in the connection.
        query:
          type: string
          description: Query used to access data in the connection.
    JobExecutionDetails:
      type: object
      description: Information about the execution of a job, including per-stage execution details.
      properties:
        stages:
          type: array
          description: The stages of the job execution.
          items:
            $ref: '#/components/schemas/StageSummary'
        nextPageToken:
          type: string
          description: If present, this response is incomplete. Retrieve the next page of results by passing this value as the pageToken.
    Status:
      type: object
      description: The Status type defines a logical error model, compatible with gRPC and Google API error conventions.
      properties:
        code:
          type: integer
          format: int32
          description: The status code, which should be an enum value of google.rpc.Code.
        message:
          type: string
          description: A developer-facing error message, which should be in English.
        details:
          type: array
          description: A list of messages that carry the error details.
          items:
            type: object
            additionalProperties: true
    ProgressTimeseries:
      type: object
      description: Information about the progress of some component of job execution.
      properties:
        currentProgress:
          type: number
          format: double
          des

# --- truncated at 32 KB (51 KB total) ---
# Full source: https://raw.githubusercontent.com/api-evangelist/google-cloud-dataflow/refs/heads/main/openapi/google-cloud-dataflow-jobs-api-openapi.yml