Google Cloud Dataflow · Arazzo Workflow

Google Cloud Dataflow List Jobs and Snapshot

Version 1.0.0

List jobs in a region, inspect the first job, then snapshot it.

1 workflow 2 source APIs 1 provider
View Spec View on GitHub Apache BeamBatch ProcessingBig DataData ProcessingETLStream ProcessingArazzoWorkflows

Provider

google-cloud-dataflow

Workflows

list-jobs-and-snapshot
List jobs in a region, read the first one, and snapshot it.
Lists jobs in a region, captures the first job id, reads that job for its state, then creates a snapshot of it.
3 steps inputs: accessToken, filter, location, projectId, ttl outputs: currentState, jobId, snapshotId
1
listJobs
List the Dataflow jobs in the requested region and capture the first job id returned in the page.
2
inspectJob
Read the first job from the list to inspect its current state before taking a snapshot.
3
snapshotJob
Create a snapshot of the inspected job, capturing its streaming state with the supplied retention window.

Source API Descriptions

Arazzo Workflow Specification

Raw ↑
arazzo: 1.0.1
info:
  title: Google Cloud Dataflow List Jobs and Snapshot
  summary: List jobs in a region, inspect the first job, then snapshot it.
  description: >-
    Discovers active jobs in a region and protects the first one with a
    snapshot. The workflow lists the jobs in a project location, captures the
    first job id from the list, reads that job to inspect its current state, then
    creates a snapshot of it so its streaming state can later seed a new job.
    Every step spells out its request inline, including the inline Bearer
    authorization Google Cloud requires, so the flow can be read and executed
    without opening the underlying OpenAPI description.
  version: 1.0.0
sourceDescriptions:
- name: jobsApi
  url: ../openapi/google-cloud-dataflow-jobs-api-openapi.yml
  type: openapi
- name: snapshotsApi
  url: ../openapi/google-cloud-dataflow-snapshots-api-openapi.yml
  type: openapi
workflows:
- workflowId: list-jobs-and-snapshot
  summary: List jobs in a region, read the first one, and snapshot it.
  description: >-
    Lists jobs in a region, captures the first job id, reads that job for its
    state, then creates a snapshot of it.
  inputs:
    type: object
    required:
    - accessToken
    - projectId
    - location
    properties:
      accessToken:
        type: string
        description: Google Cloud OAuth 2.0 access token used as a Bearer credential.
      projectId:
        type: string
        description: The Google Cloud project id that owns the jobs.
      location:
        type: string
        description: The regional endpoint that contains the jobs (e.g. us-central1).
      filter:
        type: string
        description: Optional job state filter (e.g. ACTIVE, TERMINATED, ALL).
      ttl:
        type: string
        description: Snapshot retention duration as a duration string (e.g. 604800s).
  steps:
  - stepId: listJobs
    description: >-
      List the Dataflow jobs in the requested region and capture the first job
      id returned in the page.
    operationId: listLocationJobs
    parameters:
    - name: Authorization
      in: header
      value: Bearer $inputs.accessToken
    - name: projectId
      in: path
      value: $inputs.projectId
    - name: location
      in: path
      value: $inputs.location
    - name: filter
      in: query
      value: $inputs.filter
    successCriteria:
    - condition: $statusCode == 200
    outputs:
      firstJobId: $response.body#/jobs/0/id
      nextPageToken: $response.body#/nextPageToken
  - stepId: inspectJob
    description: >-
      Read the first job from the list to inspect its current state before
      taking a snapshot.
    operationId: getLocationJob
    parameters:
    - name: Authorization
      in: header
      value: Bearer $inputs.accessToken
    - name: projectId
      in: path
      value: $inputs.projectId
    - name: location
      in: path
      value: $inputs.location
    - name: jobId
      in: path
      value: $steps.listJobs.outputs.firstJobId
    successCriteria:
    - condition: $statusCode == 200
    outputs:
      jobId: $response.body#/id
      currentState: $response.body#/currentState
  - stepId: snapshotJob
    description: >-
      Create a snapshot of the inspected job, capturing its streaming state with
      the supplied retention window.
    operationId: snapshotLocationJob
    parameters:
    - name: Authorization
      in: header
      value: Bearer $inputs.accessToken
    - name: projectId
      in: path
      value: $inputs.projectId
    - name: location
      in: path
      value: $inputs.location
    - name: jobId
      in: path
      value: $steps.inspectJob.outputs.jobId
    requestBody:
      contentType: application/json
      payload:
        ttl: $inputs.ttl
        location: $inputs.location
    successCriteria:
    - condition: $statusCode == 200
    outputs:
      snapshotId: $response.body#/id
      snapshotState: $response.body#/state
  outputs:
    jobId: $steps.inspectJob.outputs.jobId
    currentState: $steps.inspectJob.outputs.currentState
    snapshotId: $steps.snapshotJob.outputs.snapshotId

Work with this as data

Every workflow here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for arazzo workflows

4 MCP tools reach this
  • find_arazzoBrowse and filter every workflow in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This workflow
curl "https://apis.io/api/v1/arazzo/google-cloud-dataflow-list-jobs-and-snapshot-workflow"
All arazzo workflows
curl "https://apis.io/api/v1/arazzo?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.