Azure Synapse Analytics SparkBatch API

The SparkBatch API from Azure Synapse Analytics — 2 operation(s) for sparkbatch.

Operations 4

GET /livyApi/versions/{sparkPoolName}/batches Azure Synapse Analytics List Spark batch jobs #
POST /livyApi/versions/{sparkPoolName}/batches Azure Synapse Analytics Create a Spark batch job #
GET /livyApi/versions/{sparkPoolName}/batches/{batchId} Azure Synapse Analytics Get a Spark batch job #
DELETE /livyApi/versions/{sparkPoolName}/batches/{batchId} Azure Synapse Analytics Cancel a Spark batch job #

Documentation

📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/workspace
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/sqlpools
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/bigdatapool
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/pipeline
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/spark
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/monitoring
📖
Documentation
https://learn.microsoft.com/en-us/azure/synapse-analytics/synapse-link/
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/role-assignments
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/notebook
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/dataset
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/linked-service
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/data-flow
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/sql-script
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/trigger
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/spark-job-definition
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/managed-private-endpoints
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/integration-runtimes
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/library
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/git-integration
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/ip-firewall-rules
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/keys
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/private-endpoint-connections
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/private-link-hubs
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/kusto-pools
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/azure-ad-only-authentications
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/spark-configuration
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/data-flow-debug-session
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/credential
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/kql-script
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/link-connection

Specifications

Schemas & Data

📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-workspace-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-sql-pool-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-spark-pool-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-pipeline-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-spark-batch-job-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-role-assignment-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-notebook-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-dataset-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-linked-service-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-trigger-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-firewall-rule-schema.json

Other Resources

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API
curl "https://apis.io/api/v1/apis/microsoft-azure-synapse-analytics-sparkbatch-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

microsoft-azure-synapse-analytics-sparkbatch-api-openapi.yml Raw ↑
openapi: 3.2.0
info:
  title: Azure Synapse Analytics - Spark Job Spark Batch API
  description: Submit and manage Apache Spark batch jobs and interactive sessions. Provides operations for monitoring job status, retrieving logs, and cancelling running applications.
  version: 2019-11-01-preview
  contact:
    name: Microsoft Azure Support
    url: https://azure.microsoft.com/en-us/support/
  license:
    name: Microsoft
    url: https://azure.microsoft.com/en-us/support/legal/
servers:
- url: https://{workspaceName}.dev.azuresynapse.net
  description: Synapse Data Plane
  variables:
    workspaceName:
      description: The workspace name.
      default: myworkspace
security:
- azure_auth:
  - user_impersonation
tags:
- name: SparkBatch
paths:
  /livyApi/versions/{sparkPoolName}/batches:
    get:
      operationId: SparkBatch_GetSparkBatchJobs
      summary: Azure Synapse Analytics List Spark batch jobs
      description: List all Spark batch jobs running against the Spark pool.
      tags:
      - SparkBatch
      parameters:
      - $ref: '#/components/parameters/SparkPoolNameParameter'
      - name: from
        in: query
        description: Optional param specifying which index the list should begin from.
        schema:
          type: integer
      - name: size
        in: query
        description: Optional param specifying the size of the returned list.
        schema:
          type: integer
      - name: detailed
        in: query
        description: Optional query param specifying whether detailed response is returned beyond plain livy.
        schema:
          type: boolean
      responses:
        '200':
          description: Successfully retrieved the list of batch jobs.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/SparkBatchJobCollection'
        default:
          description: Error response.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
    post:
      operationId: SparkBatch_CreateSparkBatchJob
      summary: Azure Synapse Analytics Create a Spark batch job
      description: Create new Spark batch job.
      tags:
      - SparkBatch
      parameters:
      - $ref: '#/components/parameters/SparkPoolNameParameter'
      - name: detailed
        in: query
        schema:
          type: boolean
      requestBody:
        required: true
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/SparkBatchJobOptions'
      responses:
        '200':
          description: Successfully created the batch job.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/SparkBatchJob'
        default:
          description: Error response.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
  /livyApi/versions/{sparkPoolName}/batches/{batchId}:
    get:
      operationId: SparkBatch_GetSparkBatchJob
      summary: Azure Synapse Analytics Get a Spark batch job
      description: Gets a single Spark batch job.
      tags:
      - SparkBatch
      parameters:
      - $ref: '#/components/parameters/SparkPoolNameParameter'
      - name: batchId
        in: path
        required: true
        description: Identifier for the batch job.
        schema:
          type: integer
      - name: detailed
        in: query
        schema:
          type: boolean
      responses:
        '200':
          description: Successfully retrieved the batch job.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/SparkBatchJob'
        default:
          description: Error response.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
    delete:
      operationId: SparkBatch_CancelSparkBatchJob
      summary: Azure Synapse Analytics Cancel a Spark batch job
      description: Cancels a running Spark batch job.
      tags:
      - SparkBatch
      parameters:
      - $ref: '#/components/parameters/SparkPoolNameParameter'
      - name: batchId
        in: path
        required: true
        schema:
          type: integer
      responses:
        '200':
          description: Successfully cancelled the batch job.
        default:
          description: Error response.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
components:
  schemas:
    SparkBatchJobCollection:
      type: object
      properties:
        from:
          type: integer
        total:
          type: integer
        sessions:
          type: array
          items:
            $ref: '#/components/schemas/SparkBatchJob'
    ErrorResponse:
      type: object
      properties:
        error:
          type: object
          properties:
            code:
              type: string
            message:
              type: string
    SparkBatchJob:
      type: object
      properties:
        livyInfo:
          type: object
          properties:
            currentState:
              type: string
        name:
          type: string
        workspaceName:
          type: string
        sparkPoolName:
          type: string
        submitterName:
          type: string
        submitterId:
          type: string
        artifactId:
          type: string
        jobType:
          type: string
          enum:
          - SparkBatch
          - SparkSession
        result:
          type: string
          enum:
          - Uncertain
          - Succeeded
          - Failed
          - Cancelled
        state:
          type: string
          description: The batch state.
        id:
          type: integer
        appId:
          type: string
        appInfo:
          type: object
          additionalProperties:
            type: string
        log:
          type: array
          items:
            type: string
    SparkBatchJobOptions:
      type: object
      required:
      - name
      - file
      properties:
        name:
          type: string
          description: The name of the batch job.
        file:
          type: string
          description: File containing the application to execute.
        className:
          type: string
          description: Main class for Java/Scala applications.
        args:
          type: array
          items:
            type: string
        jars:
          type: array
          items:
            type: string
        pyFiles:
          type: array
          items:
            type: string
        files:
          type: array
          items:
            type: string
        archives:
          type: array
          items:
            type: string
        conf:
          type: object
          additionalProperties:
            type: string
        driverMemory:
          type: string
        driverCores:
          type: integer
        executorMemory:
          type: string
        executorCores:
          type: integer
        executorCount:
          type: integer
  parameters:
    SparkPoolNameParameter:
      name: sparkPoolName
      in: path
      required: true
      description: Name of the Spark pool.
      schema:
        type: string
  securitySchemes:
    azure_auth:
      type: oauth2
      flows:
        implicit:
          authorizationUrl: https://login.microsoftonline.com/common/oauth2/authorize
          scopes:
            user_impersonation: impersonate your user account