Azure Synapse Analytics SparkJobDefinition API

The SparkJobDefinition API from Azure Synapse Analytics — 5 operation(s) for sparkjobdefinition.

Operations 7

GET /sparkJobDefinitions Azure Synapse Analytics List Spark job definitions #
GET /sparkJobDefinitions/{sparkJobDefinitionName} Azure Synapse Analytics Get a Spark job definition #
PUT /sparkJobDefinitions/{sparkJobDefinitionName} Azure Synapse Analytics Create or update a Spark job definition #
DELETE /sparkJobDefinitions/{sparkJobDefinitionName} Azure Synapse Analytics Delete a Spark job definition #
POST /sparkJobDefinitions/{sparkJobDefinitionName}/rename Azure Synapse Analytics Rename a Spark job definition #
POST /sparkJobDefinitions/{sparkJobDefinitionName}/execute Azure Synapse Analytics Execute a Spark job definition #
POST /sparkJobDefinitions/{sparkJobDefinitionName}/debug Azure Synapse Analytics Debug a Spark job definition #

Documentation

📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/workspace
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/sqlpools
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/bigdatapool
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/pipeline
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/spark
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/monitoring
📖
Documentation
https://learn.microsoft.com/en-us/azure/synapse-analytics/synapse-link/
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/role-assignments
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/notebook
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/dataset
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/linked-service
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/data-flow
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/sql-script
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/trigger
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/spark-job-definition
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/managed-private-endpoints
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/integration-runtimes
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/library
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/git-integration
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/ip-firewall-rules
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/keys
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/private-endpoint-connections
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/private-link-hubs
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/kusto-pools
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/azure-ad-only-authentications
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/spark-configuration
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/data-flow-debug-session
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/credential
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/kql-script
📖
Documentation
https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/link-connection

Specifications

Schemas & Data

📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-workspace-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-sql-pool-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-spark-pool-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-pipeline-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-spark-batch-job-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-role-assignment-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-notebook-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-dataset-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-linked-service-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-trigger-schema.json
📊
JSONSchema
https://raw.githubusercontent.com/api-evangelist/microsoft-azure-synapse-analytics/refs/heads/main/json-schema/azure-synapse-analytics-firewall-rule-schema.json

Other Resources

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API
curl "https://apis.io/api/v1/apis/microsoft-azure-synapse-analytics-sparkjobdefinition-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

microsoft-azure-synapse-analytics-sparkjobdefinition-api-openapi.yml Raw ↑
openapi: 3.2.0
info:
  title: Azure Synapse Analytics Spark Job Definition API
  description: Create and manage Spark job definitions as reusable templates for batch processing. Spark job definitions encapsulate configuration, code, and dependencies for repeatable execution.
  version: '2020-12-01'
  contact:
    name: Microsoft Azure Support
    url: https://azure.microsoft.com/en-us/support/
  license:
    name: Microsoft
    url: https://azure.microsoft.com/en-us/support/legal/
servers:
- url: https://{workspaceName}.dev.azuresynapse.net
  description: Synapse Data Plane
  variables:
    workspaceName:
      default: myworkspace
security:
- azure_auth:
  - user_impersonation
tags:
- name: SparkJobDefinition
paths:
  /sparkJobDefinitions:
    get:
      operationId: SparkJobDefinition_GetSparkJobDefinitionsByWorkspace
      summary: Azure Synapse Analytics List Spark job definitions
      description: Lists Spark job definitions in the workspace.
      tags:
      - SparkJobDefinition
      parameters:
      - $ref: '#/components/parameters/ApiVersionParameter'
      responses:
        '200':
          description: Successfully retrieved the list.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/SparkJobDefinitionListResponse'
        default:
          description: Error response.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
  /sparkJobDefinitions/{sparkJobDefinitionName}:
    get:
      operationId: SparkJobDefinition_GetSparkJobDefinition
      summary: Azure Synapse Analytics Get a Spark job definition
      description: Gets a Spark job definition.
      tags:
      - SparkJobDefinition
      parameters:
      - $ref: '#/components/parameters/ApiVersionParameter'
      - $ref: '#/components/parameters/SparkJobDefinitionNameParameter'
      - name: If-None-Match
        in: header
        schema:
          type: string
      responses:
        '200':
          description: Successfully retrieved.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/SparkJobDefinitionResource'
        '304':
          description: Not modified.
        default:
          description: Error response.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
    put:
      operationId: SparkJobDefinition_CreateOrUpdateSparkJobDefinition
      summary: Azure Synapse Analytics Create or update a Spark job definition
      description: Creates or updates a Spark job definition.
      tags:
      - SparkJobDefinition
      parameters:
      - $ref: '#/components/parameters/ApiVersionParameter'
      - $ref: '#/components/parameters/SparkJobDefinitionNameParameter'
      - name: If-Match
        in: header
        schema:
          type: string
      requestBody:
        required: true
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/SparkJobDefinitionResource'
      responses:
        '200':
          description: Successfully updated.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/SparkJobDefinitionResource'
        '202':
          description: Creation accepted.
        default:
          description: Error response.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
    delete:
      operationId: SparkJobDefinition_DeleteSparkJobDefinition
      summary: Azure Synapse Analytics Delete a Spark job definition
      description: Deletes a Spark job definition.
      tags:
      - SparkJobDefinition
      parameters:
      - $ref: '#/components/parameters/ApiVersionParameter'
      - $ref: '#/components/parameters/SparkJobDefinitionNameParameter'
      responses:
        '200':
          description: Successfully deleted.
        '202':
          description: Deletion accepted.
        '204':
          description: Not found.
        default:
          description: Error response.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
  /sparkJobDefinitions/{sparkJobDefinitionName}/rename:
    post:
      operationId: SparkJobDefinition_RenameSparkJobDefinition
      summary: Azure Synapse Analytics Rename a Spark job definition
      description: Renames a Spark job definition.
      tags:
      - SparkJobDefinition
      parameters:
      - $ref: '#/components/parameters/ApiVersionParameter'
      - $ref: '#/components/parameters/SparkJobDefinitionNameParameter'
      requestBody:
        required: true
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/ArtifactRenameRequest'
      responses:
        '200':
          description: Successfully renamed.
        '202':
          description: Rename accepted.
        default:
          description: Error response.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
  /sparkJobDefinitions/{sparkJobDefinitionName}/execute:
    post:
      operationId: SparkJobDefinition_ExecuteSparkJobDefinition
      summary: Azure Synapse Analytics Execute a Spark job definition
      description: Executes the Spark job definition.
      tags:
      - SparkJobDefinition
      parameters:
      - $ref: '#/components/parameters/ApiVersionParameter'
      - $ref: '#/components/parameters/SparkJobDefinitionNameParameter'
      responses:
        '200':
          description: Successfully submitted.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/SparkBatchJob'
        '202':
          description: Execution accepted.
        default:
          description: Error response.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
  /sparkJobDefinitions/{sparkJobDefinitionName}/debug:
    post:
      operationId: SparkJobDefinition_DebugSparkJobDefinition
      summary: Azure Synapse Analytics Debug a Spark job definition
      description: Debug the Spark job definition.
      tags:
      - SparkJobDefinition
      parameters:
      - $ref: '#/components/parameters/ApiVersionParameter'
      - $ref: '#/components/parameters/SparkJobDefinitionNameParameter'
      requestBody:
        required: true
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/SparkJobDefinitionResource'
      responses:
        '200':
          description: Successfully submitted debug.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/SparkBatchJob'
        '202':
          description: Debug accepted.
        default:
          description: Error response.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
components:
  schemas:
    ErrorResponse:
      type: object
      properties:
        error:
          type: object
          properties:
            code:
              type: string
            message:
              type: string
    SparkBatchJob:
      type: object
      properties:
        id:
          type: integer
        name:
          type: string
        state:
          type: string
        appId:
          type: string
        log:
          type: array
          items:
            type: string
    ArtifactRenameRequest:
      type: object
      properties:
        newName:
          type: string
    SparkJobDefinitionListResponse:
      type: object
      properties:
        value:
          type: array
          items:
            $ref: '#/components/schemas/SparkJobDefinitionResource'
        nextLink:
          type: string
    SparkJobDefinitionResource:
      type: object
      properties:
        id:
          type: string
          readOnly: true
        name:
          type: string
          readOnly: true
        type:
          type: string
          readOnly: true
        etag:
          type: string
          readOnly: true
        properties:
          $ref: '#/components/schemas/SparkJobDefinition'
    SparkJobDefinition:
      type: object
      required:
      - targetBigDataPool
      - jobProperties
      properties:
        description:
          type: string
        targetBigDataPool:
          type: object
          properties:
            referenceName:
              type: string
            type:
              type: string
        requiredSparkVersion:
          type: string
        language:
          type: string
        jobProperties:
          type: object
          required:
          - name
          - file
          properties:
            name:
              type: string
            file:
              type: string
            className:
              type: string
            conf:
              type: object
              additionalProperties:
                type: string
            args:
              type: array
              items:
                type: string
            jars:
              type: array
              items:
                type: string
            pyFiles:
              type: array
              items:
                type: string
            files:
              type: array
              items:
                type: string
            driverMemory:
              type: string
            driverCores:
              type: integer
            executorMemory:
              type: string
            executorCores:
              type: integer
            numExecutors:
              type: integer
        folder:
          type: object
          properties:
            name:
              type: string
  parameters:
    SparkJobDefinitionNameParameter:
      name: sparkJobDefinitionName
      in: path
      required: true
      description: The Spark job definition name.
      schema:
        type: string
    ApiVersionParameter:
      name: api-version
      in: query
      required: true
      schema:
        type: string
        default: '2020-12-01'
  securitySchemes:
    azure_auth:
      type: oauth2
      flows:
        implicit:
          authorizationUrl: https://login.microsoftonline.com/common/oauth2/authorize
          scopes:
            user_impersonation: impersonate your user account