Azure Databricks · JSON Structure

Azure Databricks Task Settings Structure

Type: object Properties: 19

AnalyticsApache SparkBig DataData EngineeringMachine Learning

TaskSettings is a JSON Structure definition published by Azure Databricks, describing 19 properties. It conforms to the https://json-structure.org/draft/2020-12/schema meta-schema.

Properties

task_key description depends_on existing_cluster_id job_cluster_key notebook_task spark_jar_task spark_python_task spark_submit_task pipeline_task python_wheel_task sql_task dbt_task run_if timeout_seconds max_retries min_retry_interval_millis retry_on_timeout libraries

Meta-schema: https://json-structure.org/draft/2020-12/schema

JSON Structure

{
  "$schema": "https://json-structure.org/draft/2020-12/schema",
  "name": "TaskSettings",
  "type": "object",
  "properties": {
    "task_key": {
      "type": "string"
    },
    "description": {
      "type": "string"
    },
    "depends_on": {
      "type": "array"
    },
    "existing_cluster_id": {
      "type": "string"
    },
    "job_cluster_key": {
      "type": "string"
    },
    "notebook_task": {
      "type": "object"
    },
    "spark_jar_task": {
      "type": "object"
    },
    "spark_python_task": {
      "type": "object"
    },
    "spark_submit_task": {
      "type": "object"
    },
    "pipeline_task": {
      "type": "object"
    },
    "python_wheel_task": {
      "type": "object"
    },
    "sql_task": {
      "type": "object"
    },
    "dbt_task": {
      "type": "object"
    },
    "run_if": {
      "type": "string"
    },
    "timeout_seconds": {
      "type": "integer"
    },
    "max_retries": {
      "type": "integer"
    },
    "min_retry_interval_millis": {
      "type": "integer"
    },
    "retry_on_timeout": {
      "type": "boolean"
    },
    "libraries": {
      "type": "array"
    }
  }
}