Azure Databricks
Azure Databricks is an Apache Spark-based analytics platform optimized for Microsoft Azure. It provides a collaborative workspace for data engineers, data scientists, and analysts to work together on big data and machine learning workloads.
APIs
Azure Databricks REST API
Core REST API for managing Azure Databricks workspaces, clusters, jobs, notebooks, and other resources programmatically.
Clusters API
Manage Databricks clusters for running Spark jobs including creating, starting, editing, listing, terminating, and deleting clusters.
Jobs API
Create, manage, and run jobs on Databricks clusters including scheduling, listing runs, and managing job permissions.
Workspace API
Manage notebooks, folders, and other workspace objects including listing, importing, exporting, and deleting workspace items.
DBFS API
Access Databricks File System (DBFS) for file operations including uploading, downloading, listing, and deleting files and directories.
Libraries API
Manage libraries and dependencies on clusters including installing, uninstalling, and listing library statuses.
Secrets API
Manage secrets and secret scopes for secure credential storage including creating scopes, putting secrets, and managing ACLs.
Token Management API
Create and manage personal access tokens for API authentication including creating, listing, and revoking tokens.
SQL Analytics API
Manage SQL warehouses, queries, and dashboards for Databricks SQL analytics workloads.
MLflow API
Track experiments, log metrics, and manage ML models using the MLflow tracking and registry APIs.
Instance Pools API
Create and manage instance pools to reduce cluster start and autoscaling times by maintaining a set of idle ready-to-use cloud instances.
Cluster Policies API
Create, list, and edit cluster policies to control cluster configurations and limit the ability to configure clusters based on a set of rules.
Repos API
Manage Git repositories within Databricks workspaces for version control of notebooks and files.
Git Credentials API
Manage Git credentials for authenticating with Git providers when using Databricks Repos.
Pipelines API
Create, edit, delete, start, and view details about Delta Live Tables pipelines for building reliable data pipelines.
Permissions API
Manage permissions on workspace objects including clusters, jobs, notebooks, and other resources using access control lists.
Unity Catalog - Catalogs API
Manage Unity Catalog catalogs for organizing and governing data assets across workspaces.
Unity Catalog - Schemas API
Manage schemas within Unity Catalog catalogs for organizing tables, views, and functions.
Unity Catalog - Tables API
Manage tables within Unity Catalog schemas including listing, getting, and deleting tables.
Unity Catalog - Volumes API
Manage Unity Catalog volumes for governing non-tabular data such as files and directories.
Unity Catalog - Grants API
Manage permissions and grants on Unity Catalog objects including catalogs, schemas, tables, and other securable objects.
Unity Catalog - External Locations API
Manage external locations in Unity Catalog for connecting to cloud storage paths.
Unity Catalog - Storage Credentials API
Manage storage credentials in Unity Catalog for authenticating access to cloud storage.
Unity Catalog - Metastores API
Manage Unity Catalog metastores which serve as the top-level container for data governance.
Model Serving Endpoints API
Create and manage model serving endpoints for deploying machine learning models as REST API endpoints.
Model Registry API
Manage registered models and model versions in the Databricks Model Registry for model lifecycle management.
Registered Models API
Manage registered models in Unity Catalog for centralized model governance and sharing.
Global Init Scripts API
Manage global cluster initialization scripts that run on every cluster in the workspace.
IP Access Lists API
Manage IP access lists to control network access to Azure Databricks workspaces.
Statement Execution API
Execute SQL statements on SQL warehouses and retrieve results for programmatic SQL access.
Command Execution API
Execute commands on running clusters and retrieve results programmatically.
Files API
Manage files in Unity Catalog volumes and workspace filesystem with operations for uploading, downloading, and deleting files.
Apps API
Deploy and manage Databricks Apps including creating, starting, stopping, and listing custom applications.
Lakeview API
Manage Lakeview dashboards programmatically including creating, updating, and publishing dashboards.
Online Tables API
Manage online tables for low-latency serving of feature data in Unity Catalog.
Vector Search Indexes API
Manage vector search indexes for similarity search and retrieval-augmented generation workloads.
Vector Search Endpoints API
Manage vector search endpoints for hosting vector search indexes.
Query History API
Retrieve query history for SQL warehouses including query text, status, and performance metrics.
Account SCIM API
Manage users, groups, and service principals across the Databricks account using SCIM 2.0 protocol.
Collections
Azure Databricks REST API
POSTMANArazzo Workflows
Azure Databricks Back Up a Notebook by Export and Re-import
Confirm a notebook, export its content, and re-import it to a backup path.
ARAZZOAzure Databricks Cancel an Active Job Run
Cancel a run and poll until its life cycle state is TERMINATED.
ARAZZOAzure Databricks Clean Up the Latest Completed Job Run
Find a job's latest completed run, confirm it, and delete it.
ARAZZOAzure Databricks Cluster Health Diagnostics
Read a cluster's state then pull its recent events for diagnosis.
ARAZZOAzure Databricks Create a Directory and Import a Notebook
Make a workspace directory, import a notebook into it, then verify it.
ARAZZOAzure Databricks Create a Job and Run It to Completion
Create a notebook job, trigger a run, and poll until TERMINATED.
ARAZZOAzure Databricks Safely Delete a Workspace Directory
List a directory, confirm it is a directory, then recursively delete it.
ARAZZOAzure Databricks Import a Notebook and Run It
Import a notebook, confirm it landed, then submit a run of it.
ARAZZOAzure Databricks Pin the First Listed Cluster
List clusters, pick the first, and pin it so it is always retained.
ARAZZOAzure Databricks Preflight and Create a Cluster
Resolve a valid Spark version and node type, then create a cluster.
ARAZZOAzure Databricks Provision a Cluster and Run a Job on It
Create a cluster, wait until RUNNING, create a job on it, then run it.
ARAZZOAzure Databricks Provision and Wait for Cluster
Create a cluster and poll its state until it reaches RUNNING.
ARAZZOAzure Databricks Overwrite Job Settings and Verify
Reset all of a job's settings, then read the job back to confirm.
ARAZZOAzure Databricks Resize a Running Cluster and Wait
Edit a running cluster's worker count and poll until it is RUNNING.
ARAZZOAzure Databricks Restart a Running Cluster and Wait
Restart a running cluster and poll until it returns to RUNNING.
ARAZZOAzure Databricks Run an Existing Job and Wait
Trigger an existing job with parameters and poll the run to completion.
ARAZZOAzure Databricks Start a Terminated Cluster and Wait
Start a terminated cluster and poll its state until RUNNING.
ARAZZOAzure Databricks Submit a One-time Run and Wait
Submit a one-time notebook run without a job and poll to completion.
ARAZZOAzure Databricks Terminate and Permanently Delete a Cluster
Terminate a cluster, wait until TERMINATED, then permanently delete it.
ARAZZOAzure Databricks Update a Job and Re-run It
Partially update a job's settings, then trigger and poll a fresh run.
ARAZZO