Azure Databricks
Azure Databricks is an Apache Spark-based analytics platform optimized for Microsoft Azure. It provides a collaborative workspace for data engineers, data scientists, and analysts to work together on big data and machine learning workloads.
APIs
Azure Databricks REST API
Core REST API for managing Azure Databricks workspaces, clusters, jobs, notebooks, and other resources programmatically.
Clusters API
Manage Databricks clusters for running Spark jobs including creating, starting, editing, listing, terminating, and deleting clusters.
Jobs API
Create, manage, and run jobs on Databricks clusters including scheduling, listing runs, and managing job permissions.
Workspace API
Manage notebooks, folders, and other workspace objects including listing, importing, exporting, and deleting workspace items.
DBFS API
Access Databricks File System (DBFS) for file operations including uploading, downloading, listing, and deleting files and directories.
Libraries API
Manage libraries and dependencies on clusters including installing, uninstalling, and listing library statuses.
Secrets API
Manage secrets and secret scopes for secure credential storage including creating scopes, putting secrets, and managing ACLs.
Token Management API
Create and manage personal access tokens for API authentication including creating, listing, and revoking tokens.
SQL Analytics API
Manage SQL warehouses, queries, and dashboards for Databricks SQL analytics workloads.
MLflow API
Track experiments, log metrics, and manage ML models using the MLflow tracking and registry APIs.
Instance Pools API
Create and manage instance pools to reduce cluster start and autoscaling times by maintaining a set of idle ready-to-use cloud instances.
Cluster Policies API
Create, list, and edit cluster policies to control cluster configurations and limit the ability to configure clusters based on a set of rules.
Repos API
Manage Git repositories within Databricks workspaces for version control of notebooks and files.
Git Credentials API
Manage Git credentials for authenticating with Git providers when using Databricks Repos.
Pipelines API
Create, edit, delete, start, and view details about Delta Live Tables pipelines for building reliable data pipelines.
Permissions API
Manage permissions on workspace objects including clusters, jobs, notebooks, and other resources using access control lists.
Unity Catalog - Catalogs API
Manage Unity Catalog catalogs for organizing and governing data assets across workspaces.
Unity Catalog - Schemas API
Manage schemas within Unity Catalog catalogs for organizing tables, views, and functions.
Unity Catalog - Tables API
Manage tables within Unity Catalog schemas including listing, getting, and deleting tables.
Unity Catalog - Volumes API
Manage Unity Catalog volumes for governing non-tabular data such as files and directories.
Unity Catalog - Grants API
Manage permissions and grants on Unity Catalog objects including catalogs, schemas, tables, and other securable objects.
Unity Catalog - External Locations API
Manage external locations in Unity Catalog for connecting to cloud storage paths.
Unity Catalog - Storage Credentials API
Manage storage credentials in Unity Catalog for authenticating access to cloud storage.
Unity Catalog - Metastores API
Manage Unity Catalog metastores which serve as the top-level container for data governance.
Model Serving Endpoints API
Create and manage model serving endpoints for deploying machine learning models as REST API endpoints.
Model Registry API
Manage registered models and model versions in the Databricks Model Registry for model lifecycle management.
Registered Models API
Manage registered models in Unity Catalog for centralized model governance and sharing.
Global Init Scripts API
Manage global cluster initialization scripts that run on every cluster in the workspace.
IP Access Lists API
Manage IP access lists to control network access to Azure Databricks workspaces.
Statement Execution API
Execute SQL statements on SQL warehouses and retrieve results for programmatic SQL access.
Command Execution API
Execute commands on running clusters and retrieve results programmatically.
Files API
Manage files in Unity Catalog volumes and workspace filesystem with operations for uploading, downloading, and deleting files.
Apps API
Deploy and manage Databricks Apps including creating, starting, stopping, and listing custom applications.
Lakeview API
Manage Lakeview dashboards programmatically including creating, updating, and publishing dashboards.
Online Tables API
Manage online tables for low-latency serving of feature data in Unity Catalog.
Vector Search Indexes API
Manage vector search indexes for similarity search and retrieval-augmented generation workloads.
Vector Search Endpoints API
Manage vector search endpoints for hosting vector search indexes.
Query History API
Retrieve query history for SQL warehouses including query text, status, and performance metrics.
Account SCIM API
Manage users, groups, and service principals across the Databricks account using SCIM 2.0 protocol.
Capabilities
Azure Databricks Data Engineering
Manage Azure Databricks clusters, jobs, and workspace objects for data engineering workflows. Used by data engineers and platform administrators.
Run with Naftiko