Apache Airflow
Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows, developed by the Apache Software Foundation. It allows you to define workflows as Directed Acyclic Graphs (DAGs) in Python code, making them maintainable, versionable, testable, and collaborative. Airflow provides a stable REST API for managing DAGs, DAG runs, tasks, connections, variables, pools, and users, along with a web-based UI for monitoring and managing pipeline execution.
Apache Airflow publishes 18 APIs on the APIs.io network, including Config API, Connection API, DAG API, and 15 more. Tagged areas include Apache, DAG, Data Pipeline, ETL, and Open Source.
The Apache Airflow catalog on APIs.io includes 1 JSON-LD context and 2 Spectral governance rulesets.
Apache Airflow’s developer surface includes changelog, CLI, authentication, documentation, getting-started guide, engineering blog, support, and 36 more developer resources.
Kin Score
APIs 19
Individual APIs this provider publishes, each with its own machine-readable definition.
Apache Airflow Experimental API (Deprecated)
The experimental API that preceded the stable REST API. This is deprecated and should not be used for new implementations.
Apache Airflow Config API
The Config API from Apache Airflow — 1 operation(s) for config.
Apache Airflow Connection API
The Connection API from Apache Airflow — 3 operation(s) for connection.
Apache Airflow DAG API
The DAG API from Apache Airflow — 8 operation(s) for dag.
Apache Airflow DAGRun API
The DAGRun API from Apache Airflow — 6 operation(s) for dagrun.
Apache Airflow DagWarning API
The DagWarning API from Apache Airflow — 1 operation(s) for dagwarning.
Apache Airflow Dataset API
The Dataset API from Apache Airflow — 4 operation(s) for dataset.
Apache Airflow EventLog API
The EventLog API from Apache Airflow — 2 operation(s) for eventlog.
Apache Airflow ImportError API
The ImportError API from Apache Airflow — 2 operation(s) for importerror.
Apache Airflow Monitoring API
The Monitoring API from Apache Airflow — 2 operation(s) for monitoring.
Apache Airflow Permission API
The Permission API from Apache Airflow — 1 operation(s) for permission.
Apache Airflow Plugin API
The Plugin API from Apache Airflow — 1 operation(s) for plugin.
Apache Airflow Pool API
The Pool API from Apache Airflow — 2 operation(s) for pool.
Apache Airflow Provider API
The Provider API from Apache Airflow — 1 operation(s) for provider.
Apache Airflow Role API
The Role API from Apache Airflow — 2 operation(s) for role.
Apache Airflow TaskInstance API
The TaskInstance API from Apache Airflow — 9 operation(s) for taskinstance.
Apache Airflow User API
The User API from Apache Airflow — 2 operation(s) for user.
Apache Airflow Variable API
The Variable API from Apache Airflow — 2 operation(s) for variable.
Apache Airflow XCom API
The XCom API from Apache Airflow — 2 operation(s) for xcom.
Scroll for all 19
Postman Collections 18
Ready-to-run Postman collections for exercising this provider's APIs.
Scroll for all 18
Arazzo Workflows 13
Multi-step API workflows described with the Arazzo specification.
Apache Airflow Audit DAG Runs Across the Fleet
Use the batch endpoints to pull failed runs and their task instances across many DAGs in a date window, then check the event log for who intervened.
ARAZZOApache Airflow Collect DAG Run Results from XCom
Wait for a DAG run to finish, find the producing task instance, and pull its XCom return value.
ARAZZOApache Airflow Trace Dataset-Driven Lineage
Find a dataset by URI, read the tasks that produce it and the DAGs that consume it, and trace the events that triggered a downstream run.
ARAZZOApache Airflow Deployment Preflight Check
Verify scheduler and metadatabase health, capture the version, and surface DAG import errors and warnings before trusting a deployment.
ARAZZOApache Airflow Diagnose a Failed DAG Run
Isolate the failed task in a DAG run, pull its logs for the last attempt, and record the diagnosis as a note.
ARAZZOApache Airflow Force a Task Instance State
Preview and then set a task instance's state to unblock a stuck pipeline, verifying the DAG run recovers.
ARAZZOApache Airflow Onboard a DAG
Orient on an unfamiliar DAG by reading its metadata, schedule details, task graph, source code, and recent run history.
ARAZZOApache Airflow Provision a User with a Role
Ensure a role exists with the intended permissions, create a user bound to it, and verify the assignment.
ARAZZOApache Airflow Register a Connection After Testing It
Test a connection's credentials against the target system before saving it, then create and verify the stored connection.
ARAZZOApache Airflow Retry Failed Tasks in a DAG Run
Preview which task instances a clear would touch, clear the failed ones for real, and wait for the re-run to settle.
ARAZZOApache Airflow Trigger a DAG Run and Wait for Completion
Unpause a DAG if needed, trigger a run with a configuration payload, and poll until the run reaches a terminal state.
ARAZZOApache Airflow Upsert a Slot Pool
Create or resize an Airflow pool by name, then read back its slot accounting.
ARAZZOApache Airflow Upsert a Variable
Look up an Airflow variable and update it if it exists, otherwise create it, then read the result back.
ARAZZOScroll for all 13
MCP Servers 1
Model Context Protocol servers that expose these APIs to AI agents.
apache-airflow-mcp.yml
MCP SERVERPricing Plans 1
Published pricing tiers and plan structures.
Rate Limits 1
Documented rate limits and quota policies.
Apache Airflow Rate Limits
RATE LIMITSFinOps 1
Cost, billing, and metering signals for API financial operations.
Apache Airflow Finops
FINOPSFeatures 10
Notable capabilities this provider offers.
DAG-as-Code
Define workflows as Python code (Directed Acyclic Graphs) for version control, testing, and collaboration.
Stable REST API
Full-featured REST API for programmatic management of DAGs, runs, tasks, connections, variables, pools, and users.
Dynamic Pipeline Generation
Generate DAGs dynamically using Python, supporting complex conditional and parametric pipelines.
Extensible Providers
Rich ecosystem of provider packages for integrating with AWS, GCP, Azure, databases, and hundreds of external services.
Rich Web UI
Browser-based dashboard for monitoring DAG runs, task statuses, logs, and Gantt charts.
Resource Pools
Control concurrency and resource allocation across tasks using configurable pools.
Cross-DAG Dependencies
Define dependencies between DAGs using sensors, dataset-driven scheduling, and external task sensors.
Pluggable Executors
Supports Sequential, Local, Celery, Kubernetes, and DASK executors for flexible deployment.
SLA Monitoring
Define and track Service Level Agreements on task and DAG completion times.
Variable and Connection Management
Centrally manage environment-specific configuration via Airflow variables and connections.
Scroll for all 10
Semantic Vocabularies 1
JSON-LD contexts and semantic vocabularies used across these APIs.
Apache Airflow Context
JSON-LDSpectral Rules 2
Spectral governance rulesets for linting and validating these APIs.
Apache Airflow API Rules
SPECTRALApache Airflow API Rules
SPECTRALJSON Schema 84
Standalone JSON Schema definitions for this provider's data models.
ActionCollection
JSON SCHEMAActionResource
JSON SCHEMAAction
JSON SCHEMABasicDAGRun
JSON SCHEMAClassReference
JSON SCHEMAClearDagRun
JSON SCHEMAClearTaskInstances
JSON SCHEMACollectionInfo
JSON SCHEMAColor
JSON SCHEMAConfigOption
JSON SCHEMAConfig
JSON SCHEMAConfigSection
JSON SCHEMAConnectionCollectionItem
JSON SCHEMAConnectionCollection
JSON SCHEMAConnection
JSON SCHEMAConnectionTest
JSON SCHEMACronExpression
JSON SCHEMADAGCollection
JSON SCHEMADAGDetail
JSON SCHEMADAGRunCollection
JSON SCHEMADAGRun
JSON SCHEMADagScheduleDatasetReference
JSON SCHEMADAG
JSON SCHEMADagState
JSON SCHEMADagWarningCollection
JSON SCHEMADagWarning
JSON SCHEMADatasetCollection
JSON SCHEMADatasetEventCollection
JSON SCHEMADatasetEvent
JSON SCHEMADataset
JSON SCHEMAEventLogCollection
JSON SCHEMAEventLog
JSON SCHEMAExtraLinkCollection
JSON SCHEMAExtraLink
JSON SCHEMAHealthInfo
JSON SCHEMAHealthStatus
JSON SCHEMAImportErrorCollection
JSON SCHEMAImportError
JSON SCHEMAJob
JSON SCHEMAListDagRunsForm
JSON SCHEMAListTaskInstanceForm
JSON SCHEMAMetadatabaseStatus
JSON SCHEMAPluginCollectionItem
JSON SCHEMAPluginCollection
JSON SCHEMAPoolCollection
JSON SCHEMAPool
JSON SCHEMAProviderCollection
JSON SCHEMAProvider
JSON SCHEMARelativeDelta
JSON SCHEMAResource
JSON SCHEMARoleCollection
JSON SCHEMARole
JSON SCHEMAScheduleInterval
JSON SCHEMASchedulerStatus
JSON SCHEMASetDagRunNote
JSON SCHEMASetTaskInstanceNote
JSON SCHEMASLAMiss
JSON SCHEMATag
JSON SCHEMATaskCollection
JSON SCHEMATaskInstanceCollection
JSON SCHEMATaskInstanceReferenceCollection
JSON SCHEMATaskInstanceReference
JSON SCHEMATaskInstance
JSON SCHEMATaskOutletDatasetReference
JSON SCHEMATask
JSON SCHEMATaskState
JSON SCHEMATimeDelta
JSON SCHEMATimezone
JSON SCHEMATriggerRule
JSON SCHEMATrigger
JSON SCHEMAUpdateDagRunState
JSON SCHEMAUpdateTaskInstance
JSON SCHEMAUpdateTaskInstancesState
JSON SCHEMAUserCollectionItem
JSON SCHEMAUserCollection
JSON SCHEMAUser
JSON SCHEMAVariableCollectionItem
JSON SCHEMAVariableCollection
JSON SCHEMAVariable
JSON SCHEMAVersionInfo
JSON SCHEMAWeightRule
JSON SCHEMAXComCollectionItem
JSON SCHEMAXComCollection
JSON SCHEMAXCom
JSON SCHEMAScroll for all 84
JSON Structure 84
JSON Structure definitions describing this provider's data shapes.
Openapi.Yaml Action Collection Structure
JSON STRUCTUREOpenapi.Yaml Action Resource Structure
JSON STRUCTUREOpenapi.Yaml Action Structure
JSON STRUCTUREOpenapi.Yaml Basic Dag Run Structure
JSON STRUCTUREOpenapi.Yaml Class Reference Structure
JSON STRUCTUREOpenapi.Yaml Clear Dag Run Structure
JSON STRUCTUREOpenapi.Yaml Clear Task Instances Structure
JSON STRUCTUREOpenapi.Yaml Collection Info Structure
JSON STRUCTUREOpenapi.Yaml Color Structure
JSON STRUCTUREOpenapi.Yaml Config Option Structure
JSON STRUCTUREOpenapi.Yaml Config Section Structure
JSON STRUCTUREOpenapi.Yaml Config Structure
JSON STRUCTUREOpenapi.Yaml Connection Collection Item Structure
JSON STRUCTUREOpenapi.Yaml Connection Collection Structure
JSON STRUCTUREOpenapi.Yaml Connection Structure
JSON STRUCTUREOpenapi.Yaml Connection Test Structure
JSON STRUCTUREOpenapi.Yaml Cron Expression Structure
JSON STRUCTUREOpenapi.Yaml Dag Collection Structure
JSON STRUCTUREOpenapi.Yaml Dag Detail Structure
JSON STRUCTUREOpenapi.Yaml Dag Run Collection Structure
JSON STRUCTUREOpenapi.Yaml Dag Run Structure
JSON STRUCTUREOpenapi.Yaml Dag Schedule Dataset Reference Structure
JSON STRUCTUREOpenapi.Yaml Dag State Structure
JSON STRUCTUREOpenapi.Yaml Dag Structure
JSON STRUCTUREOpenapi.Yaml Dag Warning Collection Structure
JSON STRUCTUREOpenapi.Yaml Dag Warning Structure
JSON STRUCTUREOpenapi.Yaml Dataset Collection Structure
JSON STRUCTUREOpenapi.Yaml Dataset Event Collection Structure
JSON STRUCTUREOpenapi.Yaml Dataset Event Structure
JSON STRUCTUREOpenapi.Yaml Dataset Structure
JSON STRUCTUREOpenapi.Yaml Event Log Collection Structure
JSON STRUCTUREOpenapi.Yaml Event Log Structure
JSON STRUCTUREOpenapi.Yaml Extra Link Collection Structure
JSON STRUCTUREOpenapi.Yaml Extra Link Structure
JSON STRUCTUREOpenapi.Yaml Health Info Structure
JSON STRUCTUREOpenapi.Yaml Health Status Structure
JSON STRUCTUREOpenapi.Yaml Import Error Collection Structure
JSON STRUCTUREOpenapi.Yaml Import Error Structure
JSON STRUCTUREOpenapi.Yaml Job Structure
JSON STRUCTUREOpenapi.Yaml List Dag Runs Form Structure
JSON STRUCTUREOpenapi.Yaml List Task Instance Form Structure
JSON STRUCTUREOpenapi.Yaml Metadatabase Status Structure
JSON STRUCTUREOpenapi.Yaml Plugin Collection Item Structure
JSON STRUCTUREOpenapi.Yaml Plugin Collection Structure
JSON STRUCTUREOpenapi.Yaml Pool Collection Structure
JSON STRUCTUREOpenapi.Yaml Pool Structure
JSON STRUCTUREOpenapi.Yaml Provider Collection Structure
JSON STRUCTUREOpenapi.Yaml Provider Structure
JSON STRUCTUREOpenapi.Yaml Relative Delta Structure
JSON STRUCTUREOpenapi.Yaml Resource Structure
JSON STRUCTUREOpenapi.Yaml Role Collection Structure
JSON STRUCTUREOpenapi.Yaml Role Structure
JSON STRUCTUREOpenapi.Yaml Schedule Interval Structure
JSON STRUCTUREOpenapi.Yaml Scheduler Status Structure
JSON STRUCTUREOpenapi.Yaml Set Dag Run Note Structure
JSON STRUCTUREOpenapi.Yaml Set Task Instance Note Structure
JSON STRUCTUREOpenapi.Yaml Sla Miss Structure
JSON STRUCTUREOpenapi.Yaml Tag Structure
JSON STRUCTUREOpenapi.Yaml Task Collection Structure
JSON STRUCTUREOpenapi.Yaml Task Instance Collection Structure
JSON STRUCTUREOpenapi.Yaml Task Instance Reference Structure
JSON STRUCTUREOpenapi.Yaml Task Instance Structure
JSON STRUCTUREOpenapi.Yaml Task Outlet Dataset Reference Structure
JSON STRUCTUREOpenapi.Yaml Task State Structure
JSON STRUCTUREOpenapi.Yaml Task Structure
JSON STRUCTUREOpenapi.Yaml Time Delta Structure
JSON STRUCTUREOpenapi.Yaml Timezone Structure
JSON STRUCTUREOpenapi.Yaml Trigger Rule Structure
JSON STRUCTUREOpenapi.Yaml Trigger Structure
JSON STRUCTUREOpenapi.Yaml Update Dag Run State Structure
JSON STRUCTUREOpenapi.Yaml Update Task Instance Structure
JSON STRUCTUREOpenapi.Yaml Update Task Instances State Structure
JSON STRUCTUREOpenapi.Yaml User Collection Item Structure
JSON STRUCTUREOpenapi.Yaml User Collection Structure
JSON STRUCTUREOpenapi.Yaml User Structure
JSON STRUCTUREOpenapi.Yaml Variable Collection Item Structure
JSON STRUCTUREOpenapi.Yaml Variable Collection Structure
JSON STRUCTUREOpenapi.Yaml Variable Structure
JSON STRUCTUREOpenapi.Yaml Version Info Structure
JSON STRUCTUREOpenapi.Yaml Weight Rule Structure
JSON STRUCTUREOpenapi.Yaml X Com Collection Item Structure
JSON STRUCTUREOpenapi.Yaml X Com Collection Structure
JSON STRUCTUREOpenapi.Yaml X Com Structure
JSON STRUCTUREScroll for all 84
Examples 30
Example request and response payloads for these APIs.
Openapi.Yaml Action Example
EXAMPLEOpenapi.Yaml Color Example
EXAMPLEOpenapi.Yaml Config Example
EXAMPLEOpenapi.Yaml Dag Example
EXAMPLEOpenapi.Yaml Dag Run Example
EXAMPLEOpenapi.Yaml Dataset Example
EXAMPLEScroll for all 30
Security Posture 3
Authentication, domain security, vulnerability disclosure, and trust-center signals.
Agentic Access 1
Recommended x-agentic-access execution contracts for AI agents.
Use Cases 6
What developers build with this provider.
ETL Pipeline Orchestration
Schedule and manage extract, transform, load pipelines with dependency management and retry logic.
Machine Learning Workflows
Orchestrate ML training, validation, and deployment pipelines with data dependency tracking.
Data Warehouse Loading
Coordinate data ingestion from multiple sources into data warehouses like BigQuery, Redshift, and Snowflake.
Batch Report Generation
Schedule periodic batch reporting jobs with email notification on completion or failure.
Multi-Cloud Data Movement
Move data between AWS, GCP, and Azure using provider integrations with dependency control.
CI/CD Pipeline Orchestration
Trigger and monitor software deployment pipelines with upstream/downstream task dependencies.
Integrations 8
Pre-built integrations with other platforms and tools.
Apache Spark
Native Spark submit and Livy operator integration for distributed data processing.
Google Cloud
Comprehensive GCP provider for BigQuery, Cloud Storage, Dataflow, Dataproc, and more.
Amazon Web Services
AWS provider for S3, Redshift, EMR, Glue, Lambda, and other services.
Microsoft Azure
Azure provider for Blob Storage, Data Factory, HDInsight, and Databricks.
dbt
dbt operator for running dbt transformations within Airflow pipelines.
Kubernetes
KubernetesPodOperator for running tasks in isolated Kubernetes pods.
Docker
DockerOperator for running tasks in Docker containers with isolated environments.
Apache Kafka
Kafka producers and consumers as Airflow tasks via the Kafka provider.
Scroll for all 8
Resources
Get Started 1
Portal, sign-up, and the first successful call
Documentation 1
Reference material describing how the API behaves
Agent Surfaces 4
MCP servers, agent skills, and machine-readable catalogs
Design & Contract 19
Pagination, idempotency, versioning, errors, and events
Scroll for all 19
Build 7
SDKs, sample code, and the tooling you integrate with
Scroll for all 7
Access & Security 5
Authentication, authorization, and security posture
Learn 1
Tutorials, courses, talks, and written guidance
Operate 3
Status, limits, changes, and where to get help
Company 2
The organization behind the API