Apache Oozie
Apache Oozie is a workflow scheduler system for managing Apache Hadoop jobs. It enables users to define workflows as directed acyclic graphs (DAGs) of actions including MapReduce, Pig, Hive, Sqoop, and custom Java/shell steps. Coordinator jobs trigger workflows based on time schedules or data availability, while bundle jobs group multiple coordinators. Oozie provides a REST API for job submission, lifecycle management, monitoring, and system administration. Governed by the Apache Software Foundation under the Apache License 2.0, written in Java.
Apache Oozie publishes 4 APIs on the APIs.io network, including Admin API, Job API, Jobs API, and 1 more. Tagged areas include Workflow, Hadoop, Orchestration, Scheduling, and Big Data.
The Apache Oozie catalog on APIs.io includes 1 JSON-LD context and 2 Spectral governance rulesets.
Apache Oozie’s developer surface includes documentation, getting-started guide, release notes, support, Stack Overflow tag, and 10 more developer resources.
Kin Score
APIs 4
Individual APIs this provider publishes, each with its own machine-readable definition.
Apache Oozie Admin API
System administration, configuration, and monitoring
Apache Oozie Job API
Single job lifecycle management and information retrieval
Apache Oozie Jobs API
Job submission and bulk management
Apache Oozie Versions API
Supported protocol version discovery
Pricing Plans 1
Published pricing tiers and plan structures.
Rate Limits 1
Documented rate limits and quota policies.
Apache Oozie Rate Limits
RATE LIMITSFinOps 1
Cost, billing, and metering signals for API financial operations.
Apache Oozie Finops
FINOPSFeatures 10
Notable capabilities this provider offers.
Directed Acyclic Graph Workflows
Define complex data processing pipelines as DAGs of actions executed on Apache Hadoop.
Coordinator Jobs
Schedule recurring workflows triggered by time intervals or data availability conditions in HDFS.
Bundle Jobs
Group multiple coordinator jobs into a single bundle for coordinated lifecycle management.
REST API Management
Full REST API for job submission, lifecycle control, monitoring, and system administration.
Native Hadoop Action Types
Built-in support for MapReduce, Pig, Hive, Sqoop, Distcp, and custom Java/shell actions.
SLA Management
Define and monitor service level agreements on workflow and coordinator actions with alert capabilities.
DAG Visualization
Generate PNG, SVG, or DOT graph visualizations of workflow DAGs for debugging and documentation.
Log Retrieval
Retrieve execution logs, error logs, and audit trails for jobs via REST API with filtering support.
High Availability
Built-in HA support with multiple Oozie server instances and distributed state management.
Shared Library Support
Manage shared Hadoop libraries across workflows for consistent classpath management.
Scroll for all 10
Semantic Vocabularies 1
JSON-LD contexts and semantic vocabularies used across these APIs.
Apache Oozie Context
JSON-LDSpectral Rules 2
Spectral governance rulesets for linting and validating these APIs.
Apache Oozie API Rules
SPECTRALApache Oozie API Rules
SPECTRALJSON Schema 8
Standalone JSON Schema definitions for this provider's data models.
BuildVersion
JSON SCHEMAJobAction
JSON SCHEMAJobId
JSON SCHEMAJobInfo
JSON SCHEMAJobList
JSON SCHEMASystemMetrics
JSON SCHEMASystemStatus
JSON SCHEMAValidationResult
JSON SCHEMAScroll for all 8
JSON Structure 8
JSON Structure definitions describing this provider's data shapes.
Apache Oozie Build Version Structure
JSON STRUCTUREApache Oozie Job Action Structure
JSON STRUCTUREApache Oozie Job Id Structure
JSON STRUCTUREApache Oozie Job Info Structure
JSON STRUCTUREApache Oozie Job List Structure
JSON STRUCTUREApache Oozie System Metrics Structure
JSON STRUCTUREApache Oozie System Status Structure
JSON STRUCTUREApache Oozie Validation Result Structure
JSON STRUCTUREScroll for all 8
Examples 8
Example request and response payloads for these APIs.
Apache Oozie Job Id Example
EXAMPLEScroll for all 8
Security Posture 2
Authentication, domain security, vulnerability disclosure, and trust-center signals.
Agentic Access 1
Recommended x-agentic-access execution contracts for AI agents.
Use Cases 6
What developers build with this provider.
ETL Pipeline Orchestration
Orchestrate multi-step ETL pipelines combining Hive queries, MapReduce jobs, and data transfers on Hadoop.
Scheduled Data Processing
Run recurring Hadoop batch jobs on time-based schedules using coordinator jobs.
Data-Triggered Workflows
Trigger workflows automatically when new data arrives in HDFS using coordinator data-in conditions.
Machine Learning Pipeline Automation
Automate ML model training and evaluation pipelines on Hadoop with dependency chaining.
Data Migration and Archival
Orchestrate large-scale data migration, compaction, and archival workflows across Hadoop clusters.
Multi-Cluster Coordination
Coordinate workflows that span multiple Hadoop clusters using Distcp and remote actions.
Integrations 6
Pre-built integrations with other platforms and tools.
Apache Hadoop
Core integration with HDFS for data storage and YARN for resource management.
Apache Hive
Native Hive action type for executing HiveQL queries as workflow steps.
Apache Pig
Native Pig action type for data transformation scripts in workflow pipelines.
Apache Sqoop
Native Sqoop action type for importing and exporting data between Hadoop and RDBMS.
Apache Spark
Spark action type for running Spark jobs within Oozie workflows.
Apache MapReduce
Native MapReduce action type as the foundational Hadoop computation framework.
Resources
Get Started 1
Portal, sign-up, and the first successful call
Documentation 1
Reference material describing how the API behaves
Agent Surfaces 1
MCP servers, agent skills, and machine-readable catalogs
Design & Contract 3
Pagination, idempotency, versioning, errors, and events
Build 2
SDKs, sample code, and the tooling you integrate with
Access & Security 2
Authentication, authorization, and security posture
Learn 1
Tutorials, courses, talks, and written guidance
Operate 3
Status, limits, changes, and where to get help
Commercial 1
Pricing, plans, and the legal terms of use