Use Case

ETL & Data Pipelines

Extracting, transforming, and loading data at scale.

47 providers 293 APIs 29 declared variants

Building and orchestrating batch and streaming pipelines that move data from operational sources into analytical stores, including scheduling, retries, and pipeline observability.

47 API providers on the APIs.io network offer etl & data pipelines. The highest-rated are Amazon EC2 Auto Scaling, Temporal, Claude, Autodesk, Amazon Managed Service for Apache Flink.

Providers

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 2 Complete, well-documented, and agent-ready
Amazon EC2 Auto Scaling Amazon EC2 Auto Scaling helps you maintain application availability and lets you automatically add or remov... 1 API 72.6 Temporal Temporal is an open-source durable execution platform for building reliable long-running distributed workfl... 2 APIs 70.2
Strong 14 Solid coverage with minor gaps
Claude Anthropic's Claude AI assistant API for natural language processing and conversation. 7 APIs 68.5 Autodesk Autodesk is a global leader in design, engineering, and entertainment software, providing cloud-connected p... 33 APIs 68.1 Amazon Managed Service for Apache Flink Amazon Managed Service for Apache Flink is the easiest way to transform and analyze streaming data in real ... 1 API 67.3 Amazon Data Exchange AWS Data Exchange makes it easy to find, subscribe to, and use third-party data in the cloud. Qualified dat... 1 API 64.4 Microsoft Azure Functions Azure Functions is a serverless compute platform from Microsoft Azure enabling event-driven code execution ... 2 APIs 63.9 Factset FactSet creates flexible, open data and software solutions for tens of thousands of investment professional... 105 APIs 63.3 Amazon Kinesis Data Firehose Amazon Kinesis Data Firehose is the easiest way to reliably load streaming data into data lakes, data store... 1 API 63.2 Amazon Glue DataBrew AWS Glue DataBrew is a visual data preparation tool that makes it easy for data analysts and data scientist... 1 API 62.9 IBM WebSphere IBM WebSphere is a family of enterprise software products that provide middleware and application server ca... 8 APIs 62.9 123FormBuilder 123FormBuilder is an online form, survey, and workflow builder used to collect, route, and integrate submis... 1 API 62.7 Amazon Step Functions Amazon Step Functions is a serverless workflow orchestration service that lets you coordinate distributed a... 1 API 62.1 Amazon Redshift Amazon Redshift is a fast, fully managed cloud data warehouse that makes it simple and cost-effective to an... 3 APIs 62.0 Apache Airflow Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows, deve... 2 APIs 61.3 Azure Databricks Azure Databricks is an Apache Spark-based analytics platform optimized for Microsoft Azure. It provides a c... 39 APIs 60.7
Developing 18 Usable, with meaningful gaps to close
Apache Oozie Apache Oozie is a workflow scheduler system for managing Apache Hadoop jobs. It enables users to define wor... 1 API 59.4 Backpack Backpack is a Solana-first crypto company founded by Armani Ferrante and Tristan Yver — the same team behin... 3 APIs 59.0 Amazon ECS Amazon Elastic Container Service (ECS) is a fully managed container orchestration service that makes it eas... 4 APIs 58.6 AWS Step Functions AWS Step Functions is a serverless orchestration service that lets you coordinate distributed applications ... 1 API 57.6 Apache Kafka Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high... 3 APIs 57.3 Argo Workflows Argo Workflows is an open-source, container-native workflow engine for orchestrating parallel jobs on Kuber... 1 API 55.8 Apache Iceberg Apache Iceberg is an open table format for large analytic datasets that provides ACID transactions, schema ... 3 APIs 55.0 Apache Airflow Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows. Airf... 1 API 53.6 Vert.x Eclipse Vert.x is a toolkit for building reactive applications on the JVM, providing support for multiple l... 7 APIs 52.3 Apache Pig Apache Pig is a platform for analyzing large data sets that provides a high-level language (Pig Latin) for ... 1 API 48.3 Apache Flink Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and ... 2 APIs 48.1 Apache DolphinScheduler Apache DolphinScheduler is a modern distributed and extensible data orchestration platform governed by the ... 1 API 48.0 Azure Logic Apps Azure Logic Apps is a cloud platform for creating and running automated workflows that integrate apps, data... 1 API 47.3 Apache Hive Apache Hive is a data warehouse software that facilitates reading, writing, and managing large datasets res... 2 APIs 47.2 DreamFactory Automate the building, securing, and documenting of REST APIs for data products with built-in enterprise se... 1 API 46.6 Tableau Desktop APIs and integration points for Tableau Desktop, a data visualization and business intelligence platform fr... 6 APIs 45.7 Apache Pulsar Apache Pulsar is a cloud-native, distributed messaging and streaming platform that provides server-to-serve... 2 APIs 45.5 Power Query Power Query is a data transformation and mashup engine used across Microsoft products including Excel, Powe... 6 APIs 45.3
Thin 10 Limited public surface area
Conductor Conductor allows you to build a complex application using simple and granular tasks that do not need to be ... 1 API 44.1 Qlik Sense APIs Collection of APIs for Qlik Sense, a business intelligence and visual analytics platform. Qlik provides RES... 13 APIs 41.0 Amazon Athena Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standar... 1 API 37.5 Apache Storm Apache Storm is a free and open-source distributed real-time computation system that makes it easy to relia... 2 APIs 37.1 Apache NiFi Apache NiFi is a dataflow management system designed to automate the flow of data between systems. It provi... 3 APIs 35.3 Apache Mesos Apache Mesos is a retired cluster manager (now in the Apache Attic) that provided efficient resource isolat... 2 APIs 34.9 Apache Arrow Apache Arrow is a cross-language development platform for in-memory analytics developed by the Apache Softw... 3 APIs 33.8 Apache Camel Apache Camel is an open-source integration framework developed by the Apache Software Foundation that imple... 4 APIs 33.7 Apache Beam Apache Beam is a unified, open-source programming model developed by the Apache Software Foundation for def... 2 APIs 33.1 Drip Drip is a Minneapolis-based ecommerce marketing automation platform that combines email, SMS, popups, and w... 2 APIs 30.9
Emerging 2 Early or largely undocumented
Apache Software Foundation The Apache Software Foundation (ASF) is a 501(c)(3) nonprofit organization that provides open source softwa... 1 API 28.0 Apache Tez Apache Tez is an application framework that allows for complex directed-acyclic-graph (DAG) based processin... 2 APIs 27.6
Minimal 1 Almost no public developer surface
Roche F. Hoffmann-La Roche is a Swiss multinational healthcare company with two divisions: Roche Pharma and Roche... 3 APIs 13.5

What Providers Actually Declared

This use case is a canonical term. These are the free-text strings providers wrote in their own apis.yml that map onto it.

Automated Data PipelinesBatch ProcessingBatch Processing and Job ManagementBig Data ProcessingBuild serverless data pipelines and reporting solutionsClinical Data IngestionComplex ETL PipelinesData IngestionData Ingestion PipelinesData PipelineData Pipeline AccelerationData Pipeline AutomationData Pipeline OrchestrationData Pipeline ProcessingData Processing PipelinesData TransformationData engineers building automated financial data pipelines and reportsDesign Batch ProcessingETL Pipeline AutomationETL Pipeline OrchestrationETL Pipeline ProcessingETL PipelinesETL ProcessingIoT Data IngestionReal-Time Data PipelinesReal-time market data ingestionRunning ETL pipelines for data transformationSubscriber and Event Data PipelinesSurvey Data Pipelines

Scroll for all 29