Use Case

ETL & Data Pipelines

Extracting, transforming, and loading data at scale.

47 providers 1059 APIs 29 declared variants

Building and orchestrating batch and streaming pipelines that move data from operational sources into analytical stores, including scheduling, retries, and pipeline observability.

47 API providers on the APIs.io network offer etl & data pipelines. The highest-rated are Autodesk, Temporal, Factset, Amazon EC2 Auto Scaling, Claude.

Providers

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 7 Complete, well-documented, and agent-ready
Autodesk Autodesk is a global leader in design, engineering, and entertainment software, providing cloud-connected p... 69 APIs 76.5 Temporal Temporal is an open-source durable execution platform for building reliable long-running distributed workfl... 7 APIs 73.0 Factset FactSet creates flexible, open data and software solutions for tens of thousands of investment professional... 460 APIs 72.8 Amazon EC2 Auto Scaling Amazon EC2 Auto Scaling helps you maintain application availability and lets you automatically add or remov... 65 APIs 71.8 Claude Anthropic's Claude AI assistant API for natural language processing and conversation. 9 APIs 70.2 Amazon Data Exchange AWS Data Exchange makes it easy to find, subscribe to, and use third-party data in the cloud. Qualified dat... 6 APIs 68.2 Amazon ECS Amazon Elastic Container Service (ECS) is a fully managed container orchestration service that makes it eas... 13 APIs 66.2
Strong 12 Solid coverage with minor gaps
Amazon Managed Service for Apache Flink Amazon Managed Service for Apache Flink is the easiest way to transform and analyze streaming data in real ... 31 APIs 65.7 123FormBuilder 123FormBuilder is an online form, survey, and workflow builder used to collect, route, and integrate submis... 5 APIs 65.3 Amazon Kinesis Data Firehose Amazon Kinesis Data Firehose is the easiest way to reliably load streaming data into data lakes, data store... 1 API 65.2 Microsoft Azure Functions Azure Functions is a serverless compute platform from Microsoft Azure enabling event-driven code execution ... 23 APIs 64.7 Amazon Step Functions Amazon Step Functions is a serverless workflow orchestration service that lets you coordinate distributed a... 37 APIs 64.5 Amazon Glue DataBrew AWS Glue DataBrew is a visual data preparation tool that makes it easy for data analysts and data scientist... 10 APIs 64.3 IBM WebSphere IBM WebSphere is a family of enterprise software products that provide middleware and application server ca... 35 APIs 63.1 AWS Step Functions AWS Step Functions is a serverless orchestration service that lets you coordinate distributed applications ... 26 APIs 62.3 Amazon Redshift Amazon Redshift is a fast, fully managed cloud data warehouse that makes it simple and cost-effective to an... 5 APIs 62.2 Apache Airflow Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows, deve... 19 APIs 62.0 Backpack Backpack is a Solana-first crypto company founded by Armani Ferrante and Tristan Yver — the same team behin... 15 APIs 59.3 Azure Databricks Azure Databricks is an Apache Spark-based analytics platform optimized for Microsoft Azure. It provides a c... 39 APIs 56.5
Developing 15 Usable, with meaningful gaps to close
DreamFactory Automate the building, securing, and documenting of REST APIs for data products with built-in enterprise se... 16 APIs 55.4 Apache Kafka Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high... 12 APIs 53.9 Apache Oozie Apache Oozie is a workflow scheduler system for managing Apache Hadoop jobs. It enables users to define wor... 4 APIs 53.6 Apache Iceberg Apache Iceberg is an open table format for large analytic datasets that provides ACID transactions, schema ... 5 APIs 53.1 Argo Workflows Argo Workflows is an open-source, container-native workflow engine for orchestrating parallel jobs on Kuber... 11 APIs 51.6 Apache Airflow Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows. Airf... 26 APIs 51.5 Azure Logic Apps Azure Logic Apps is a cloud platform for creating and running automated workflows that integrate apps, data... 2 APIs 49.6 Conductor Conductor allows you to build a complex application using simple and granular tasks that do not need to be ... 6 APIs 48.2 Tableau Desktop APIs and integration points for Tableau Desktop, a data visualization and business intelligence platform fr... 12 APIs 47.0 Apache Hive Apache Hive is a data warehouse software that facilitates reading, writing, and managing large datasets res... 4 APIs 46.8 Vert.x Eclipse Vert.x is a toolkit for building reactive applications on the JVM, providing support for multiple l... 7 APIs 46.5 Apache Flink Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and ... 10 APIs 45.6 Amazon Athena Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standar... 8 APIs 44.0 Apache DolphinScheduler Apache DolphinScheduler is a modern distributed and extensible data orchestration platform governed by the ... 1 API 42.3 Apache Pulsar Apache Pulsar is a cloud-native, distributed messaging and streaming platform that provides server-to-serve... 8 APIs 42.0
Thin 10 Limited public surface area
Power Query Power Query is a data transformation and mashup engine used across Microsoft products including Excel, Powe... 6 APIs 41.9 Apache Storm Apache Storm is a free and open-source distributed real-time computation system that makes it easy to relia... 9 APIs 39.5 Apache NiFi Apache NiFi is a dataflow management system designed to automate the flow of data between systems. It provi... 6 APIs 39.0 Qlik Sense APIs Collection of APIs for Qlik Sense, a business intelligence and visual analytics platform. Qlik provides RES... 13 APIs 38.4 Apache Mesos Apache Mesos is a retired cluster manager (now in the Apache Attic) that provided efficient resource isolat... 2 APIs 36.5 Apache Pig Apache Pig is a platform for analyzing large data sets that provides a high-level language (Pig Latin) for ... 2 APIs 33.9 Apache Arrow Apache Arrow is a cross-language development platform for in-memory analytics developed by the Apache Softw... 3 APIs 31.6 Apache Beam Apache Beam is a unified, open-source programming model developed by the Apache Software Foundation for def... 2 APIs 31.0 Apache Camel Apache Camel is an open-source integration framework developed by the Apache Software Foundation that imple... 4 APIs 30.8 Drip Drip is a Minneapolis-based ecommerce marketing automation platform that combines email, SMS, popups, and w... 2 APIs 28.4
Emerging 2 Early or largely undocumented
Apache Software Foundation The Apache Software Foundation (ASF) is a 501(c)(3) nonprofit organization that provides open source softwa... 1 API 25.9 Apache Tez Apache Tez is an application framework that allows for complex directed-acyclic-graph (DAG) based processin... 2 APIs 25.6
Minimal 1 Almost no public developer surface
Roche F. Hoffmann-La Roche is a Swiss multinational healthcare company with two divisions: Roche Pharma and Roche... 11.0

What Providers Actually Declared

This use case is a canonical term. These are the free-text strings providers wrote in their own apis.yml that map onto it.

Automated Data PipelinesBatch ProcessingBatch Processing and Job ManagementBig Data ProcessingBuild serverless data pipelines and reporting solutionsClinical Data IngestionComplex ETL PipelinesData IngestionData Ingestion PipelinesData PipelineData Pipeline AccelerationData Pipeline AutomationData Pipeline OrchestrationData Pipeline ProcessingData Processing PipelinesData TransformationData engineers building automated financial data pipelines and reportsDesign Batch ProcessingETL Pipeline AutomationETL Pipeline OrchestrationETL Pipeline ProcessingETL PipelinesETL ProcessingIoT Data IngestionReal-Time Data PipelinesReal-time market data ingestionRunning ETL pipelines for data transformationSubscriber and Event Data PipelinesSurvey Data Pipelines

Scroll for all 29