Use Case

ETL & Data Pipelines

Extracting, transforming, and loading data at scale.

46 providers 340 APIs 28 declared variants

Building and orchestrating batch and streaming pipelines that move data from operational sources into analytical stores, including scheduling, retries, and pipeline observability.

46 API providers on the APIs.io network offer etl & data pipelines. The highest-rated are Power Query, 123FormBuilder, Microsoft Azure Functions, Factset, Azure Databricks.

Providers

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 1 Complete, well-documented, and agent-ready
Strong 16 Solid coverage with minor gaps
123FormBuilder123FormBuilder is an online form, survey, and workflow builder used to collect, route, and integrate submis...1 API65.6Microsoft Azure FunctionsAzure Functions is a serverless compute platform from Microsoft Azure enabling event-driven code execution ...1 API64.3FactsetFactSet creates flexible, open data and software solutions for tens of thousands of investment professional...142 APIs64.2Azure DatabricksAzure Databricks is an Apache Spark-based analytics platform optimized for Microsoft Azure. It provides a c...1 API63.0Amazon EC2 Auto ScalingAmazon EC2 Auto Scaling helps you maintain application availability and lets you automatically add or remov...1 API62.3Qlik Sense APIsQlik Sense and Qlik Cloud from Qlik Parent, Inc. — a business intelligence, data integration and AI analyti...82 APIs59.3Amazon Glue DataBrewAWS Glue DataBrew is a visual data preparation tool that makes it easy for data analysts and data scientist...1 API58.7Amazon RedshiftAmazon Redshift is a fast, fully managed cloud data warehouse that makes it simple and cost-effective to an...1 API57.4AutodeskAutodesk is a global leader in design, engineering, and entertainment software, providing cloud-connected p...12 APIs57.2IBM WebSphereIBM WebSphere is a family of enterprise software products that provide middleware and application server ca...7 APIs55.7Amazon Data ExchangeAWS Data Exchange makes it easy to find, subscribe to, and use third-party data in the cloud. Qualified dat...1 API55.6BackpackBackpack is a Solana-first crypto company founded by Armani Ferrante and Tristan Yver — the same team behin...1 API55.6Amazon Step FunctionsAmazon Step Functions is a serverless workflow orchestration service that lets you coordinate distributed a...2 APIs55.5ClaudeAnthropic's Claude AI assistant API for natural language processing and conversation.1 API55.3Amazon ECSAmazon Elastic Container Service (ECS) is a fully managed container orchestration service that makes it eas...1 API54.9TemporalTemporal is an open-source durable execution platform for building reliable long-running distributed workfl...1 API54.5
Developing 13 Usable, with meaningful gaps to close
Amazon Kinesis Data FirehoseAmazon Kinesis Data Firehose is the easiest way to reliably load streaming data into data lakes, data store...1 API54.0Amazon Managed Service for Apache FlinkAmazon Managed Service for Apache Flink is the easiest way to transform and analyze streaming data in real ...1 API51.0AWS Step FunctionsAWS Step Functions is a serverless orchestration service that lets you coordinate distributed applications ...1 API49.8Apache AirflowApache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows, deve...1 API46.7Azure Logic AppsAzure Logic Apps is a cloud platform for creating and running automated workflows that integrate apps, data...2 APIs46.3Argo WorkflowsArgo Workflows is an open-source, container-native workflow engine for orchestrating parallel jobs on Kuber...1 API46.2ConductorConductor allows you to build a complex application using simple and granular tasks that do not need to be ...1 API45.8Apache IcebergApache Iceberg is an open table format for large analytic datasets that provides ACID transactions, schema ...1 API44.9Apache KafkaApache Kafka is an open-source distributed event streaming platform used by thousands of companies for high...2 APIs44.6Apache AirflowApache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows. Airf...1 API43.8DreamFactoryAutomate the building, securing, and documenting of REST APIs for data products with built-in enterprise se...16 APIs42.7Apache NiFiApache NiFi is a dataflow management system designed to automate the flow of data between systems. It provi...1 API41.0Tableau DesktopAPIs and integration points for Tableau Desktop, a data visualization and business intelligence platform fr...12 APIs40.6
Thin 12 Limited public surface area
Amazon AthenaAmazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standar...1 API38.8Apache StormApache Storm is a free and open-source distributed real-time computation system that makes it easy to relia...9 APIs38.6Apache HiveApache Hive is a data warehouse software that facilitates reading, writing, and managing large datasets res...1 API36.1Apache OozieApache Oozie is a workflow scheduler system for managing Apache Hadoop jobs. It enables users to define wor...1 API35.8Apache DolphinSchedulerApache DolphinScheduler is a modern distributed and extensible data orchestration platform governed by the ...1 API34.4Apache CamelApache Camel is an open-source integration framework developed by the Apache Software Foundation that imple...4 APIs31.7Apache FlinkApache Flink is a framework and distributed processing engine for stateful computations over unbounded and ...1 API31.5Apache PulsarApache Pulsar is a cloud-native, distributed messaging and streaming platform that provides server-to-serve...1 API30.9Vert.xEclipse Vert.x is a toolkit for building reactive applications on the JVM, providing support for multiple l...7 APIs30.7Apache ArrowApache Arrow is a cross-language development platform for in-memory analytics developed by the Apache Softw...3 APIs29.6Apache BeamApache Beam is a unified, open-source programming model developed by the Apache Software Foundation for def...2 APIs29.1Apache MesosApache Mesos is a retired cluster manager (now in the Apache Attic) that provided efficient resource isolat...2 APIs28.5
Emerging 3 Early or largely undocumented
Minimal 1 Almost no public developer surface

What Providers Actually Declared

This use case is a canonical term. These are the free-text strings providers wrote in their own apis.yml that map onto it.

Automated Data PipelinesBatch ProcessingBatch Processing and Job ManagementBig Data ProcessingBuild serverless data pipelines and reporting solutionsClinical Data IngestionComplex ETL PipelinesData IngestionData Ingestion PipelinesData PipelineData Pipeline AccelerationData Pipeline AutomationData Pipeline OrchestrationData Pipeline ProcessingData Processing PipelinesData TransformationData engineers building automated financial data pipelines and reportsDesign Batch ProcessingETL Pipeline AutomationETL Pipeline OrchestrationETL Pipeline ProcessingETL PipelinesETL ProcessingIoT Data IngestionReal-Time Data PipelinesReal-time market data ingestionRunning ETL pipelines for data transformationSurvey Data Pipelines

Scroll for all 28

Work with this as data

Every use case here is available over the APIs.io API and to AI agents over MCP. Use Cases is not yet its own endpoint on the v1 API. Reach it through catalog search and the tag graph, or the MCP server.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for use cases

3 MCP tools reach this
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
Search the catalog
curl "https://apis.io/api/v1/search?q=etl-pipelines&limit=10"
Everything under a tag
curl "https://apis.io/api/v1/tags/etl-pipelines"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

A second provider on the same verified email joins the account you already have.