Use Case

ETL & Data Pipelines

Extracting, transforming, and loading data at scale.

42 providers 364 APIs 27 declared variants

Building and orchestrating batch and streaming pipelines that move data from operational sources into analytical stores, including scheduling, retries, and pipeline observability.

42 API providers on the APIs.io network offer etl & data pipelines. The highest-rated are Power Query, Qlik Sense, Microsoft Azure Functions, Amazon EC2 Auto Scaling, Factset.

Providers

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 3 Complete, well-documented, and agent-ready
Strong 10 Solid coverage with minor gaps
Developing 12 Usable, with meaningful gaps to close
Amazon Managed Service for Apache FlinkAmazon Managed Service for Apache Flink is the easiest way to transform and analyze streaming data in real ...1 published contract54.0Amazon Kinesis Data FirehoseAmazon Kinesis Data Firehose is the easiest way to reliably load streaming data into data lakes, data store...1 published contract53.6ClaudeAnthropic's Claude AI assistant API for natural language processing and conversation.1 published contract53.6BackpackBackpack is a Solana-first crypto company founded by Armani Ferrante and Tristan Yver — the same team behin...1 published contract52.2AWS Step FunctionsAWS Step Functions is a serverless orchestration service that lets you coordinate distributed applications ...10 published contracts51.3Apache AirflowApache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows, deve...27 published contracts48.1Apache IcebergApache Iceberg is an open table format for large analytic datasets that provides ACID transactions, schema ...1 published contract46.8Apache KafkaApache Kafka is an open-source distributed event streaming platform used by thousands of companies for high...2 published contracts45.4Argo WorkflowsArgo Workflows is an open-source, container-native workflow engine for orchestrating parallel jobs on Kuber...1 published contract45.1ConductorConductor allows you to build a complex application using simple and granular tasks that do not need to be ...1 published contract41.9DreamFactoryAutomate the building, securing, and documenting of REST APIs for data products with built-in enterprise se...16 APIs41.3Apache NiFiApache NiFi is a dataflow management system designed to automate the flow of data between systems. It provi...1 published contract39.9
Thin 13 Limited public surface area
Tableau DesktopAPIs and integration points for Tableau Desktop, a data visualization and business intelligence platform fr...12 APIs39.1Apache StormApache Storm is a free and open-source distributed real-time computation system that makes it easy to relia...8 APIs37.5Amazon AthenaAmazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standar...1 published contract36.4Apache OozieApache Oozie is a workflow scheduler system for managing Apache Hadoop jobs. It enables users to define wor...1 published contract34.3Apache HiveApache Hive is a data warehouse software that facilitates reading, writing, and managing large datasets res...1 published contract34.1Apache DolphinSchedulerApache DolphinScheduler is a modern distributed and extensible data orchestration platform governed by the ...1 API34.0Apache CamelApache Camel is an open-source integration framework developed by the Apache Software Foundation that imple...4 APIs32.1Vert.xEclipse Vert.x is a toolkit for building reactive applications on the JVM, providing support for multiple l...7 APIs32.0Apache PulsarApache Pulsar is a cloud-native, distributed messaging and streaming platform that provides server-to-serve...1 published contract31.0Apache FlinkApache Flink is a framework and distributed processing engine for stateful computations over unbounded and ...1 published contract29.5Apache ArrowApache Arrow is a cross-language development platform for in-memory analytics developed by the Apache Softw...3 APIs29.4Apache BeamApache Beam is a unified, open-source programming model developed by the Apache Software Foundation for def...2 APIs28.9Apache MesosApache Mesos is a retired cluster manager (now in the Apache Attic) that provided efficient resource isolat...2 APIs27.2
Emerging 3 Early or largely undocumented
Minimal 1 Almost no public developer surface

What Providers Actually Declared

This use case is a canonical term. These are the free-text strings providers wrote in their own apis.yml that map onto it.

Automated Data PipelinesBatch ProcessingBatch Processing and Job ManagementBig Data ProcessingBuild serverless data pipelines and reporting solutionsClinical Data IngestionComplex ETL PipelinesData IngestionData Ingestion PipelinesData PipelineData Pipeline AccelerationData Pipeline AutomationData Pipeline OrchestrationData Processing PipelinesData TransformationData engineers building automated financial data pipelines and reportsDesign Batch ProcessingETL Pipeline AutomationETL Pipeline OrchestrationETL Pipeline ProcessingETL PipelinesETL ProcessingIoT Data IngestionReal-Time Data PipelinesReal-time market data ingestionRunning ETL pipelines for data transformationSurvey Data Pipelines

Scroll for all 27

Work with this as data

Every use case here is available over the APIs.io API and to AI agents over MCP. Use Cases is not yet its own endpoint on the v1 API. Reach it through catalog search and the tag graph, or the MCP server.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for use cases

3 MCP tools reach this
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
Search the catalog
curl "https://apis.io/api/v1/search?q=etl-pipelines&limit=10"
Everything under a tag
curl "https://apis.io/api/v1/tags/etl-pipelines"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.