Use Case

ETL & Data Pipelines

Extracting, transforming, and loading data at scale.

42 providers 338 APIs 27 declared variants

Building and orchestrating batch and streaming pipelines that move data from operational sources into analytical stores, including scheduling, retries, and pipeline observability.

42 API providers on the APIs.io network offer etl & data pipelines. The highest-rated are Power Query, Qlik Sense, Microsoft Azure Functions, Amazon Glue DataBrew, Amazon EC2 Auto Scaling.

Providers

Ranked by API Evangelist rating — Exemplar and Strong are expanded by default.

Exemplar 3 Complete, well-documented, and agent-ready
Power QueryPower Query is Microsoft's data connectivity and transformation engine, driven by the M formula language. I...3 published contracts75.8Qlik SenseQlik Sense and Qlik Cloud from Qlik Parent, Inc. — a business intelligence, data integration and AI analyti...78 published contracts72.6Microsoft Azure FunctionsAzure Functions is a serverless compute platform from Microsoft Azure enabling event-driven code execution ...1 published contract68.5
Strong 13 Solid coverage with minor gaps
Amazon Glue DataBrewAWS Glue DataBrew is a visual data preparation tool that makes it easy for data analysts and data scientist...1 published contract66.0Amazon EC2 Auto ScalingAmazon EC2 Auto Scaling helps you maintain application availability and lets you automatically add or remov...1 published contract65.3Amazon RedshiftAmazon Redshift is a fast, fully managed cloud data warehouse that makes it simple and cost-effective to an...2 published contracts63.6Azure DatabricksAzure Databricks is an Apache Spark-based analytics platform optimized for Microsoft Azure. It provides a c...1 published contract63.6FactsetFactSet creates flexible, open data and software solutions for tens of thousands of investment professional...142 published contracts63.6Amazon ECSAmazon Elastic Container Service (ECS) is a fully managed container orchestration service that makes it eas...1 published contract62.1Amazon Managed Service for Apache FlinkAmazon Managed Service for Apache Flink is the easiest way to transform and analyze streaming data in real ...1 published contract61.4Amazon Kinesis Data FirehoseAmazon Kinesis Data Firehose is the easiest way to reliably load streaming data into data lakes, data store...1 published contract61.0AutodeskAutodesk is a global leader in design, engineering, and entertainment software, providing cloud-connected p...12 published contracts60.3IBM WebSphereIBM WebSphere is a family of enterprise software products that provide middleware and application server ca...7 published contracts59.9Amazon Data ExchangeAWS Data Exchange makes it easy to find, subscribe to, and use third-party data in the cloud. Qualified dat...1 published contract59.4AWS Step FunctionsAWS Step Functions is a serverless orchestration service that lets you coordinate distributed applications ...10 published contracts56.7ClaudeAnthropic's Claude AI assistant API for natural language processing and conversation.1 published contract56.2
Developing 8 Usable, with meaningful gaps to close
123FormBuilder123FormBuilder is an online form, survey, and workflow builder used to collect, route, and integrate submis...1 published contract52.5Apache KafkaApache Kafka is an open-source distributed event streaming platform used by thousands of companies for high...2 published contracts47.7Apache IcebergApache Iceberg is an open table format for large analytic datasets that provides ACID transactions, schema ...1 published contract46.9Apache AirflowApache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows, deve...2 published contracts46.3BackpackBackpack is a Solana-first crypto company founded by Armani Ferrante and Tristan Yver — the same team behin...1 published contract44.7Argo WorkflowsArgo Workflows is an open-source, container-native workflow engine for orchestrating parallel jobs on Kuber...1 published contract43.7ConductorConductor allows you to build a complex application using simple and granular tasks that do not need to be ...1 published contract40.5DreamFactoryAutomate the building, securing, and documenting of REST APIs for data products with built-in enterprise se...16 APIs40.1
Thin 14 Limited public surface area
Apache NiFiApache NiFi is a dataflow management system designed to automate the flow of data between systems. It provi...1 published contract39.0Tableau DesktopAPIs and integration points for Tableau Desktop, a data visualization and business intelligence platform fr...12 APIs37.7Apache StormApache Storm is a free and open-source distributed real-time computation system that makes it easy to relia...8 APIs36.2Apache OozieApache Oozie is a workflow scheduler system for managing Apache Hadoop jobs. It enables users to define wor...1 published contract34.4Amazon AthenaAmazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standar...1 published contract33.5Apache HiveApache Hive is a data warehouse software that facilitates reading, writing, and managing large datasets res...1 published contract32.8Apache DolphinSchedulerApache DolphinScheduler is a modern distributed and extensible data orchestration platform governed by the ...1 API32.6Vert.xEclipse Vert.x is a toolkit for building reactive applications on the JVM, providing support for multiple l...7 APIs31.9Apache PulsarApache Pulsar is a cloud-native, distributed messaging and streaming platform that provides server-to-serve...1 published contract30.9Apache CamelApache Camel is an open-source integration framework developed by the Apache Software Foundation that imple...4 APIs30.8Apache FlinkApache Flink is a framework and distributed processing engine for stateful computations over unbounded and ...1 published contract29.4Apache ArrowApache Arrow is a cross-language development platform for in-memory analytics developed by the Apache Softw...3 APIs29.3Apache BeamApache Beam is a unified, open-source programming model developed by the Apache Software Foundation for def...2 APIs28.8Apache MesosApache Mesos is a retired cluster manager (now in the Apache Attic) that provided efficient resource isolat...2 APIs27.1
Emerging 4 Early or largely undocumented
Apache TezApache Tez is an application framework that allows for complex directed-acyclic-graph (DAG) based processin...2 APIs19.9Apache PigApache Pig is a platform for analyzing large data sets that provides a high-level language (Pig Latin) for ...2 APIs19.5Apache Software FoundationThe Apache Software Foundation (ASF) is a 501(c)(3) nonprofit organization that provides open source softwa...1 API17.9RocheF. Hoffmann-La Roche is a Swiss multinational healthcare company with two divisions: Roche Pharma and Roche...11.0

What Providers Actually Declared

This use case is a canonical term. These are the free-text strings providers wrote in their own apis.yml that map onto it.

Automated Data PipelinesBatch ProcessingBatch Processing and Job ManagementBig Data ProcessingBuild serverless data pipelines and reporting solutionsClinical Data IngestionComplex ETL PipelinesData IngestionData Ingestion PipelinesData PipelineData Pipeline AccelerationData Pipeline AutomationData Pipeline OrchestrationData Processing PipelinesData TransformationData engineers building automated financial data pipelines and reportsDesign Batch ProcessingETL Pipeline AutomationETL Pipeline OrchestrationETL Pipeline ProcessingETL PipelinesETL ProcessingIoT Data IngestionReal-Time Data PipelinesReal-time market data ingestionRunning ETL pipelines for data transformationSurvey Data Pipelines

Scroll for all 27

Work with this as data

Every use case here is available over the APIs.io API and to AI agents over MCP. Use Cases is not yet its own endpoint on the v1 API. Reach it through catalog search and the tag graph, or the MCP server.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for use cases

3 MCP tools reach this
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
Search the catalog 
curl "https://apis.io/api/v1/search?q=etl-pipelines&limit=10"
Everything under a tag 
curl "https://apis.io/api/v1/tags/etl-pipelines"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.