Apache Sqoop
Apache Sqoop is a command-line tool designed for efficiently transferring bulk data between Apache Hadoop and structured data stores such as relational databases. It supports parallel import and export of data, incremental loads, and direct database connectors for MySQL, PostgreSQL, Oracle, SQL Server, and DB2. Note: Apache Sqoop has been retired to the Apache Attic as of 2021. Users are encouraged to migrate to Apache Spark or Apache NiFi.
Apache Sqoop publishes 1 API on the APIs.io network. Tagged areas include Big Data, Data Transfer, ETL, Hadoop, and RDBMS.
Apache Sqoop’s developer surface includes documentation, developer portal, and 4 more developer resources.
Kin Score
APIs 1
Individual APIs this provider publishes, each with its own machine-readable definition.
Apache Sqoop CLI
Apache Sqoop provides a command-line interface for bulk data transfer between Hadoop and relational databases. Commands include sqoop-import for loading data into HDFS or Hive, ...
Pricing Plans 1
Published pricing tiers and plan structures.
Rate Limits 1
Documented rate limits and quota policies.
Apache Sqoop Rate Limits
RATE LIMITSFinOps 1
Cost, billing, and metering signals for API financial operations.
Apache Sqoop Finops
FINOPSFeatures 5
Notable capabilities this provider offers.
Bulk Import
High-throughput parallel import from RDBMS to HDFS, Hive, or HBase.
Bulk Export
Export data from HDFS back to relational database tables.
Incremental Loads
Delta-based incremental loading using append or lastmodified strategies.
Direct Import Mode
Native database utility-based transfers for MySQL and PostgreSQL.
Hive Integration
Auto-create Hive tables and load imported data directly into Hive.
Security Posture 2
Authentication, domain security, vulnerability disclosure, and trust-center signals.
Use Cases 2
What developers build with this provider.
Data Warehouse Loading
Load relational database data into Hadoop-based data warehouses.
Database Offloading
Move historical data from RDBMS to HDFS for cost-effective storage.
Integrations 4
Pre-built integrations with other platforms and tools.
Apache Hadoop
Primary target storage for Sqoop imports via HDFS.
Apache Hive
Create and populate Hive tables from RDBMS imports.
MySQL
MySQL JDBC and direct mysqldump-based connector.
Oracle
Oracle JDBC connector for enterprise database data transfer.
Resources
Get Started 1
Portal, sign-up, and the first successful call
Documentation 1
Reference material describing how the API behaves
Build 1
SDKs, sample code, and the tooling you integrate with
Access & Security 2
Authentication, authorization, and security posture
Commercial 1
Pricing, plans, and the legal terms of use