Apache Hive

Apache Hive is a data warehouse software that facilitates reading, writing, and managing large datasets residing in distributed storage using SQL. It provides a SQL-like interface called HiveQL for querying data stored in Hadoop, along with a WebHCat REST API for job submission and metastore access.

2 APIs 8 Features

ApacheBig DataData WarehouseETLHadoopOpen SourceSQL

APIs

Apache Hive WebHCat REST API

WebHCat (Templeton) REST API for Apache Hive providing DDL operations, HiveQL job submission, and Hive Metastore metadata access over HTTP.

Apache Hive JDBC API

JDBC interface to HiveServer2 for standard SQL client connectivity, supporting parameterized queries, result sets, and connection pooling from Java and ODBC-bridge applications.

Collections

Apache Hive WebHCat REST API

OPEN

Pricing Plans

Apache Hive Plans Pricing

3 plans

PLANS

Rate Limits

Apache Hive Rate Limits

5 limits

RATE LIMITS

FinOps

Apache Hive Finops

FINOPS

Features

HiveQL SQL Interface

SQL-like query language for reading, writing, and aggregating data stored in distributed storage.

WebHCat REST API

HTTP REST API (Templeton) for DDL operations, job submission, and metastore metadata access.

HiveServer2 JDBC/ODBC

Thrift-based server with JDBC and ODBC drivers for standard SQL client connectivity.

Hive Metastore

Central repository for table schema, partition metadata, and storage location information.

Partitioning

Partition tables by column values for efficient query pruning and data organization.

ORC and Parquet Storage

Optimized columnar storage formats with predicate pushdown and compression support.

ACID Transactions

Full ACID transaction support for inserts, updates, and deletes on managed ORC tables.

Vectorized Query Execution

Batch processing of rows in CPU register-width vectors for improved query throughput.

Use Cases

Data Warehouse Analytics

Run SQL analytics on petabyte-scale datasets stored in HDFS or object storage.

ETL Pipeline Orchestration

Use HiveQL scripts to transform and load data between raw and curated data lake zones.

Ad-Hoc Data Exploration

Query structured data interactively using Beeline or JDBC-connected BI tools.

Log Analysis

Parse and aggregate application logs stored as text or JSON in HDFS using Hive SerDes.

Data Catalog Integration

Use the Hive Metastore as a shared schema registry for Spark, Flink, and Presto.

Semantic Vocabularies

Apache Hive Webhcat Context

21 classes · 0 properties

JSON-LD

API Governance Rules

Apache Hive API Rules

8 rules · 2 errors 5 warnings 1 info

SPECTRAL

JSON Structure

Hive Webhcat Column Structure

3 properties

JSON STRUCTURE

Hive Webhcat Database Structure

5 properties

JSON STRUCTURE

Hive Webhcat Job Structure

6 properties

JSON STRUCTURE

Hive Webhcat Partition Structure

5 properties

JSON STRUCTURE

Hive Webhcat Queryresult Structure

4 properties

JSON STRUCTURE

Hive Webhcat Table Structure

8 properties

JSON STRUCTURE

Example Payloads

Hive Webhcat Column Example

3 fields

EXAMPLE

Hive Webhcat Database Example

5 fields

EXAMPLE

Hive Webhcat Job Example

6 fields

EXAMPLE

Hive Webhcat Partition Example

5 fields

EXAMPLE

Hive Webhcat Queryresult Example

4 fields

EXAMPLE

Hive Webhcat Table Example

8 fields

EXAMPLE

Resources

GitHubOrganization

Sources

opencollection: 1.0.0
info:
  name: Apache Hive WebHCat REST API
  version: 1.0.0
items:
- info:
    name: Databases
    type: folder
  items:
  - info:
      name: Apache Hive List Databases
      type: http
    http:
      method: GET
      url: http://localhost:50111/templeton/v1/ddl/database
    docs: List all databases in the Hive metastore.
  - info:
      name: Apache Hive Get Database
      type: http
    http:
      method: GET
      url: http://localhost:50111/templeton/v1/ddl/database/:dbName
      params:
      - name: dbName
        value: ''
        type: path
        description: Database name
    docs: Get metadata for a specific Hive database.
- info:
    name: Tables
    type: folder
  items:
  - info:
      name: Apache Hive List Tables
      type: http
    http:
      method: GET
      url: http://localhost:50111/templeton/v1/ddl/database/:dbName/table
      params:
      - name: dbName
        value: ''
        type: path
    docs: List all tables in a Hive database.
  - info:
      name: Apache Hive Get Table
      type: http
    http:
      method: GET
      url: http://localhost:50111/templeton/v1/ddl/database/:dbName/table/:tableName
      params:
      - name: dbName
        value: ''
        type: path
      - name: tableName
        value: ''
        type: path
        description: Table name
    docs: Get schema and metadata for a specific Hive table.
  - info:
      name: Apache Hive List Partitions
      type: http
    http:
      method: GET
      url: http://localhost:50111/templeton/v1/ddl/database/:dbName/table/:tableName/partition
      params:
      - name: dbName
        value: ''
        type: path
      - name: tableName
        value: ''
        type: path
    docs: List all partitions for a Hive table.
- info:
    name: Jobs
    type: folder
  items:
  - info:
      name: Apache Hive Submit Hive Job
      type: http
    http:
      method: POST
      url: http://localhost:50111/templeton/v1/hive
      body:
        type: form-urlencoded
        data:
        - name: execute
          value: ''
        - name: file
          value: ''
        - name: statusdir
          value: ''
        - name: db
          value: ''
    docs: Submit a HiveQL query as an asynchronous Hadoop job via WebHCat.
  - info:
      name: Apache Hive Get Job Status
      type: http
    http:
      method: GET
      url: http://localhost:50111/templeton/v1/jobs/:jobId
      params:
      - name: jobId
        value: ''
        type: path
        description: Hadoop job ID
    docs: Get the status of a submitted Hive job.
bundled: true