Apache Giraph website screenshot

Apache Giraph

Apache Giraph is an iterative graph processing system built for high scalability on Apache Hadoop. It is modeled after Google's Pregel and provides a simple yet flexible Java API for graph algorithms at massive scale using the Bulk Synchronous Parallel (BSP) model. Note - Apache Giraph has been retired as of 2024.

2 APIs 8 Features
ApacheBig DataBSPGraph ProcessingHadoopOpen SourceRetired

APIs

Apache Giraph Job Monitoring API

Monitoring API for Apache Giraph graph processing jobs via the YARN ResourceManager REST API, providing job status, progress tracking, and cluster capacity metrics.

Apache Giraph Java API

Java API based on the Bulk Synchronous Parallel (BSP) model for implementing graph algorithms, with Vertex, Edge, and Master compute APIs for distributed graph processing on Had...

Collections

Apache Giraph Job Monitoring API

OPEN

Pricing Plans

Apache Giraph Plans Pricing

3 plans

PLANS

Rate Limits

Apache Giraph Rate Limits

5 limits

RATE LIMITS

FinOps

Apache Giraph Finops

FINOPS

Features

Bulk Synchronous Parallel (BSP) Model

Google Pregel-inspired BSP computation model where vertices communicate through supersteps.

Vertex-Centric Programming

Write graph algorithms by defining per-vertex compute functions that exchange messages with neighbors.

Master Compute API

Global coordination API for aggregating results and controlling algorithm termination across supersteps.

Aggregators

Sharded aggregators for collecting global statistics across all vertices during computation.

Edge-Oriented Input

Flexible input formats for loading graphs from HDFS, Hive, Gora, and Rexster sources.

Out-of-Core Computation

Spill graph data to disk for processing graphs larger than available memory.

Hadoop Integration

Runs as a MapReduce job on Apache Hadoop YARN for resource management and fault tolerance.

Fault Tolerance

Checkpoint-based recovery for fault tolerance across superstep boundaries.

Use Cases

Social Graph Analysis

Analyze social network connections, communities, and influence at billions-of-vertices scale (as used at Facebook).

PageRank Computation

Compute web page or entity rankings using iterative link analysis algorithms.

Shortest Path Computation

Find shortest paths between vertices for network routing and recommendation problems.

Connected Components

Identify clusters and connected components in large graphs for community detection.

Graph Machine Learning Features

Generate graph-structural features for machine learning models at scale.

Integrations

Apache Hadoop

Runs on Hadoop YARN as a MapReduce application for cluster resource management.

Apache Hive

Hive I/O module for loading graph data from Hive tables.

Apache Gora

Gora I/O module for loading graph data from various NoSQL data stores.

Rexster

Rexster graph server I/O module for loading data from TinkerPop graph databases.

Apache HBase

HBase integration for storing and loading vertex and edge data.

Semantic Vocabularies

Apache Giraph Job Context

5 classes · 14 properties

JSON-LD

API Governance Rules

Apache Giraph API Rules

7 rules · 4 errors 3 warnings

SPECTRAL

JSON Structure

Giraph Job Application Info Structure

12 properties

JSON STRUCTURE

Giraph Job Application Response Structure

1 properties

JSON STRUCTURE

Giraph Job Applications Response Structure

1 properties

JSON STRUCTURE

Giraph Job Cluster Metrics Response Structure

1 properties

JSON STRUCTURE

Example Payloads

Giraph Job Application Info Example

12 fields

EXAMPLE

Giraph Job Application Response Example

1 fields

EXAMPLE

Giraph Job Applications Response Example

1 fields

EXAMPLE

Giraph Job Cluster Metrics Response Example

1 fields

EXAMPLE

Resources

🔗
Documentation
Documentation
🚀
GettingStarted
GettingStarted
👥
GitHubOrganization
GitHubOrganization
👥
GitHubRepository
GitHubRepository
🔗
SpectralRules
SpectralRules
🔗
Vocabulary
Vocabulary

Sources

Raw ↑ 
opencollection: 1.0.0
info:
  name: Apache Giraph Job Monitoring API
  version: 1.3.0
items:
- info:
    name: Job Management
    type: folder
  items:
  - info:
      name: Apache Giraph List Graph Processing Jobs
      type: http
    http:
      method: GET
      url: http://localhost:8088/ws/v1/cluster/apps
      params:
      - name: applicationTypes
        value: ''
        type: query
        description: Filter by application type (e.g., MAPREDUCE for Giraph jobs)
      - name: states
        value: ''
        type: query
        description: Filter by job state (RUNNING, FINISHED, FAILED, KILLED)
    docs: List Giraph graph processing jobs running on YARN cluster via the ResourceManager REST API.
  - info:
      name: Apache Giraph Get Graph Processing Job
      type: http
    http:
      method: GET
      url: http://localhost:8088/ws/v1/cluster/apps/:appId
      params:
      - name: appId
        value: ''
        type: path
        description: YARN application ID for the Giraph job
    docs: Get detailed status and metrics for a specific Giraph job running on YARN.
- info:
    name: Cluster
    type: folder
  items:
  - info:
      name: Apache Giraph Get Cluster Metrics
      type: http
    http:
      method: GET
      url: http://localhost:8088/ws/v1/cluster/metrics
    docs: Get YARN cluster metrics relevant to Giraph job execution capacity.
bundled: true