Apache Spark

Apache Spark Applications API

The Applications API from Apache Spark — 25 operation(s) for applications.

Documentation GitHub OpenAPI

Operations 25

GET /applications List applications

GET /applications/{app-id}/jobs List jobs for an application

GET /applications/{app-id}/jobs/{job-id} Get a job

GET /applications/{app-id}/stages List stages

GET /applications/{app-id}/stages/{stage-id} Get stage

GET /applications/{app-id}/stages/{stage-id}/{stage-attempt-id} Get stage attempt

GET /applications/{app-id}/stages/{stage-id}/{stage-attempt-id}/taskSummary Stage attempt task summary

GET /applications/{app-id}/stages/{stage-id}/{stage-attempt-id}/taskList Stage attempt task list

GET /applications/{app-id}/executors List active executors

GET /applications/{app-id}/executors/{executor-id}/threads Executor thread dump

GET /applications/{app-id}/allexecutors List all executors (active and dead)

GET /applications/{app-id}/storage/rdd List persisted RDDs

GET /applications/{app-id}/storage/rdd/{rdd-id} Get RDD details

GET /applications/{base-app-id}/logs Download event logs

GET /applications/{base-app-id}/{attempt-id}/logs Download event logs for an attempt

GET /applications/{app-id}/streaming/statistics Streaming statistics

GET /applications/{app-id}/streaming/receivers Streaming receivers

GET /applications/{app-id}/streaming/receivers/{stream-id} Streaming receiver details

GET /applications/{app-id}/streaming/batches Streaming batches

GET /applications/{app-id}/streaming/batches/{batch-id} Streaming batch details

GET /applications/{app-id}/streaming/batches/{batch-id}/operations Streaming batch operations

GET /applications/{app-id}/streaming/batches/{batch-id}/operations/{outputOp-id} Streaming output operation details

GET /applications/{app-id}/sql List SQL executions

GET /applications/{app-id}/sql/{execution-id} Get SQL execution details

GET /applications/{app-id}/environment Application environment

Documentation

📖

Documentation

https://spark.apache.org/docs/latest/monitoring.html#rest-api

Specifications

⚙

OpenAPI

https://raw.githubusercontent.com/api-evangelist/apache-spark/refs/heads/main/openapi/apache-spark-applications-api-openapi.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this

find_apisBrowse and filter every API in the catalog.
get_api_artifactsOne API's artifacts, grouped by type.
get_openapiThe primary OpenAPI for this API.
find_similar_apisAPIs that look like this one.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This API

curl "https://apis.io/api/v1/apis/apache-spark-applications-api"

All apis

curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

openapi: 3.2.0
info:
  title: Apache Spark Monitoring REST Applications API
  version: '1.0'
  description: Minimal OpenAPI for the Apache Spark monitoring REST API exposed by the Spark UI and the History Server. All endpoints are mounted under /api/v1.
servers:
- url: http://localhost:4040/api/v1
  description: Spark application UI
- url: http://localhost:18080/api/v1
  description: Spark History Server
tags:
- name: Applications
paths:
  /applications:
    get:
      summary: List applications
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: array
                items:
                  type: object
      tags:
      - Applications
  /applications/{app-id}/jobs:
    get:
      summary: List jobs for an application
      parameters:
      - $ref: '#/components/parameters/AppId'
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: array
                items:
                  type: object
      tags:
      - Applications
  /applications/{app-id}/jobs/{job-id}:
    get:
      summary: Get a job
      parameters:
      - $ref: '#/components/parameters/AppId'
      - name: job-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: object
      tags:
      - Applications
  /applications/{app-id}/stages:
    get:
      summary: List stages
      parameters:
      - $ref: '#/components/parameters/AppId'
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: array
                items:
                  type: object
      tags:
      - Applications
  /applications/{app-id}/stages/{stage-id}:
    get:
      summary: Get stage
      parameters:
      - $ref: '#/components/parameters/AppId'
      - name: stage-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: object
      tags:
      - Applications
  /applications/{app-id}/stages/{stage-id}/{stage-attempt-id}:
    get:
      summary: Get stage attempt
      parameters:
      - $ref: '#/components/parameters/AppId'
      - name: stage-id
        in: path
        required: true
        schema:
          type: string
      - name: stage-attempt-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: object
      tags:
      - Applications
  /applications/{app-id}/stages/{stage-id}/{stage-attempt-id}/taskSummary:
    get:
      summary: Stage attempt task summary
      parameters:
      - $ref: '#/components/parameters/AppId'
      - name: stage-id
        in: path
        required: true
        schema:
          type: string
      - name: stage-attempt-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: object
      tags:
      - Applications
  /applications/{app-id}/stages/{stage-id}/{stage-attempt-id}/taskList:
    get:
      summary: Stage attempt task list
      parameters:
      - $ref: '#/components/parameters/AppId'
      - name: stage-id
        in: path
        required: true
        schema:
          type: string
      - name: stage-attempt-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: array
                items:
                  type: object
      tags:
      - Applications
  /applications/{app-id}/executors:
    get:
      summary: List active executors
      parameters:
      - $ref: '#/components/parameters/AppId'
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/executors/{executor-id}/threads:
    get:
      summary: Executor thread dump
      parameters:
      - $ref: '#/components/parameters/AppId'
      - name: executor-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/allexecutors:
    get:
      summary: List all executors (active and dead)
      parameters:
      - $ref: '#/components/parameters/AppId'
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/storage/rdd:
    get:
      summary: List persisted RDDs
      parameters:
      - $ref: '#/components/parameters/AppId'
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/storage/rdd/{rdd-id}:
    get:
      summary: Get RDD details
      parameters:
      - $ref: '#/components/parameters/AppId'
      - name: rdd-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{base-app-id}/logs:
    get:
      summary: Download event logs
      parameters:
      - name: base-app-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{base-app-id}/{attempt-id}/logs:
    get:
      summary: Download event logs for an attempt
      parameters:
      - name: base-app-id
        in: path
        required: true
        schema:
          type: string
      - name: attempt-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/streaming/statistics:
    get:
      summary: Streaming statistics
      parameters:
      - $ref: '#/components/parameters/AppId'
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/streaming/receivers:
    get:
      summary: Streaming receivers
      parameters:
      - $ref: '#/components/parameters/AppId'
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/streaming/receivers/{stream-id}:
    get:
      summary: Streaming receiver details
      parameters:
      - $ref: '#/components/parameters/AppId'
      - name: stream-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/streaming/batches:
    get:
      summary: Streaming batches
      parameters:
      - $ref: '#/components/parameters/AppId'
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/streaming/batches/{batch-id}:
    get:
      summary: Streaming batch details
      parameters:
      - $ref: '#/components/parameters/AppId'
      - name: batch-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/streaming/batches/{batch-id}/operations:
    get:
      summary: Streaming batch operations
      parameters:
      - $ref: '#/components/parameters/AppId'
      - name: batch-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/streaming/batches/{batch-id}/operations/{outputOp-id}:
    get:
      summary: Streaming output operation details
      parameters:
      - $ref: '#/components/parameters/AppId'
      - name: batch-id
        in: path
        required: true
        schema:
          type: string
      - name: outputOp-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/sql:
    get:
      summary: List SQL executions
      parameters:
      - $ref: '#/components/parameters/AppId'
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/sql/{execution-id}:
    get:
      summary: Get SQL execution details
      parameters:
      - $ref: '#/components/parameters/AppId'
      - name: execution-id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
      tags:
      - Applications
  /applications/{app-id}/environment:
    get:
      summary: Application environment
      parameters:
      - $ref: '#/components/parameters/AppId'
      responses:
        '200':
          description: OK
      tags:
      - Applications
components:
  parameters:
    AppId:
      name: app-id
      in: path
      required: true
      schema:
        type: string
x-generated-from: https://spark.apache.org/docs/latest/monitoring.html
x-generated-by: claude-crawl-2026-05-08