Apache Livy

Apache Livy is a service that enables easy interaction with a Spark cluster over a REST interface. It allows submitting Spark jobs or snippets of Spark code, retrieving results synchronously or asynchronously, and managing Spark contexts across multiple users. Licensed under Apache 2.0.

Apache Livy publishes 3 APIs on the APIs.io network: Batches API, Sessions API, and Statements API. Tagged areas include Big Data, Interactive Computing, Open-Source, REST, and Spark.

The Apache Livy catalog on APIs.io includes 1 JSON-LD context and 2 Spectral governance rulesets.

Apache Livy’s developer surface includes documentation, getting-started guide, and 13 more developer resources.

🌐 Visit website 📡 Source on GitHub

33.1/100 thin ▬ flat Agent 22/100 agent aware open core · Apache-2.0 Full breakdown ↓
scored 2026-09-08 · rubric v0.20.0

AccessFreemium

1 APIs 7 Features 4 Use Cases

Big Data Interactive Computing Open-Source REST Spark

Kin Score

Kin Score How this is scored →
scored 2026-09-08 · rubric v0.20.0

Composite quality — 33.1/100 · thin

Contract Quality 10.9 / 20

Developer Ergonomics 3.4 / 16

Access Clarity 4.2 / 16

Operational Transparency 2.7 / 10

Contract Governance 2.8 / 10

Discoverability 4.7 / 8

Open Source Surface 1.5 / 10

Create-or-Update Ergonomics 0.0 / 10

Agent readiness — 22/100 · agent aware

Machine-Readable Contract 18 / 18

Agentic Access Contract 10 / 10

Documented Reversibility 0 / 6

MCP Server 0 / 12

Machine-Readable Auth 0 / 10

Idempotency 0 / 9

Stable Error Semantics 0 / 8

Request/Response Examples 7 / 7

Rate-Limit Signaling 7 / 7

Typed Event Surface 0 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Delegated User Identity 0 / 6

Protected Resource Metadata 0 / 5

Registration Without a Human 0 / 6

Agentic Commerce Well-Known Document 0 / 5

Open Source Surface applies to this provider. This product is open source and we read its repository directly, so Open Source Surface carries 10 points of the composite. It is scored from what the repository actually publishes — a security policy, a contribution guide, a release history, a code of conduct — read live from the provider rather than inferred from our own catalog pointers. This facet adds; nothing was taken away to make room for it. An open-source project is not excused from the commercial facets, because exemption would strip it of the points it does earn. If we have the wrong repository, or this product is not open source, say so on your provider repo and we will drop the facet rather than have you publish against it.

Create-or-Update Ergonomics applies to this provider. This API accepts writes, so it carries 10 points of the composite. It is scored from the published contracts themselves: whether a caller can create-or-update in one call, whether the write accepts a key the caller already holds, and whether the response says which branch ran. Without that, every write needs a search-and-branch in front of it, and the first time that check is skipped a duplicate record is created. Scored against the observed mean rather than raw — a provider at the catalog average is unchanged by this facet, not penalised by it.

The six quality facets above are damped to 80 points between them, because the conditional facet above carries the other 20. That is why each facet's contribution is shown against a damped maximum: raising a quality facet moves the composite by 80% of its nominal weight, not 100%. The full arithmetic is at apis.io/rating/.

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from github.com/api-evangelist/apache-livy: open an issue to ask a question, or submit a pull request to add artifacts. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

APIs 3

Individual APIs this provider publishes, each with its own machine-readable definition.

Apache Livy Batches API

Batch Spark job submission

Apache Livy Sessions API

Interactive Spark session management

Apache Livy Statements API

Code statement execution within sessions

Open Collections 4

Open, tool-agnostic API collections (OpenAPI-derived and Bruno).

API Collection

OPEN COLLECTION

Apache Livy REST Batches API

OPEN COLLECTION

Apache Livy REST Batches Sessions API

OPEN COLLECTION

Apache Livy REST Batches Statements API

OPEN COLLECTION

Pricing Plans 1

Published pricing tiers and plan structures.

Apache Livy Plans Pricing

3 plans

PLANS

Rate Limits 1

Documented rate limits and quota policies.

Apache Livy Rate Limits

5 limits

RATE LIMITS

FinOps 1

Cost, billing, and metering signals for API financial operations.

Apache Livy Finops

FINOPS

Features 7

Notable capabilities this provider offers.

Interactive Spark Sessions

Create persistent Spark contexts for interactive code execution in Python, Scala, R, and SQL.

Batch Job Submission

Submit batch Spark jobs without creating an interactive session.

Multi-Language Support

Execute code in PySpark, Spark (Scala), SparkR, and SQL.

Multi-User Impersonation

Proxy user support for multi-tenant Spark cluster access.

Asynchronous Execution

Submit jobs and poll for results asynchronously.

Log Access

Retrieve driver and executor logs for debugging.

REST Interface

Simple HTTP REST API for Spark cluster interaction without native clients.

Scroll for all 7

Semantic Vocabularies 1

JSON-LD contexts and semantic vocabularies used across these APIs.

Apache Livy Rest Api Context

12 classes · 31 properties

JSON-LD

Spectral Rules 2

Spectral governance rulesets for linting and validating these APIs.

Apache Livy API Rules

5 rules · 3 warnings 2 info

SPECTRAL

Apache Livy API Rules

18 rules · 9 errors 7 warnings 2 info

SPECTRAL

JSON Schema 12

Standalone JSON Schema definitions for this provider's data models.

BatchList

3 properties

JSON SCHEMA

Batch

5 properties

JSON SCHEMA

BatchState

2 properties

JSON SCHEMA

CreateBatchRequest

10 properties

JSON SCHEMA

CreateSessionRequest

11 properties

JSON SCHEMA

Log

4 properties

JSON SCHEMA

SessionList

3 properties

JSON SCHEMA

Session

8 properties

JSON SCHEMA

SessionState

2 properties

JSON SCHEMA

StatementList

2 properties

JSON SCHEMA

StatementRequest

2 properties

JSON SCHEMA

Statement

4 properties

JSON SCHEMA

Scroll for all 12

JSON Structure 12

JSON Structure definitions describing this provider's data shapes.

Rest Api Batch List Structure

3 properties

JSON STRUCTURE

Rest Api Batch State Structure

2 properties

JSON STRUCTURE

Rest Api Batch Structure

5 properties

JSON STRUCTURE

Rest Api Create Batch Request Structure

10 properties

JSON STRUCTURE

Rest Api Create Session Request Structure

11 properties

JSON STRUCTURE

Rest Api Log Structure

4 properties

JSON STRUCTURE

Rest Api Session List Structure

3 properties

JSON STRUCTURE

Rest Api Session State Structure

2 properties

JSON STRUCTURE

Rest Api Session Structure

8 properties

JSON STRUCTURE

Rest Api Statement List Structure

2 properties

JSON STRUCTURE

Rest Api Statement Request Structure

2 properties

JSON STRUCTURE

Rest Api Statement Structure

4 properties

JSON STRUCTURE

Scroll for all 12

Examples 12

Example request and response payloads for these APIs.

Rest Api Batch Example

5 fields

EXAMPLE

Rest Api Batch List Example

3 fields

EXAMPLE

Rest Api Batch State Example

2 fields

EXAMPLE

Rest Api Create Batch Request Example

10 fields

EXAMPLE

Rest Api Create Session Request Example

11 fields

EXAMPLE

Rest Api Log Example

4 fields

EXAMPLE

Rest Api Session Example

8 fields

EXAMPLE

Rest Api Session List Example

3 fields

EXAMPLE

Rest Api Session State Example

2 fields

EXAMPLE

Rest Api Statement Example

4 fields

EXAMPLE

Rest Api Statement List Example

2 fields

EXAMPLE

Rest Api Statement Request Example

2 fields

EXAMPLE

Scroll for all 12

Security Posture 2

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Apache Livy Domain Security

TLSv1.3 · HSTS · DMARC

SECURITY

Apache Livy Vulnerability Disclosure

security.txt · contact published

SECURITY

Agentic Access 1

Recommended x-agentic-access execution contracts for AI agents.

Apache Livy Agentic Access

15 operations · 5 acting

AGENTIC

Use Cases 4

What developers build with this provider.

Notebook Integration

Power Jupyter, Zeppelin, and other notebooks with Spark backends via Livy.

Data Engineering Pipelines

Submit Spark batch jobs from orchestration tools like Airflow and Oozie.

Interactive Data Exploration

Execute ad-hoc Spark code for exploratory data analysis.

Multi-Tenant Spark Access

Enable multiple users to share a Spark cluster with isolation via Livy sessions.

Integrations 5

Pre-built integrations with other platforms and tools.

Apache Spark

Livy requires a Spark cluster and acts as the REST gateway to Spark.

Apache Zeppelin

Zeppelin notebook backend using Livy for distributed Spark execution.

Jupyter Notebook

Jupyter sparkmagic extension uses Livy for remote Spark kernel access.

Apache Airflow

Airflow LivyOperator for submitting Spark batch jobs from DAGs.

Amazon EMR

Livy is available as an EMR application for REST-based Spark access.

Resources

Get Started 1

Portal, sign-up, and the first successful call

GettingStarted

GettingStarted

Documentation 1

Reference material describing how the API behaves

Documentation

Documentation

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

AgenticAccess

AgenticAccess

Design & Contract 3

Pagination, idempotency, versioning, errors, and events

Versioning

Versioning

SpectralRules

SpectralRules

Vocabulary

Vocabulary

Build 3

SDKs, sample code, and the tooling you integrate with

CodeOfConduct

CodeOfConduct

GitHubOrganization

GitHubOrganization

GitHubRepository

GitHubRepository

Access & Security 2

Authentication, authorization, and security posture

VulnerabilityDisclosure

VulnerabilityDisclosure

DomainSecurity

DomainSecurity

Operate 1

Status, limits, changes, and where to get help

IssueTracker

IssueTracker

Commercial 2

Pricing, plans, and the legal terms of use

License

License

TermsOfService

TermsOfService

Company 1

The organization behind the API

Website

Website

Source (apis.yml)

aid: apache-livy
name: Apache Livy
description: Apache Livy is a service that enables easy interaction with a Spark cluster over a REST interface. It allows
  submitting Spark jobs or snippets of Spark code, retrieving results synchronously or asynchronously, and managing Spark
  contexts across multiple users. Licensed under Apache 2.0.
type: Index
deliveryModel:
  model: open-core
  license: Apache-2.0
  open_source: true
  commercial: true
  callable_host: false
  label: Open core · an OSS project plus a commercial hosted product
  confidence: high
  source:
  - license
  - openapi
  - pricing
  generated: '2026-08-28'
  method: derived
accessModel:
  pricing: freemium
  onboarding: unknown
  trial: false
  try_now: false
  public: false
  label: Freemium
  confidence: medium
  source:
  - plans
  generated: '2026-07-22'
  method: derived
position: Consuming
access: 3rd-Party
image: https://kinlane-images.s3.amazonaws.com/shared/apis-json/icons/apache-livy.png
tags:
- Big Data
- Interactive Computing
- Open-Source
- REST
- Spark
tags_raw:
- Big Data
- Interactive Computing
- Open Source
- REST
- Spark
created: '2026-03-16'
modified: '2026-05-19'
url: https://raw.githubusercontent.com/api-evangelist/apache-livy/refs/heads/main/apis.yml
specificationVersion: '0.23'
apis:
- aid: apache-livy:apache-livy-batches-api
  name: Apache Livy Batches API
  description: Batch Spark job submission
  humanURL: https://livy.apache.org/docs/latest/rest-api.html
  tags:
  - Batches
  properties:
  - type: OpenAPI
    url: openapi/apache-livy-batches-api-openapi.yml
  - type: Documentation
    url: https://livy.apache.org/docs/latest/rest-api.html
- aid: apache-livy:apache-livy-sessions-api
  name: Apache Livy Sessions API
  description: Interactive Spark session management
  humanURL: https://livy.apache.org/docs/latest/rest-api.html
  tags:
  - Sessions
  properties:
  - type: OpenAPI
    url: openapi/apache-livy-sessions-api-openapi.yml
  - type: Documentation
    url: https://livy.apache.org/docs/latest/rest-api.html
- aid: apache-livy:apache-livy-statements-api
  name: Apache Livy Statements API
  description: Code statement execution within sessions
  humanURL: https://livy.apache.org/docs/latest/rest-api.html
  tags:
  - Statements
  properties:
  - type: OpenAPI
    url: openapi/apache-livy-statements-api-openapi.yml
  - type: Documentation
    url: https://livy.apache.org/docs/latest/rest-api.html
common:
- type: Website
  url: https://www.apache.org/
- type: IssueTracker
  url: https://github.com/apache/incubator-livy/issues
- type: CodeOfConduct
  url: https://github.com/apache/.github/blob/main/.github/CODE_OF_CONDUCT.md
- type: License
  name: Apache-2.0
  url: https://github.com/apache/incubator-livy/blob/master/LICENSE
- type: AgenticAccess
  url: agentic-access/apache-livy-agentic-access.yml
- type: VulnerabilityDisclosure
  url: security/apache-livy-vulnerability-disclosure.yml
- type: DomainSecurity
  url: security/apache-livy-domain-security.yml
- type: GitHubOrganization
  url: https://github.com/apache
- type: GitHubRepository
  url: https://github.com/apache/incubator-livy
- type: Documentation
  url: https://livy.apache.org/docs/latest/
- type: GettingStarted
  url: https://livy.apache.org/get-started/
- type: TermsOfService
  url: https://www.apache.org/licenses/LICENSE-2.0
- type: Versioning
  url: https://livy.apache.org/download/
- type: SpectralRules
  url: rules/apache-livy-spectral-rules.yml
- type: Vocabulary
  url: vocabulary/apache-livy-vocabulary.yaml
- type: Features
  data:
  - name: Interactive Spark Sessions
    description: Create persistent Spark contexts for interactive code execution in Python, Scala, R, and SQL.
  - name: Batch Job Submission
    description: Submit batch Spark jobs without creating an interactive session.
  - name: Multi-Language Support
    description: Execute code in PySpark, Spark (Scala), SparkR, and SQL.
  - name: Multi-User Impersonation
    description: Proxy user support for multi-tenant Spark cluster access.
  - name: Asynchronous Execution
    description: Submit jobs and poll for results asynchronously.
  - name: Log Access
    description: Retrieve driver and executor logs for debugging.
  - name: REST Interface
    description: Simple HTTP REST API for Spark cluster interaction without native clients.
- type: UseCases
  data:
  - name: Notebook Integration
    description: Power Jupyter, Zeppelin, and other notebooks with Spark backends via Livy.
  - name: Data Engineering Pipelines
    description: Submit Spark batch jobs from orchestration tools like Airflow and Oozie.
  - name: Interactive Data Exploration
    description: Execute ad-hoc Spark code for exploratory data analysis.
  - name: Multi-Tenant Spark Access
    description: Enable multiple users to share a Spark cluster with isolation via Livy sessions.
- type: Integrations
  data:
  - name: Apache Spark
    description: Livy requires a Spark cluster and acts as the REST gateway to Spark.
  - name: Apache Zeppelin
    description: Zeppelin notebook backend using Livy for distributed Spark execution.
  - name: Jupyter Notebook
    description: Jupyter sparkmagic extension uses Livy for remote Spark kernel access.
  - name: Apache Airflow
    description: Airflow LivyOperator for submitting Spark batch jobs from DAGs.
  - name: Amazon EMR
    description: Livy is available as an EMR application for REST-based Spark access.
maintainers:
- FN: Kin Lane
  email: info@apievangelist.com

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this

find_providersBrowse and filter every provider in the catalog.
get_provider_artifactsEvery artifact this provider publishes, grouped by type.
get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
get_provider_ratingPRO — composite, band, trend and facet scores.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This provider

curl "https://apis.io/api/v1/providers/apache-livy"

All providers

curl "https://apis.io/api/v1/providers?limit=25"

Every operation they expose

curl "https://apis.io/api/v1/providers/apache-livy/operations?limit=25"

How their score was established

curl "https://apis.io/api/v1/providers/apache-livy/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.