Apache Spark

Apache Spark SQL API

Spark module for structured data processing with DataFrame and Dataset APIs. Provides a SQL interface and supports various data sources including Parquet, ORC, JSON, CSV, JDBC, Hive, and Delta Lake. The Spark SQL API supports Scala, Python, Java, and R bindings.

GitHub

Documentation

📖
Documentation
https://spark.apache.org/docs/latest/sql-programming-guide.html

Other Resources

🔗
SDKs
Scala API Reference
🔗
SDKs
Python API Reference
🔗
SDKs
Java API Reference
🔗
APIsJSON
https://raw.githubusercontent.com/api-evangelist/apache-spark/refs/heads/main/apis.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/apache-spark-sql-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

API entry from apis.yml

apis.yml Raw ↑ 
aid: apache-spark:apache-spark-sql-api
name: Apache Spark SQL API
description: Spark module for structured data processing with DataFrame and Dataset APIs. Provides a SQL
  interface and supports various data sources including Parquet, ORC, JSON, CSV, JDBC, Hive, and Delta
  Lake. The Spark SQL API supports Scala, Python, Java, and R bindings.
humanURL: https://spark.apache.org/docs/latest/sql-programming-guide.html
tags:
- DataFrames
- SQL
- Structured Data
properties:
- type: Documentation
  url: https://spark.apache.org/docs/latest/sql-programming-guide.html
- type: SDKs
  url: https://spark.apache.org/docs/latest/api/scala/org/apache/spark/sql/index.html
  title: Scala API Reference
- type: SDKs
  url: https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql/index.html
  title: Python API Reference
- type: SDKs
  url: https://spark.apache.org/docs/latest/api/java/index.html?org/apache/spark/sql/package-summary.html
  title: Java API Reference