# Apache PySpark

**Canonical:** https://apis.io/providers/pyspark/  
**Website:** https://spark.apache.org/  
**APIs profiled:** 5

Python API for Apache Spark - A unified analytics engine for large-scale data processing supporting batch processing, streaming, machine learning, and graph computing.

## Kin Score — 16.8 / 100 (emerging)

Scored 2026-08-25 under rubric 0.14.0. Trend: flat (+0.0 from 16.8).

| Facet | Score |
|---|---|
| Discoverability | 55.6 |
| Contract Quality | 0.0 |
| Governance | 0.0 |
| Contract Governance | 0.0 |
| Operational Transparency | 36.8 |
| Developer Ergonomics | 16.7 |
| Commercial Clarity | 15.8 |
| Access Clarity | 15.8 |

## Agent readiness — 2.5 (human-only)

| Dimension | Value |
|---|---|
| Spec Presence | no |
| Agentic Access | no |
| Reversibility Documented | no |
| MCP Server | no |
| Auth Clarity | no |
| Idempotency | no |
| Error Semantics | no |
| OpenAPI Examples | no |
| Rate Limit Signal | documented |
| Event Surface Described | no |
| Agent Skills | no |
| Well Known Catalog | no |
| Consent Identity | no |
| Agent Card | no |
| Dry Run Mode | no |
| Delegated Identity | no |
| Protected Resource Metadata | no |
| Dynamic Client Registration | no |
| Agentic Commerce | no |

## Access

Freemium — onboarding: unknown, pricing: freemium, trial: no (confidence: medium).

## APIs (5)

- **PySpark Core API** — Core Spark functionality including RDDs, SparkContext, and basic operations.
- **PySpark SQL** — Structured data processing with DataFrame and SQL operations.
- **PySpark Streaming** — Real-time stream processing capabilities using DStreams and Structured Streaming.
- **PySpark MLlib** — Machine learning library with scalable algorithms for classification, regression, clustering, and more.
- **PySpark ML (DataFrame-based)** — DataFrame-based machine learning API with pipelines and feature transformers.

## Security (2)

- **Pyspark Domain Security** — TLSv1.3 · HSTS · DMARC
- **Pyspark Vulnerability Disclosure** — security.txt · contact published

## Plans (1)

- **Pyspark Plans Pricing**

## Tags

Big Data, Data Processing, Distributed Computing, Machine-Learning, Python, Streaming

---

Profiled by [API Evangelist](https://apievangelist.com) and published on [APIs.io](https://apis.io/providers/pyspark/). Scores are computed from the provider's own public artifacts under a published rubric.