Metadata-Version: 2.4
Name: sparkless
Version: 4.19.0
Summary: PySpark-like DataFrame API in Python—no JVM. Uses robin-sparkless (Rust/Polars) as the execution engine.
License-Expression: MIT
Project-URL: Homepage, https://github.com/eddiethedean/robin-sparkless
Project-URL: Documentation, https://robin-sparkless.readthedocs.io/
Project-URL: Repository, https://github.com/eddiethedean/robin-sparkless
Project-URL: Issues, https://github.com/eddiethedean/robin-sparkless/issues
Project-URL: Changelog, https://github.com/eddiethedean/robin-sparkless/blob/main/CHANGELOG.md
Keywords: pyspark,polars,dataframe,spark,etl
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Programming Language :: Python :: 3.14
Classifier: Programming Language :: Rust
Classifier: Topic :: Scientific/Engineering
Requires-Python: >=3.11
Description-Content-Type: text/markdown
Requires-Dist: sparkless-native==4.19.0
Provides-Extra: dev
Requires-Dist: pytest; extra == "dev"
Requires-Dist: pandas; extra == "dev"
Requires-Dist: pytest-xdist; extra == "dev"
Requires-Dist: hypothesis; extra == "dev"
Requires-Dist: pytest-timeout; extra == "dev"
Requires-Dist: polars; extra == "dev"
Requires-Dist: pyarrow; extra == "dev"
Provides-Extra: jdbc
Requires-Dist: testcontainers; extra == "jdbc"
Requires-Dist: psycopg2-binary; extra == "jdbc"
Requires-Dist: pymysql; extra == "jdbc"
Requires-Dist: pymssql; extra == "jdbc"
Requires-Dist: oracledb; extra == "jdbc"
Provides-Extra: pyspark
Requires-Dist: pyspark<3.6,>=3.5; extra == "pyspark"
Requires-Dist: delta-spark<4,>=3.0; extra == "pyspark"
Provides-Extra: pyspark4
Requires-Dist: pyspark<4.2,>=4.0; extra == "pyspark4"
Requires-Dist: delta-spark<5,>=4.0; extra == "pyspark4"
Provides-Extra: testing
Requires-Dist: sparkless-testing==4.19.0; extra == "testing"
Provides-Extra: server
Requires-Dist: sparkless-server==4.19.0; extra == "server"
Provides-Extra: connect
Requires-Dist: sparkless-server[connect]==4.19.0; extra == "connect"
Provides-Extra: server-duckdb
Requires-Dist: sparkless-server-duckdb==4.19.0; extra == "server-duckdb"
Provides-Extra: connect-duckdb
Requires-Dist: sparkless-server-duckdb[connect]==4.19.0; extra == "connect-duckdb"

# Sparkless

**PySpark-style DataFrames in Python. No JVM required.**

[![PyPI](https://img.shields.io/pypi/v/sparkless.svg)](https://pypi.org/project/sparkless/)
[![Python versions](https://img.shields.io/pypi/pyversions/sparkless.svg)](https://pypi.org/project/sparkless/)
[![Documentation](https://readthedocs.org/projects/robin-sparkless/badge/?version=latest)](https://robin-sparkless.readthedocs.io/en/latest/)

Sparkless brings familiar DataFrame and SQL APIs to local development and
testing. Its Rust/Polars engine runs your transformations without Java or a
Spark cluster.

## Install

Requires **Python 3.11+**:

```bash
python -m pip install "sparkless>=4,<5"
```

## Quick start

```python
from sparkless.sql import SparkSession, functions as F

spark = SparkSession.builder.app_name("example").get_or_create()
df = spark.createDataFrame([("Alice", 25), ("Bob", 30)], ["name", "age"])
df.filter(F.col("age") >= 30).select("name").show()
spark.stop()
```

Use common transformations, joins, aggregations, windows, SQL, and file I/O.
For tests, install `sparkless[testing]` to get the backend-independent
`sparkless_testing` helpers. They let one pytest suite run with Sparkless or real
PySpark.

Sparkless runs on one machine and implements a subset of PySpark behavior.
See [Before you adopt](https://github.com/eddiethedean/robin-sparkless/blob/main/docs/BEFORE_YOU_ADOPT.md)
for compatibility and limitations.

### Supported platforms

Prebuilt wheels cover Linux, macOS, and Windows. See the
[platform guide](https://github.com/eddiethedean/robin-sparkless/blob/main/docs/python_getting_started.md#supported-platforms)
and [PyPI files](https://pypi.org/project/sparkless/#files) for your release.

## Learn more

| Guide | What you'll find |
| --- | --- |
| [Getting started](https://github.com/eddiethedean/robin-sparkless/blob/main/docs/python_getting_started.md) | Installation, extras, and examples |
| [Python API](https://github.com/eddiethedean/robin-sparkless/blob/main/docs/PYTHON_API_REFERENCE.md) | DataFrames, functions, SQL, and Arrow export |
| [Testing](https://github.com/eddiethedean/robin-sparkless/blob/main/docs/TESTING_GUIDE.md) | Run the same tests with Sparkless and PySpark |
| [Spark Connect](https://github.com/eddiethedean/robin-sparkless/blob/main/docs/SPARK_CONNECT.md) | Native server setup and the 4.18 supported subset |

[Full documentation](https://robin-sparkless.readthedocs.io/) ·
[Source and contributing](https://github.com/eddiethedean/robin-sparkless/blob/main/CONTRIBUTING.md) ·
[Issues](https://github.com/eddiethedean/robin-sparkless/issues) ·
[MIT license](https://github.com/eddiethedean/robin-sparkless/blob/main/LICENSE).
