Metadata-Version: 2.4
Name: flyteplugins-spark
Version: 2.2.4
Summary: Spark plugin for flyte
Author-email: Kevin Su <pingsutw@users.noreply.github.com>
Requires-Python: >=3.10
Description-Content-Type: text/markdown
Requires-Dist: pyspark
Requires-Dist: flyte

# Union Spark Plugin

Union can execute Spark jobs natively on a Kubernetes Cluster, which manages a virtual cluster’s lifecycle, spin-up, and tear down. It leverages the open-sourced Spark On K8s Operator and can be enabled without signing up for any service. This is like running a transient spark cluster — a type of cluster spun up for a specific Spark job and torn down after completion.

To install the plugin, run the following command:

```bash
pip install --pre flyteplugins-spark
```
