Metadata-Version: 2.4
Name: pyspark-inspect
Version: 0.4.5
Summary: pyspark ASTs in Python
License: MIT
Author: Matthias Ossadnik
Author-email: ossadnik.matthias@gmail.com
Requires-Python: >=3.11,<4.0
Classifier: Development Status :: 3 - Alpha
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Programming Language :: Python :: 3.14
Requires-Dist: pyspark (>=3.5.0)
Project-URL: homepage, https://github.com/mossadnik/pyspark-inspect
Description-Content-Type: text/markdown

# pyspark-inspect

pyspark-inspect allows to inspect and manipulate pyspark Column expressions across different spark versions.

## Compatibility & Limitiations

There is only a subset of functions implemented.

Tested against:

<table>
<tr>
    <td rowspan="2">Spark Classic</td>
    <td>3.5.2</td>
    <td>Databricks Runtime 16.4</td>
</tr>
<tr>
    <td>3.5.9</td>
    <td>Apache Spark</td>
</tr>
<tr>
    <td rowspan="2">Spark Connect</td>
    <td>3.5.2</td>
    <td>Databricks Runtime 16.4</td>
</tr>
<tr>
    <td>4.2.0</td>
    <td>Databricks Serverless</td>
</tr>
</table>

## Basic Usage

```python
from pypspark.sql import functions as F
from pyspark_inspect import inspect_column
from pyspark_inspect.column import expression as E

ast = inpect_column(F.col('a') + F.col('b'))
col = ast.to_column()
```

