Metadata-Version: 2.4
Name: datawash-inspector
Version: 0.2.0
Summary: An automated end-to-end data cleaning, preprocessing, and EDA pipeline.
Home-page: https://github.com/Kishown-e22194/datawash
Author: kishown
Author-email: kishown <kishown@example.com>
Project-URL: Homepage, https://github.com/Kishown-e22194/datawash
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.8
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: pandas>=1.3.0
Requires-Dist: numpy>=1.20.0
Requires-Dist: scikit-learn>=1.0.0
Requires-Dist: scipy>=1.7.0
Requires-Dist: plotly>=5.0.0
Dynamic: author
Dynamic: home-page
Dynamic: license-file
Dynamic: requires-python

# DataWash 🔬

**DataWash Inspector** is an automated, end-to-end Python data pipeline that cleans, prunes, prepares, and visualizes your datasets with zero manual effort. It includes a built-in serverless HTML dashboard for zero-code data exploration in Google Colab!

## Installation

You can install `datawash` via pip:

```bash
pip install datawash-inspector
```

## Quick Start

It only takes a few lines of code to completely sanitize, optimize, and encode your dataset for machine learning.

```python
from datawash import DataPipeline

# 1. Initialize Pipeline
pipe = DataPipeline()

# 2. Load and Auto-Clean
pipe.load_data('your_data.csv')
pipe.sanitize_garbage().auto_type_correct()
pipe.handle_missing_values(strategy='auto')

# 3. Export Clean Data
pipe.save_data('cleaned_data.csv')
```

## The Interactive Dashboard

`datawash` comes with a fully automated EDA (Exploratory Data Analysis) dashboard. 

**For Google Colab / Jupyter Users:**
Instantly inject a serverless, interactive HTML dashboard directly inside your notebook!
```python
# Magically embeds a stunning UI into your Colab cell
pipe.show_dashboard()
```

**For Local IDE Users (VS Code, PyCharm, etc):**
Automatically generate the HTML dashboard and open it in your default web browser!
```python
# Generates the report and pops it open in Chrome/Safari/Edge
pipe.show_dashboard()
```

## Features

- **Memory Optimization:** Automatically downcasts large numbers to save memory (up to 50%+ reduction).
- **Auto-Cleaning:** Automatically converts pure whitespace strings or garbage text (`"N/A"`, `"?"`, `"-"`) to `NaN` values.
- **Smart Imputation:** Dynamically imputes missing numeric values with the median and categorical values with the mode.
- **Statistical EDA:** Calculates an advanced unified correlation matrix supporting numerical, categorical, and mixed variable types (Cramér's V, Eta, Spearman).
- **Feature Pruning:** Automatically identifies and drops highly redundant features (e.g., `> 90%` correlation) and high-cardinality IDs.

## License

This project is licensed under the MIT License.
