Metadata-Version: 2.4
Name: medevalkit
Version: 0.1.3
Summary: A toolkit for evaluating machine learning models for healthcare applications.
Author-email: Wesley Yeung <corona-monody-7e@icloud.com>
License: MIT
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Classifier: Intended Audience :: Science/Research
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.8
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: lifelines
Requires-Dist: matplotlib
Requires-Dist: numpy
Requires-Dist: pandas
Requires-Dist: scikit-learn
Requires-Dist: scikit-survival
Requires-Dist: seaborn
Provides-Extra: dev
Requires-Dist: pytest; extra == "dev"
Requires-Dist: ruff; extra == "dev"
Requires-Dist: mypy; extra == "dev"
Requires-Dist: build; extra == "dev"
Requires-Dist: twine; extra == "dev"
Dynamic: license-file

# MedEvalKit

**MedEvalKit** is a modular and extensible Python toolkit for evaluating machine learning models, especially in healthcare applications. It provides unified APIs for computing metrics, calibration curves, bootstrap confidence intervals, and plotting diagnostic curves.

## Features

- Binary and multiclass classification support
- Threshold optimization
- Calibration error estimation
- Bootstrap confidence intervals
- ROC, PR, and calibration plotting
- Simulate results at different incidence rates

## Installation

```bash
pip install medevalkit
```

## Usage Example

```python
from medevalkit import Evaluate

clf.fit(X_train, y_train)
y_prob = clf.predict_proba(X_test)

evaluator = Evaluate(y_true=y_test, y_prob=y_prob, classification=True, threshold=threshold)
report = evaluator.generate_report(bootstrap=True)
print(report["text_report"])
```

## GitHub Repo

Visit https://github.com/wesleyyeung/medevalkit for more examples.

## License

This project is licensed under the MIT License.
