Metadata-Version: 2.4
Name: purism
Version: 1.0.0
Summary: Automatic data filtering library specialized in Korean data purification
Author: Lumia101
Project-URL: Homepage, https://github.com/Lumia101/purism/tree/main
Requires-Python: >=3.11
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: torch
Requires-Dist: transformers
Requires-Dist: bitsandbytes
Requires-Dist: lingua-language-detector
Requires-Dist: datasketch[redis]
Requires-Dist: ftfy
Dynamic: license-file

# Purism: Automatic data filtering library specialized in Korean data purification
> **Puri**fy **s**yste**m**

## Summary
This repository is an automatic data filtering library specialized in Korean data purification.
 
# Quickstart
Coming soon...

## API
