Metadata-Version: 2.1
Name: gguf-cutter
Version: 0.0.4
Summary: cutter/quantizor for gguf (bf/f16)
Author-email: calcuis <info@calcu.io>
Description-Content-Type: text/markdown
Classifier: License :: OSI Approved :: MIT License
Requires-Dist: tqdm
Project-URL: Download, https://github.com/calcuis/gguf-quantizor/releases
Project-URL: GitHub, https://github.com/calcuis/gguf-quantizor
Project-URL: Homepage, https://gguf.org
Project-URL: Issues, https://github.com/calcuis/gguf-quantizor/issues
Project-URL: reddit, https://www.reddit.com/r/gguf

### cutter/quantizor for gguf

#### install it via pip/pip3
```
pip install gguf-cutter
```
#### download the cutter by (if no py command; use python/python3 instead)
```
py -m gguf_cutter
```
### how to use it
tag: q2_k, q3_k_s, q3_k_m, q3_k_l, q4_k_s, q4_k_m, q5_k_s, q5_k_m, q6_k, q5_0, q5_1, q4_0, q4_1, q8_0
```
.\quantizor.exe [input_path] [output_path] [tag]
```
#### example:
if you want to cut a `f16` gguf into `q4_k_m`, you should execute the `command` above in that way (put your f16 gguf file in the current directory with `quantizor.exe` together)
```
.\quantizor.exe your-gguf-f16.gguf output-gguf-q4_k_m.gguf q4_k_m
```
then, after completing the process, the quantized `q_4_k_m` will be saved in the current directory
