Metadata-Version: 2.4
Name: riptoken
Version: 0.0.1
Summary: Fast BPE tokenizer for LLMs
Author-email: Dae Choi <daechoi70@gmail.com>
License-Expression: MIT
Requires-Python: >=3.9
