Metadata-Version: 2.4
Name: rust_tokenizer_pyo3
Version: 0.1.0
Summary: Fast Unicode-aware tokenizer implemented in Rust (PyO3 + maturin).
License: MIT
