Metadata-Version: 2.4
Name: rftokenizer
Version: 3.0.0
Summary: A character-wise tokenizer for morphologically rich languages
Home-page: https://github.com/amir-zeldes/RFTokenizer
Download-URL: https://github.com/amir-zeldes/RFTokenizer/releases/tag/v3.0.0
Author: Amir Zeldes
Author-email: amir.zeldes@georgetown.edu
License: Apache License, Version 2.0
Keywords: NLP,tokenization,segmentation,morphology,morphological,Hebrew,Arabic,Coptic,word,splitting,tokenizer
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 2
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
License-File: LICENSE.md
Requires-Dist: scikit-learn
Requires-Dist: numpy
Requires-Dist: pandas
Requires-Dist: xgboost
Requires-Dist: hyperopt
Dynamic: author
Dynamic: author-email
Dynamic: classifier
Dynamic: download-url
Dynamic: home-page
Dynamic: keywords
Dynamic: license
Dynamic: license-file
Dynamic: requires-dist
Dynamic: summary
