Metadata-Version: 2.4
Name: fast_dataindex
Version: 0.1.2
Summary: Data tool helpers for PaddleNLP pre-training.
Home-page: https://github.com/PaddlePaddle/PaddleNLP/blob/develop/model_zoo/ernie-1.0/data_tools
Author: PaddleNLP Team
Author-email: paddlenlp@baidu.com
License: Apache 2.0
Classifier: Programming Language :: C++
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
Description-Content-Type: text/markdown
Requires-Dist: numpy<=1.26.4
Requires-Dist: pybind11
Dynamic: author
Dynamic: author-email
Dynamic: classifier
Dynamic: description
Dynamic: description-content-type
Dynamic: home-page
Dynamic: license
Dynamic: requires-dist
Dynamic: requires-python
Dynamic: summary

# fast_dataindex
Package for helpers.cpp 

> https://github.com/PaddlePaddle/PaddleNLP/blob/develop/model_zoo/ernie-1.0/data_tools/helpers.cpp

Build linux packages. 
- x86
```
docker run --rm -e PLAT=manylinux2014_x86_64 -v `pwd`:/io quay.io/pypa/manylinux2014_x86_64 bash -x /io/package/build.sh
```
- aarch64
```
docker run --rm -e PLAT=manylinux2014_aarch64 -v `pwd`:/io quay.io/pypa/manylinux2014_aarch64 bash -x /io/package/build.sh
```

upload wheel
```
python -m twine upload ./wheelhouse/* --verbose
```

build for local useage.
```
pip wheel ./ --no-deps -w wheelhouse/
```
