transformers
accelerate==0.20.3
sentencepiece
protobuf==3.20.*
python-snappy
pandas
nvitop
click
datasets
wandb
scipy
absl-py
torch
torchvision
torchaudio
deepspeed
