torch
transformers
lingua-language-detector
datasketch[redis]
ftfy
joblib
tqdm
