litellm
openai>=2.0
numpy
tqdm
pyrate-limiter>=3.0