Metadata-Version: 2.4
Name: condi-llm
Version: 0.9.0
Summary: Distributed training and serving framework for models up to 405B parameters.
Project-URL: Homepage, https://github.com/Shimba-crypto/condi-llm
Project-URL: Documentation, https://shimba-crypto.github.io/condi-llm/
Project-URL: Repository, https://github.com/Shimba-crypto/condi-llm
Author-email: Condi Limited <hello@condi.ltd>
License-Expression: Apache-2.0
Keywords: distributed,fsdp,llm,pytorch,rlhf,training
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.9
Requires-Dist: numpy>=1.24
Requires-Dist: torch>=2.2
Requires-Dist: tqdm>=4.65
Provides-Extra: dev
Requires-Dist: mypy>=1.5; extra == 'dev'
Requires-Dist: pytest>=7.4; extra == 'dev'
Requires-Dist: ruff>=0.1; extra == 'dev'
Provides-Extra: trace
Requires-Dist: opentelemetry-api>=1.20; extra == 'trace'
Requires-Dist: opentelemetry-sdk>=1.20; extra == 'trace'
Description-Content-Type: text/markdown

`condi-llm`
``Distributed training and serving framework for models up to 405B parameters.``

`Install`
```pip install condi-llm```
``Quick start``
```python

import condi_llm as cllm

model = cllm.AutoModel.from_pretrained("condi-70b")
trainer = cllm.Trainer(model, strategy="fsdp_shard", grad_accum=32)
trainer.fit(dataset, epochs=3)
```

``License
Apache-2.0``
