Metadata-Version: 2.4
Name: condi-slm
Version: 2.4.1
Summary: Edge-first small language model runtime. Sub-15ms first-token latency on commodity CPUs.
Project-URL: Homepage, https://github.com/Shimba-crypto/condi-llm
Project-URL: Documentation, https://shimba-crypto.github.io/condi-llm/
Project-URL: Repository, https://github.com/Shimba-crypto/condi-llm
Author-email: Condi Limited <hello@condi.ltd>
License-Expression: Apache-2.0
Keywords: edge,inference,llm,pytorch,quantization,slm
Classifier: Development Status :: 5 - Production/Stable
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.9
Requires-Dist: numpy>=1.24
Requires-Dist: torch>=2.0
Requires-Dist: tqdm>=4.65
Provides-Extra: dev
Requires-Dist: mypy>=1.5; extra == 'dev'
Requires-Dist: pytest>=7.4; extra == 'dev'
Requires-Dist: ruff>=0.1; extra == 'dev'
Provides-Extra: onnx
Requires-Dist: onnx>=1.14; extra == 'onnx'
Requires-Dist: onnxruntime>=1.16; extra == 'onnx'
Provides-Extra: server
Requires-Dist: fastapi>=0.100; extra == 'server'
Requires-Dist: uvicorn>=0.23; extra == 'server'
Description-Content-Type: text/markdown

`condi-slm`

`Small language model` runtime engineered for sub-15ms first-token latency on commodity CPUs.

`Install`
```pip install condi-slm```
