Metadata-Version: 2.4
Name: furiosa-llm
Version: 2025.1.1
Summary: Furiosa LLM
Author-email: "FurioaAI, Inc." <pkg@furiosa.ai>
Requires-Python: >=3.8
Description-Content-Type: text/markdown
Classifier: Development Status :: 4 - Beta
Classifier: Environment :: Console
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: System Administrators
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Dist: furiosa-native-compiler ~= 2025.1.0
Requires-Dist: furiosa-native-runtime ~= 2025.1.0
Requires-Dist: furiosa-torch-ext ~= 2025.1.0
Requires-Dist: furiosa-llm-models ~= 2025.1.0
Requires-Dist: furiosa-model-compressor ~= 2025.1.0
Requires-Dist: furiosa-smi-py ~= 2025.1.0
Requires-Dist: accelerate
Requires-Dist: datasets
Requires-Dist: fastapi == 0.114.0
Requires-Dist: huggingface_hub >= 0.8.0
Requires-Dist: pydantic == 2.9.0
Requires-Dist: PyYAML
Requires-Dist: openai == 1.63.2
Requires-Dist: orjson
Requires-Dist: optimum
Requires-Dist: partial-json-parser == 0.2.1.1.post5
Requires-Dist: ray
Requires-Dist: torch == 2.4.1
Requires-Dist: transformers == 4.44.2
Requires-Dist: uvicorn[standard] == 0.30.6
Requires-Dist: cachetools
Requires-Dist: mpmath < 1.4
Requires-Dist: gitpython
Requires-Dist: more-itertools
Requires-Dist: mnist ; extra == "test"
Requires-Dist: mypy ; extra == "test"
Requires-Dist: pytest ; extra == "test"
Requires-Dist: pytest-cov ; extra == "test"
Requires-Dist: pytest-mock ; extra == "test"
Requires-Dist: pytest-timeout ; extra == "test"
Requires-Dist: ruff ; extra == "test"
Requires-Dist: tabulate ; extra == "test"
Requires-Dist: types-requests ; extra == "test"
Requires-Dist: types-tabulate ; extra == "test"
Requires-Dist: types-protobuf ; extra == "test"
Requires-Dist: types-psutil ; extra == "test"
Requires-Dist: types-PyYAML ; extra == "test"
Requires-Dist: types-cachetools ; extra == "test"
Requires-Dist: sentencepiece ; extra == "test"
Requires-Dist: pydot ; extra == "test"
Requires-Dist: zstandard ; extra == "test"
Requires-Dist: httpx == 0.27.2 ; extra == "test"
Project-URL: Bug Tracker, https://github.com/furiosa-ai/furiosa-sdk/issues
Project-URL: Documentation, https://furiosa-ai.github.io/docs
Project-URL: Home, https://furiosa.ai
Project-URL: Source Code, https://github.com/furiosa-ai/furiosa-sdk
Provides-Extra: test

# furiosa_llm

This is an implementation of a high-throughput inference engine for LLMs using FuriosaAI NPUs.
To learn how to build, run and tests, please refer to the [furiosa-runtime/README.md](https://github.com/furiosa-ai/furiosa-runtime/blob/main/README.md).

