Metadata-Version: 2.4
Name: furiosa-llm
Version: 2026.1.0
Summary: "Furiosa LLM
Author-email: "FuriosaAI, Inc." <pkg@furiosa.ai>
Requires-Python: >=3.10
Description-Content-Type: text/markdown
Classifier: Development Status :: 4 - Beta
Classifier: Environment :: Console
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: System Administrators
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Dist: furiosa-native-llm-common ~= 2026.1.0
Requires-Dist: furiosa-native-compiler ~= 2026.1.0
Requires-Dist: furiosa-native-runtime ~= 2026.1.0
Requires-Dist: furiosa-torch-ext ~= 2026.1.0
Requires-Dist: furiosa-smi-py ~= 2026.1.0
Requires-Dist: furiosa-models ~= 2026.1.0
Requires-Dist: accelerate
Requires-Dist: blake3
Requires-Dist: datasets
Requires-Dist: fastapi == 0.128.0
Requires-Dist: huggingface_hub[hf-transfer] >= 0.8.0
Requires-Dist: pydantic == 2.11.7
Requires-Dist: PyYAML
Requires-Dist: openai >= 1.99.1
Requires-Dist: openai-harmony == 0.0.4
Requires-Dist: orjson
Requires-Dist: optimum >= 1.26.0
Requires-Dist: partial-json-parser == 0.2.1.1.post5
Requires-Dist: prometheus_client >= 0.18.0
Requires-Dist: ray[default]
Requires-Dist: types-tqdm
Requires-Dist: tqdm
Requires-Dist: tabulate
Requires-Dist: torch == 2.7.0
Requires-Dist: transformers == 4.57.1
Requires-Dist: types-regex
Requires-Dist: types-tabulate
Requires-Dist: uvicorn[standard] == 0.30.6
Requires-Dist: cachetools
Requires-Dist: mpmath < 1.4
Requires-Dist: gitpython
Requires-Dist: more-itertools
Requires-Dist: mnist ; extra == "test"
Requires-Dist: mypy ; extra == "test"
Requires-Dist: pydot==2.0.0 ; extra == "test"
Requires-Dist: pytest ; extra == "test"
Requires-Dist: pytest-cov ; extra == "test"
Requires-Dist: pytest-mock ; extra == "test"
Requires-Dist: pytest-timeout ; extra == "test"
Requires-Dist: ruff ; extra == "test"
Requires-Dist: toml ; extra == "test"
Requires-Dist: typer ; extra == "test"
Requires-Dist: types-requests ; extra == "test"
Requires-Dist: types-protobuf ; extra == "test"
Requires-Dist: types-psutil ; extra == "test"
Requires-Dist: types-PyYAML ; extra == "test"
Requires-Dist: types-cachetools ; extra == "test"
Requires-Dist: zstandard ; extra == "test"
Requires-Dist: httpx == 0.27.2 ; extra == "test"
Project-URL: Bug Tracker, https://github.com/furiosa-ai/furiosa-sdk/issues
Project-URL: Documentation, https://furiosa-ai.github.io/docs
Project-URL: Home, https://furiosa.ai
Project-URL: Source Code, https://github.com/furiosa-ai/furiosa-sdk
Provides-Extra: test

# furiosa-llm

This package provides a high-performance inference engine for large language
models (LLMs) running on FuriosaAI NPUs. It is part of the Furiosa SDK. For
more information, please visit the [FuriosaAI Developer
Center](https://developer.furiosa.ai/latest/en/index.html).

