Metadata-Version: 2.4
Name: superfluid-cli
Version: 0.1.10
Summary: One serving daemon for local LLM inference, across runtimes and machines
Author: Base Compute
License-Expression: Apache-2.0
License-File: LICENSE
License-File: NOTICE
Keywords: llm,inference,serving,llama-cpp,mlx
Classifier: Development Status :: 4 - Beta
Classifier: Environment :: Console
Classifier: Intended Audience :: Developers
Classifier: Operating System :: MacOS
Classifier: Operating System :: POSIX :: Linux
Classifier: Programming Language :: Rust
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Project-URL: Homepage, https://superfluid.sh
Project-URL: Documentation, https://superfluid.sh
Project-URL: Source, https://github.com/basecompute/superfluid
Project-URL: Changelog, https://github.com/basecompute/superfluid/blob/main/CHANGELOG.md
Project-URL: Issues, https://github.com/basecompute/superfluid/issues
Requires-Python: >=3.9
Description-Content-Type: text/markdown

# superfluid

One serving daemon for local LLM inference, across runtimes and machines. superfluid puts one scheduler, one durable session log and one set of APIs (OpenAI, Anthropic, Ollama) in front of llama.cpp, MLX and baseRT.

```sh
pip install superfluid-cli            # or: pipx install superfluid-cli, uv tool install superfluid-cli
superfluid serve unsloth/Qwen3.8-27B-GGUF:UD-Q4_K_M
```

This package is the prebuilt superfluid release for macOS on Apple silicon (macOS 15 or later) and Linux on x86-64 or arm64 (glibc 2.28 or later), with the `superfluid` command. It has no Python API and needs nothing from your Python beyond running the command. The runtimes themselves (llama.cpp, MLX, baseRT) are installed by superfluid on first use, under `~/.superfluid`, never into your Python environment.

Update it with pip (`pip install --upgrade superfluid-cli`); `superfluid self update` leaves a pip install to pip and says so.

Documentation: <https://superfluid.sh> · Source: <https://github.com/basecompute/superfluid>

The package is named `superfluid-cli` because `superfluid` on PyPI is an unrelated project.

## License

Apache-2.0; see LICENSE and NOTICE in the package. The baseRT engine superfluid can install is a separate product under its own license.
