Metadata-Version: 2.4
Name: lifeboat
Version: 2.2.54
Summary: Self-hosted LLM inference with a control plane, load balancer and OpenAI-compatible API
Author: iterate.ai
License-Expression: LicenseRef-Proprietary
Project-URL: Homepage, https://iterate.ai/lifeboat
Project-URL: Documentation, https://docs.iterate.ai/lifeboat/
Keywords: llm,inference,openai,gguf,self-hosted,load-balancer
Classifier: Intended Audience :: Developers
Classifier: Operating System :: POSIX :: Linux
Classifier: Operating System :: MacOS :: MacOS X
Classifier: Operating System :: Microsoft :: Windows
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.10
Description-Content-Type: text/markdown
Requires-Dist: cryptography>=44.0.1
Requires-Dist: fastapi>=0.115
Requires-Dist: httpx>=0.27
Requires-Dist: pydantic>=2.9
Requires-Dist: starlette>=0.40
Requires-Dist: uvicorn>=0.32
Provides-Extra: hub
Requires-Dist: huggingface_hub>=0.26; extra == "hub"
Requires-Dist: gguf>=0.10; extra == "hub"
Provides-Extra: mlx
Requires-Dist: mlx-lm>=0.28; (sys_platform == "darwin" and platform_machine == "arm64") and extra == "mlx"

# Lifeboat

Self-hosted LLM inference with a control plane, load balancer and an
OpenAI-compatible API.

```bash
pip install lifeboat
lifeboat serve Qwen/Qwen3-0.6B-GGUF
```

See https://docs.iterate.ai/lifeboat/
