Metadata-Version: 2.4
Name: flint-llm
Version: 0.1.0
Summary: Deploy LLMs to Kubernetes.
Author: Flint contributors
License: Apache-2.0
Project-URL: Homepage, https://github.com/flint-llm/flint
Project-URL: Issues, https://github.com/flint-llm/flint/issues
Project-URL: Changelog, https://github.com/flint-llm/flint/blob/main/CHANGELOG.md
Keywords: llm,kubernetes,vllm,ollama,tgi,inference,deploy
Classifier: Development Status :: 3 - Alpha
Classifier: Environment :: Console
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: POSIX :: Linux
Classifier: Operating System :: MacOS
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: System :: Systems Administration
Requires-Python: >=3.12
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: click<9,>=8.1
Requires-Dist: httpx<1,>=0.27
Requires-Dist: jinja2<4,>=3.1
Requires-Dist: kubernetes<40,>=29.0
Requires-Dist: pydantic<3,>=2.0
Requires-Dist: pyyaml<7,>=6.0
Provides-Extra: dev
Requires-Dist: ruff>=0.4; extra == "dev"
Requires-Dist: mypy>=1.10; extra == "dev"
Requires-Dist: pytest>=8.0; extra == "dev"
Requires-Dist: pytest-cov>=5.0; extra == "dev"
Requires-Dist: pre-commit>=3.7; extra == "dev"
Requires-Dist: types-PyYAML>=6.0; extra == "dev"
Dynamic: license-file

# Flint

Deploy LLMs to Kubernetes.

> **v0.1.0 — early (alpha) release.** Interfaces may still change; try it on a
> non-production cluster first. The GPU serving paths (vLLM, TGI) are best
> validated on your own hardware.

Flint is an open-source CLI that deploys large language models to your own Kubernetes cluster and routes traffic between versions. It uses your existing kubeconfig; there is no Flint server to operate.

## Install

```bash
pip install flint-llm    # the distribution is flint-llm; the CLI command is `flint`
```

## Status

Alpha — v0.1.0. See [CHANGELOG.md](CHANGELOG.md) for what's included and
[docs/troubleshooting.md](docs/troubleshooting.md) for common errors.

## License

Apache 2.0. See [LICENSE](LICENSE).
