Metadata-Version: 2.3
Name: llama-tui
Version: 0.1.1
Summary: Lightweight TUI manager for llama.cpp models on Raspberry Pi
Requires-Dist: click-extra>=7.12
Requires-Python: >=3.14
Description-Content-Type: text/markdown

# llama-tui

CLI manager for llama.cpp. 
Detects hardware, downloads models, launches optimized servers.
Specifically made for raspberry pi devices.

## Requirements

- Raspberry Pi OS (any model, x64/x86_64 recommended)
- Python 3.14+
- [uv](https://docs.astral.sh/uv/)
- `llama-server` (compiled with BLIS + NEON)
- `hf` CLI (huggingface-hub, authenticated)

## Install

	uv tool install llama-tui


## Setup

	llama-tui setup 	# detect hardware, select models
	llama-tui download 	# fetch enabled models
	llama-tui prep 		# system tuning (swap, governor, hugepages)


## Serve
llama-tui serve --role chat


## Other Commands

	llama-tui models 	# list enabled models
	llama-tui rpc 		# check remote RPC connectivity
	llama-tui status 	# full system & config summary
	llama-tui restore 	# revert system tuning
	llama-tui swap 		# show swap status


## Optional RPC

On a second Pi, run:

	rpc-server --host <hostname> --port 50052


Enable RPC during `setup` or edit `~/.config/llama-tui/config.toml`.

## License

MIT