Metadata-Version: 2.4
Name: rocmate
Version: 0.5.3
Summary: Curated AMD GPU compatibility index and CLI for AI workloads — ROCm and Vulkan
Project-URL: Homepage, https://github.com/T0nd3/rocmate
Project-URL: Issues, https://github.com/T0nd3/rocmate/issues
Author-email: Benjamin Faeuster <benjamin.faeuster@web.de>
License: MIT
License-File: LICENSE
Keywords: ai,amd,gpu,llm,ollama,rocm
Classifier: Development Status :: 3 - Alpha
Classifier: Environment :: GPU
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: POSIX :: Linux
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: System :: Hardware
Requires-Python: >=3.11
Requires-Dist: pydantic>=2.6
Requires-Dist: pyyaml>=6.0
Requires-Dist: rich>=13.7
Requires-Dist: typer>=0.12
Provides-Extra: dev
Requires-Dist: mypy>=1.10; extra == 'dev'
Requires-Dist: pytest-cov>=5.0; extra == 'dev'
Requires-Dist: pytest>=8.0; extra == 'dev'
Requires-Dist: ruff>=0.5; extra == 'dev'
Description-Content-Type: text/markdown

# rocmate

[![PyPI](https://img.shields.io/pypi/v/rocmate)](https://pypi.org/project/rocmate/)
[![CI](https://github.com/T0nd3/rocmate/actions/workflows/ci.yml/badge.svg)](https://github.com/T0nd3/rocmate/actions/workflows/ci.yml)
[![Website](https://img.shields.io/badge/matrix-t0nd3.github.io%2Frocmate-blue)](https://t0nd3.github.io/rocmate/)
[![License: MIT](https://img.shields.io/github/license/T0nd3/rocmate)](LICENSE)

> Get AMD GPUs running with AI tools — without the rabbit hole.

`rocmate` is a curated compatibility index and CLI for running modern AI workloads on AMD GPUs — via ROCm or Vulkan. It tells you what works on your specific card, what to set, and what to avoid — based on configurations that real users have tested.

```
pip install rocmate
```

![rocmate doctor](https://raw.githubusercontent.com/T0nd3/rocmate/main/docs/rocmate-doctor.png)

## Why?

AMD GPUs offer great VRAM-per-dollar (especially the RX 7900 XTX with 24 GB), but getting Ollama, ComfyUI, faster-whisper, or axolotl to actually use the GPU still involves hunting through blog posts, GitHub issues, and Discord threads. Information is scattered, often outdated, and rarely specific to your chip generation (gfx1030 vs gfx1100 vs gfx1151 vs gfx1201).

`rocmate` consolidates this knowledge into one place — version-controlled, testable, community-maintained.

## Quickstart

```bash
pip install rocmate
```

**Check your system:**
```
$ rocmate doctor
✓ GPU detected: AMD Radeon RX 7900 XTX (gfx1100)
✓ ROCm found: 7.2.3
✗ User not in 'render' group — run: sudo usermod -aG render $USER
✓ Docker available
✓ Vulkan available
```

**Show the tested config for a tool:**
```bash
rocmate show llama-cpp               # auto-detects your chip
rocmate show llama-cpp --chip gfx1100
```

**Find tools by keyword:**
```bash
rocmate search llm
rocmate list --chip gfx1151          # filter by chip
```

**Install with the right ENV vars (shows plan first, asks for confirmation):**
```bash
rocmate install ollama
rocmate install ollama --chip gfx1100   # skip GPU detection

# Auto-fix detected issues
rocmate doctor --fix
```

## Supported tools

→ **[Live compatibility matrix](https://t0nd3.github.io/rocmate/)** — auto-updated on every commit.

| Tool | gfx1151<br>Radeon 8060S/8050S | gfx1100<br>RX 7900 XT/XTX | gfx1101<br>RX 7800/7700 XT | gfx1102<br>RX 7600 | gfx1030<br>RX 6800/6900 | gfx1201<br>RX 9070 |
|------|:-:|:-:|:-:|:-:|:-:|:-:|
| Ollama | ✅ | ✅ | ✅ | ✅ | ✅ | 🟡 |
| ComfyUI | 🟡 | ✅ | ✅ | 🟡 | 🟡 | — |
| faster-whisper | ✅ | ✅ | 🟡 | — | — | — |
| llama.cpp | ✅ | ✅ | ✅ | ✅ | ✅ | 🟡 |
| Stable Diffusion WebUI | 🟡 | ✅ | ✅ | 🟡 | 🟡 | — |
| vLLM | ✅ | ✅ | ✅ | 🟡 | 🟡 | 🟡 |
| Axolotl | 🟡 | ✅ | ✅ | 🟡 | 🟡 | — |
| ExLlamaV2 | 🟡 | ✅ | ✅ | 🟡 | 🟡 | — |

✅ tested · 🟡 partial / workarounds needed · — no data yet

Run `rocmate show <tool>` for chip-specific ENV vars, install hints, and tested ROCm versions.

## Status

Actively maintained by [@T0nd3](https://github.com/T0nd3) on an RX 7900 XTX. Contributions for other AMD chips are very welcome — one YAML file, five minutes. See [CONTRIBUTING.md](CONTRIBUTING.md).

## License

MIT — see [LICENSE](LICENSE).
