local models on one GPU
http://127.0.0.1:1919
Sized for this card. Context figures assume a q8 KV cache.
…