lllm3090

local models on one RTX 3090

engine-

model-

endpointhttp://127.0.0.1:1919

VRAM-

Installed

Available to download

Sized for this card. Context figures assume a q8 KV cache.

Engine logconnecting…

…