 ██ ██ ▓▓ ██   ModelRoom
 ██ ██ ██ ░░   Which local model packages fit your machine.
 ▓▓ ██ ░░ ░░   modelroom 1.0.0 · github.com/jm-vis/modelroom

 folder    not chosen yet          the first question asks where results live
 daemon    Ollama 0.34.2           reachable, 5 models, 4 of them local
 machine   workstation             not measured in this results folder yet

 Five steps: configuration, packages, context, measurement, results.
 Files are written as the run goes on. Esc leaves a list, Ctrl-C leaves at any point.

 ── Step 1 of 5  Configuration ──────────────────────────────────────────
 ? Where should results live?  this folder
   another computer: pick its profile below, or import the file made there
 ? Which machines should the result cover?  this machine
 ? What kind of machine is this?  laptop
   graphics  NVIDIA RTX PRO 3000 Blackwell Generation Laptop GPU · 12.0 GB · nvidia-smi · usable (CUDA)
   graphics  Intel(R) Graphics · shared memory · windows · not counted: integrated graphics shares the system memory
   measured: laptop, one graphics card, 12 GB, 128 GB memory, confirmed by llmfit
 ✓ Configuration   <results>, 1 machine

 ── Step 2 of 5  Packages ───────────────────────────────────────────────
 ? What are you looking for?  qwen
 ? Show only repositories of a publisher or a listed packager?  Yes
   catalog: shipped <day>
   searched Hugging Face at the publisher Qwen and the five listed packagers
   4 repositories, 2 of them models you can pick from
 ? Which of these models should the result cover?  Qwen3.5-9B
 ✓ Packages        1 model, 23 packages from 2 repositories

 ── Step 3 of 5  Context ────────────────────────────────────────────────
 ? How many people use it on a typical day?  1 (1 request)
 ? How much text should a model handle at once?  L  32k  24,000 words  a report or a long contract
 ✓ Context         L 32k

 ── Step 4 of 5  Measurement ────────────────────────────────────────────
   1 installed model -- a cloud model, not a package on this machine
   no ranked package is installed on this machine; the load test measures installed packages only (stage 1: no download)
 – Measurement     none in this run

 ── Step 5 of 5  Results ────────────────────────────────────────────────

 folder    <results>
 machine   laptop-00000000         laptop, 12 GB graphics, 128 GB memory, measured today
 models    Qwen3.5-9B              23 packages from unsloth and Ollama
 context   32k (entered), KV cache f16 (assumed), 1 request (from 1 user)
 speed     not measured            say Yes in step 4 to measure an installed package
 result    docs\models.md          23 packages ranked, 0 no fit

 laptop-00000000 · context L 32k
 room      graphics 11.0 GB for models (12.0 GB card minus reserve)
           memory 111.7 GB for models (127.7 GB minus reserve)
           disk 41.2 GB free on C: (Ollama models)
 loaded    Ollama holds hf.co/unsloth/DeepSeek-R1-0528-Qwen3-8B-… (5.7 GB, 5.7 GB of it on the card)
           graphics 10.2 GB free now
 #    Model                   Package                Fit          Speed         Memory    Download
 ───────────────────────────────────────────────────────────────────────────────────────────────────
 1    Qwen3.5-9B              unsloth · UD-Q6_K_XL   tight        –             10.5 GB   8.2 GB
 2    Qwen3.5-9B              unsloth · Q6_K         fits         –             9.2 GB    6.9 GB
 3    Qwen3.5-9B              unsloth · UD-Q5_K_XL   fits         –             8.5 GB    6.3 GB
 4    Qwen3.5-9B              unsloth · Q5_K_M       fits         –             8.3 GB    6.1 GB
 5    Qwen3.5-9B              unsloth · Q5_K_S       fits         –             8.1 GB    5.9 GB
 6    Qwen3.5-9B              unsloth · UD-Q4_K_XL   fits         –             7.7 GB    5.6 GB
 7    Qwen3.5-9B              ollama · Q4_K_M        fits         –             8.3 GB    6.1 GB
 8    Qwen3.5-9B              unsloth · Q4_K_M       fits         –             7.4 GB    5.3 GB
 9    Qwen3.5-9B              unsloth · Q4_K_S       fits         –             7.1 GB    5.0 GB
 10   Qwen3.5-9B              unsloth · Q4_1         fits         –             7.5 GB    5.4 GB
 shown     10 of 23 packages
 memory    #1–10 fit into graphics memory, budget 11.0 GB (card minus reserve, from the profile)
 speed     nothing measured in the rows shown · say Yes in step 4 to measure an installed package
 key       Fit is memory only: the package's need against a pool · ample: up to 60 % of the pool
           fits: up to 85 % · tight: up to 98 % · no fit: more
           the pool is what the mode names, minus its reserve (per card) · gpu: one card
           gpu_split: all cards together · cpu_gpu, cpu (RAM): the system memory
           system memory keeps a quarter as reserve, 2 to 16 GB, unless modelroom.toml sets it
           one memory shared by system and card counts as gpu, a quarter kept, no upper limit
           off the card, and for a fit from size the highest class is fits
           best: the least compression of the same model that fits
           modelroom rates no model family against another
           Speed is measured, see its column.

 install   #1  ollama pull hf.co/unsloth/Qwen3.5-9B-GGUF:UD-Q6_K_XL
 Quality of these models for your task: https://artificialanalysis.ai

 ✓ Results         docs\models.md

 ? Which package should be pulled into Ollama?  #9  hf.co/unsloth/Qwen3.5-9B-GGUF:Q4_K_S
 install   #9  ollama pull hf.co/unsloth/Qwen3.5-9B-GGUF:Q4_K_S
 ? Pull #9 into Ollama now? (5.0 GB)  Yes
 pulling   hf.co/unsloth/Qwen3.5-9B-GGUF:Q4_K_S
 ✓ Pulled    hf.co/unsloth/Qwen3.5-9B-GGUF:Q4_K_S · 5.0 GB · say Yes in step 4 of the next run to measure it
