
Matrix report — logs
       │                     c1                    │                     c8                    
engine │          TTFT          TPOT         tok/s │          TTFT          TPOT         tok/s 
───────────────────────────────────────────────────────────────────────────────────────────────
arbi   │     1767/1758       3.5/4.4       193/164 │   34428/32525     11.4/20.2       177/154 
vllm   │     5157/4544       3.2/4.2       122/116 │   21773/10627     25.7/40.7       170/149 
sglang │     4893/4655       3.2/4.1       125/116 │   20689/19564     20.0/25.4       172/156 
cells: tqkv/bf16 · TTFT,TPOT=ms median · tok/s=aggregate · best / worst>20% / worst-close / plain mid
