### review (10 tasks) - separated: none (every rung's interval overlaps another's)

| rung | accepted | share | 95% interval | answer correct | no answer | median wall s | median model s | cost USD |
| -- | -- | -- | -- | -- | -- | -- | -- | -- |
| local-qwen3.8-27b | 7/10 | 70% | 40%-89% | 7 | 1 | 77.8 | 7.2 | 0.0000 (10 receipts) |
| glm-5.3-flash | 10/10 | 100% | 72%-100% | 10 | 0 | 58.8 | n/a | not measured |
| glm-5.3 | 9/10 | 90% | 60%-98% | 9 | 0 | 49.7 | n/a | not measured |
| openrouter-nemotron-ultra | 2/10 | 20% | 6%-51% | 6 | 3 | 206.7 | 125.2 | 0.0000 (9 receipts) |
| openrouter-nemotron-super | 8/10 | 80% | 49%-94% | 9 | 0 | 145.9 | 76.2 | 0.0000 (10 receipts) |
| unpinned-ladder | 8/10 | 80% | 49%-94% | 8 | 0 | 84.2 | 8.9 | 0.0000 (10 receipts) |

### code_generation (10 tasks) - separated: none (every rung's interval overlaps another's)

| rung | accepted | share | 95% interval | answer correct | no answer | median wall s | median model s | cost USD |
| -- | -- | -- | -- | -- | -- | -- | -- | -- |
| local-qwen3.8-27b | 0/10 | 0% | 0%-28% | 3 | 1 | 84.9 | 10.0 | 0.0000 (10 receipts) |
| glm-5.3-flash | 2/10 | 20% | 6%-51% | 2 | 8 | 175.1 | n/a | not measured |
| glm-5.3 | 3/10 | 30% | 11%-60% | 4 | 6 | 175.1 | n/a | not measured |
| openrouter-nemotron-ultra | 0/10 | 0% | 0%-28% | 3 | 6 | 137.3 | 43.7 | 0.0000 (9 receipts) |
| openrouter-nemotron-super | 0/10 | 0% | 0%-28% | 0 | 9 | 115.6 | 58.3 | 0.0000 (7 receipts) |
| unpinned-ladder | 0/10 | 0% | 0%-28% | 2 | 0 | 87.5 | 15.0 | 0.0000 (10 receipts) |
