Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: b24b2d4c-0177-4c00-a58b-69c6570191f9 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T12:41:06.626941+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
b24b2d4c-0177-4c00-a58b-69c6570191f9coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:41:06.626941+00:00
edb53bb6-326f-400f-87a7-48c1acef3e2dcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:41:06.527144+00:00
4063c109-b6fc-467d-afe9-a6a71907e5dacoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:41:05.519064+00:00
cbe171c1-4cb5-4637-9320-07433b150449coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:41:05.354633+00:00
5d145873-8635-4612-8c69-33d0bc102dcecoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:41:05.264674+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0061  (coder)