Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 0e91e69c-2b0b-40a0-ab18-4b3d5356d400 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-26T16:04:42.253658+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
0e91e69c-2b0b-40a0-ab18-4b3d5356d400coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T16:04:42.253658+00:00
d348ec49-2046-4f33-9a86-8e24d1e1548acoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T16:04:42.194337+00:00
f2ae35a2-5e26-405c-b8a0-56d163b4d64ccoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T16:04:42.050230+00:00
802d039f-63cc-4c85-b125-485f74e881afcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T16:04:42.002588+00:00
b985c2bf-3ed3-435a-a8dd-e610205ce07ccoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T16:04:41.936590+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0092  (coder)