Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 6fcd83ba-47f7-4f82-a89a-92b1e4700101 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T12:13:10.939259+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
6fcd83ba-47f7-4f82-a89a-92b1e4700101coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:13:10.939259+00:00
26b8b40f-1bfb-49fe-978d-3f35ec6c35e5coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:13:10.790792+00:00
6f050640-c7fe-46de-9306-ce0a505227f7coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:13:09.810763+00:00
58c4d31e-fec5-43d9-99b9-b32b928a270acoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:13:09.671383+00:00
f96e7fe8-1713-47a2-be5f-b924e3d0a7fdcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:13:09.565613+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0064  (coder)