Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: f2d57d02-42a3-4b36-910e-894cd5db2bb7 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T11:54:51.795148+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
f2d57d02-42a3-4b36-910e-894cd5db2bb7coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:54:51.795148+00:00
9677c618-913b-469f-97f2-ebe8bc1bf9c3coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:54:51.664664+00:00
3f2fc4d1-b242-4543-aa28-93dd6627ae5ecoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:54:50.884676+00:00
c8bd9c1f-90f2-43c8-a495-22ce97eca293coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:54:50.769043+00:00
4f3a7bb8-ae24-48da-a670-1c5a08e37916coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:54:50.663741+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0066  (coder)