Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: d4aaf3ff-3b18-4f34-9344-394fd993591b | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T11:59:14.467738+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
d4aaf3ff-3b18-4f34-9344-394fd993591bcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:59:14.467738+00:00
a21cda42-380d-4c80-8d38-bdc9b8a7358dcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:59:14.311463+00:00
57a66dad-ed3a-4c71-8b92-9be5963d51d6coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:59:13.279055+00:00
93f40087-ea24-4433-b1ad-2e911ed9f796coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:59:13.152628+00:00
76f8e1e5-5a3f-45ea-b39b-3c44a204d1b9coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:59:13.007210+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0065  (coder)