Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 8dc503a4-6cbf-4795-9a16-69693e7d429b | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T15:43:54.137184+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
8dc503a4-6cbf-4795-9a16-69693e7d429bcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:43:54.137184+00:00
0494d101-e209-4388-882e-604e3b86d74bcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:43:54.103703+00:00
99cdf571-6969-4d87-a1cd-9112006d88d8coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:43:53.833823+00:00
aa8c7996-0d84-4fa6-adb5-8271a347f913coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:43:53.810865+00:00
b01c706c-e540-4904-8d29-c842d54f13bacoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:43:53.774262+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0058  (coder)