Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 48824a62-06c0-47a4-a03f-729d52824abe | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T12:09:42.654771+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
48824a62-06c0-47a4-a03f-729d52824abecoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:09:42.654771+00:00
63c9a85d-17ce-462a-9fef-c5befee18b3ecoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:09:42.557383+00:00
4cc08de5-3e28-4ea7-8289-b76d5e20d58ccoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:09:42.127655+00:00
a56aad5b-c8b7-4657-802b-42ac84771399coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:09:42.046110+00:00
b1a4f83e-d13b-43b6-84e3-410938a6d994coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:09:41.956536+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0064  (coder)