Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: b5ef2428-ce04-4623-8e4b-5b0235927f22 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T12:16:35.355282+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
b5ef2428-ce04-4623-8e4b-5b0235927f22coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:16:35.355282+00:00
e4edea51-1cd1-44a3-96b8-0a20d5ba96f1coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:16:35.240436+00:00
fba087d8-aeac-4da6-befc-95754f72b296coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:16:34.515325+00:00
e30c3054-2358-4441-b900-bbe9c30dbda6coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:16:34.424524+00:00
c12863b4-6a30-4ebc-ad04-61a5e0a39258coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:16:34.336532+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0063  (coder)