Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: e1f1d3fd-7f9f-4075-8574-93080cbfbfda | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T15:36:15.908711+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
e1f1d3fd-7f9f-4075-8574-93080cbfbfdacoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:36:15.908711+00:00
35300d62-40d0-4752-b95d-c88cef5396e8coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:36:15.866909+00:00
d8ef81b7-1443-4c1f-9a05-3a68bd536b8bcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:36:14.915922+00:00
3a5ecf7c-1b16-42c2-aac6-f8eaf4c19281coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:36:14.884554+00:00
c39dbca0-5a7b-4591-9b26-ec742476f988coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:36:14.849487+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0059  (coder)