Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 53b22a49-d17a-420a-a090-15f40e149bf2 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-26T15:55:52.225338+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
53b22a49-d17a-420a-a090-15f40e149bf2coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T15:55:52.225338+00:00
980c6a3b-291a-492c-9c51-49b18fe900c6coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T15:55:52.152174+00:00
c7e4eccb-0ca8-4cdd-be7a-34bfb052bd0fcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T15:55:51.205822+00:00
7c2cdd0d-fd23-41c5-848b-7562ef0fe970coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T15:55:51.094088+00:00
2914849f-ccc6-41d3-a0f4-8a75c61e2551coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T15:55:51.000427+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0093  (coder)