Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: b2853a52-ea95-43e8-94ff-7fe551c4dd6c | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T00:31:03.376597+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
b2853a52-ea95-43e8-94ff-7fe551c4dd6ccoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:31:03.376597+00:00
b09ebdda-489b-4d80-ac1e-ccee6fde0d0ecoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:31:03.319786+00:00
1686a551-d580-4128-a5e3-83c5076ca615coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:31:03.221580+00:00
17af20d2-d240-44cf-8910-2a5e88285113coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:31:03.183326+00:00
4baeef7e-b396-46b5-bd3e-7e2cab1fcee4coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:31:03.150661+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0087  (coder)