Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 1c6430f2-7389-40ca-9240-501a9552d300 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T12:39:12.826553+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
1c6430f2-7389-40ca-9240-501a9552d300coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:39:12.826553+00:00
81f12e30-13f9-40be-b998-c06b317f540fcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:39:12.782761+00:00
b808323b-fe25-4210-9789-f330542acb98coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:39:12.408058+00:00
97db7251-4cf7-49d2-a01b-b35b9e21adc6coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:39:12.328643+00:00
19787524-2cba-42e7-b6b5-1302221e1827coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:39:12.242893+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0061  (coder)