Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 805b4c37-3160-414b-a248-19bab1ab7c28 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T15:41:57.586723+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
805b4c37-3160-414b-a248-19bab1ab7c28coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:41:57.586723+00:00
3c2c954e-a479-4f82-82f6-13e16647fa53coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:41:57.536172+00:00
c51c9e0b-a18b-41ff-8770-a08bd9b6f5decoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:41:57.332357+00:00
cfad9193-6ebb-44ce-894c-f78ecf3c3391coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:41:57.284128+00:00
a318296f-bdaa-44e3-a14b-d86f4ffa040fcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T15:41:57.233899+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0058  (coder)