Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 5180c38a-5db1-4307-b21b-12fc25fec245 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T00:48:18.990388+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
5180c38a-5db1-4307-b21b-12fc25fec245coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:48:18.990388+00:00
4cc60372-3f49-4106-84da-1bcebcd4607bcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:48:18.898242+00:00
776397bc-5356-4a3a-85bb-60d999583c4bcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:48:18.331361+00:00
7446b168-7354-4930-af7d-a6db47c0215ecoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:48:18.236422+00:00
ab1312ce-509d-4019-a6f0-c54a8cff729acoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:48:18.166704+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0081  (coder)