Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 2592e9b4-8624-4ac3-b3a9-a7ce20109747 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T12:21:34.953092+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
2592e9b4-8624-4ac3-b3a9-a7ce20109747coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:21:34.953092+00:00
65504589-fa55-413a-b441-3611feecebcbcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:21:34.837394+00:00
61e8ddb2-06dc-473b-82d6-526e84c36339coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:21:33.815905+00:00
b733b7b9-861e-4fd8-8225-8e2c8b9e47eccoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:21:33.745184+00:00
3e6ed865-7d2d-4547-be2a-aafcdba4705ccoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T12:21:33.664008+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0062  (coder)