Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 0a41e11c-aef2-4e5e-bdbe-12803efe7984 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T01:18:39.779069+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
0a41e11c-aef2-4e5e-bdbe-12803efe7984coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:18:39.779069+00:00
3db61a29-3b27-4091-a296-ce2dabd8d53ecoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:18:39.712494+00:00
1f195dce-8cc8-4c68-99a2-30c166cebb30coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:18:39.518255+00:00
87cea764-d9f5-497d-99ef-d25ec15d2994coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:18:39.451272+00:00
32bac14d-fa8e-4a04-bb89-ad129c4d8b36coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:18:39.386192+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0073  (coder)