Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 2d621494-cea4-4872-94e7-94b8280dcd08 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T11:49:48.656149+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
2d621494-cea4-4872-94e7-94b8280dcd08coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:49:48.656149+00:00
e1e47bab-ffa8-48bf-b2d6-4ce9c3f6b0bccoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:49:48.539364+00:00
cd4eea7c-2de2-48f5-b8fd-22b78059ecf5coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:49:47.691348+00:00
93b0349b-e358-4dc5-ad1a-ba08a619356fcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:49:47.593203+00:00
c9c28dc9-3423-4a4e-9112-f02f1299620ccoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:49:47.475201+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0067  (coder)