Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 1e5e72d2-e376-42d6-97f0-a64738487daa | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T00:34:20.397488+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
1e5e72d2-e376-42d6-97f0-a64738487daacoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:34:20.397488+00:00
e3699329-eb21-40a7-9ef2-786902c57f5dcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:34:20.323781+00:00
fd1075f4-e4f6-480a-a3f9-ce535f28b14dcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:34:19.968170+00:00
f93b4556-b9cf-4d0c-868b-848c632b01adcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:34:19.892856+00:00
1b819b53-f003-4fb1-a08d-b43e4e6b92e5coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:34:19.819815+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0085  (coder)