Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: f564bc0d-9e32-4421-8368-4d73eec9aae1 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-26T09:13:57.146491+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
f564bc0d-9e32-4421-8368-4d73eec9aae1coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T09:13:57.146491+00:00
0705f8cb-0f41-49ed-ad39-a60076a33fa0coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T09:13:57.058430+00:00
1dc5e7d5-b6f4-4c2f-a806-8c75ec2f5a20coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T09:13:56.724489+00:00
3b81895a-956c-47c5-b213-646edfafb6d8coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T09:13:56.649904+00:00
71d042dc-da8b-45f9-80cb-c4e0fbbe7d18coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-26T09:13:56.560311+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0099  (coder)