Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 1b9419a3-a715-488e-b0ec-a416c6caae1f | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T00:45:40.606435+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
1b9419a3-a715-488e-b0ec-a416c6caae1fcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:45:40.606435+00:00
15bbcf0c-36f8-4561-a5db-5f1fcbfd31ffcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:45:40.552467+00:00
2982da1a-5314-4640-8b17-fcef4f974cb0coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:45:40.400647+00:00
2572d696-e5c1-485b-8826-567f0fb315e7coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:45:40.351036+00:00
bec8111b-c848-4469-8b91-ee2557a04c31coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:45:40.306129+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0083  (coder)