Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 5425d815-a26f-4757-9e20-3392bdce3ab8 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T00:43:44.133384+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
5425d815-a26f-4757-9e20-3392bdce3ab8coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:43:44.133384+00:00
bffe3154-6e6b-457a-acbe-a6cea5317965coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:43:44.111233+00:00
6209c5ec-7521-482e-9b48-42f138599065coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:43:43.967227+00:00
5d807d96-892d-4d63-ab69-fa24f97d300ccoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:43:43.923300+00:00
1ab4bc83-8a06-4df9-8066-e039238494fdcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:43:43.891488+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0084  (coder)