Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: c2b20e48-0adb-4f7d-ae90-32d87b120b5a | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T01:24:15.727545+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
c2b20e48-0adb-4f7d-ae90-32d87b120b5acoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:24:15.727545+00:00
7a3afe73-493c-425c-bac3-3f0bd0cfcf9ecoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:24:15.301020+00:00
5c17144c-028c-44d7-abe6-81e18f2de599coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:24:14.436675+00:00
0d23926a-a5d3-4169-9402-99c662ae4298coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:24:13.947878+00:00
c3580b73-a86b-4191-baf3-ce9d5aaac212coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:24:13.719367+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0071  (coder)