Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 40e6884b-548f-4f1b-b3f3-0d5b12c34776 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T11:31:47.724606+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
40e6884b-548f-4f1b-b3f3-0d5b12c34776coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:31:47.724606+00:00
03146597-d1e0-4c4a-b683-8b7c680648cdcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:31:47.588908+00:00
59a5ed30-b66f-4499-a9c2-446a20237592coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:31:46.824965+00:00
d1f0dc6a-9412-4ed2-9bc0-21d399f116d8coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:31:46.722085+00:00
027814e4-521a-472c-a60d-aa54a27458fccoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T11:31:46.587024+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0069  (coder)