Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 00e1fe86-6584-4330-938a-ea74075e3fe4 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T01:06:06.546165+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
00e1fe86-6584-4330-938a-ea74075e3fe4coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:06:06.546165+00:00
263cd5c8-872d-477c-9ff0-35c48de6b74dcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:06:06.490091+00:00
698e8889-c911-4478-854d-73adb6710dbdcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:06:06.277019+00:00
b0f4eba0-8b2e-40d4-8503-9925240c11efcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:06:06.230755+00:00
48a67889-1753-4451-92ef-f118cfbdcad0coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:06:06.171953+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0076  (coder)