Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: b65975d6-f6ad-4e57-93a4-df545d98d326 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T01:12:28.043566+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
b65975d6-f6ad-4e57-93a4-df545d98d326coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:12:28.043566+00:00
94effe6f-aef7-4b79-ac9e-f61a72beaf42coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:12:28.000585+00:00
c7385d94-e407-4bea-a8cb-6bb4e970b8d8coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:12:27.819200+00:00
3a4ec23b-c11d-42ac-b4e7-347f675fecaccoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:12:27.776193+00:00
795cf715-c0b0-4704-9e67-cfdce0a713afcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:12:27.736723+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0074  (coder)