Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: dbaf0e7f-397a-470d-aba3-6c27f4bc8268 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T00:55:14.388756+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
dbaf0e7f-397a-470d-aba3-6c27f4bc8268coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:55:14.388756+00:00
58c0d41e-7881-4dc5-9cf6-981995574d37coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:55:14.315976+00:00
030f664f-e3fd-4c1a-8837-1d48ab6d80c3coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:55:14.180712+00:00
53d7ea69-1db9-4ea4-adf9-15bb677134d6coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:55:14.144944+00:00
977a2da9-6b62-4d99-99ab-0a1db58e79fdcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:55:14.113326+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0080  (coder)