Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 767cbd55-6286-4bfd-bc51-520d050f5b91 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T00:57:59.103606+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
767cbd55-6286-4bfd-bc51-520d050f5b91coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:57:59.103606+00:00
59f4a2c9-1c93-4414-a16a-49eb368a20a5coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:57:58.775620+00:00
f9467016-7c57-4740-94f3-fd34977bde60coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:57:57.814083+00:00
0f4cf503-47c8-454f-8084-fe56341c41a6coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:57:57.178152+00:00
dd0d74b7-dc1b-4974-92a5-5d3f9158e267coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T00:57:56.644981+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0079  (coder)