Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: dc3c47be-7ea4-4270-9250-42c32ab25b19 | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T01:03:43.858957+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
dc3c47be-7ea4-4270-9250-42c32ab25b19coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:03:43.858957+00:00
bfb33729-fc09-4a7e-95c5-982bae48b549coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:03:43.817526+00:00
049625e0-cc52-4f57-9d90-262a285cca4ccoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:03:43.664569+00:00
6957eac6-db94-42d5-957c-fb6d3594dea9coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:03:43.616467+00:00
1e882b7a-161b-4e05-bd7a-e70efefd93c5coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:03:43.545713+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0077  (coder)