Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 09eaf368-038c-4f0f-a720-9cf6cde3f15d | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T01:20:41.457489+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
09eaf368-038c-4f0f-a720-9cf6cde3f15dcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:20:41.457489+00:00
5ed1efbc-ded6-4513-b647-c1da03720599coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:20:41.424511+00:00
39a197dd-cdd2-476a-8a35-8ea25d42af01coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:20:41.318333+00:00
668a3741-7b03-499b-8153-67b27e8ecd43coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:20:41.286322+00:00
bb8c67ad-7faa-4c5d-872e-d148ac5a5cf8coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:20:41.250381+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0072  (coder)