Eval Report: ci-pr-smoke

Profile: gdm-swebench-lite-v1 | Tasks: 2 | Pass rate: 100.0% | Cost: $0.0020

Task IDBandScorePassedCost
python-bugfix-easy-001easy0.740$0.0010
python-config-easy-001easy0.740$0.0010

Leaderboard Snapshot

Latest run: 208c5edf-8af4-4901-b4c3-3639712ca59e | Latest model: coder | Latest score: 0.740 | Recorded at: 2026-04-27T01:26:47.371460+00:00

Recent Trend

Run IDModelGit SHAScoreCreated
208c5edf-8af4-4901-b4c3-3639712ca59ecoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:26:47.371460+00:00
13f7dfe2-4d2f-408f-812b-1f83285e5236coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:26:47.330694+00:00
72da9d95-6a02-45fb-84b5-82a2d8d3cf0bcoder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:26:47.127467+00:00
d3b7ed79-c830-475f-b1f0-715e49ac4f82coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:26:47.085325+00:00
bfae3904-6d9e-4fc3-9c6b-02e31d966e63coder4669773b4fbe9d507f1396f38777a1b36998faf30.7402026-04-27T01:26:47.053489+00:00

Cost Frontier

pass_rate vs cost_usd (Pareto frontier marked with *)
* [####################] 100.0% @ $0.0070  (coder)