Updated: 2026-05-26T10:38:51.459828+00:00
Recent runs: 100
Status counts: OK: 100
Tier counts: nightly: 33, post-merge: 23, pr-smoke: 44
Taxonomy counts: wrong-file: 55, wrong-logic: 11
Budget exceeded: 0
Memorisation detected: 22
| Generated | Tier | Status | Suite | Profile | Pass/Total | Cost | Memorisation | Taxonomy | Artifacts |
|---|---|---|---|---|---|---|---|---|---|
| 2026-05-26T10:38:51.459828+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 3/8 | 0.0080 | yes | wrong-file: 5 | markdown | html | manifest |
| 2026-05-26T10:38:49.454381+00:00 | nightly | OK | ci-nightly | profile | 300/301 | 3.0100 | yes | wrong-logic: 1 | markdown | html | manifest |
| 2026-05-26T10:38:44.130169+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 300/300 | 0.3000 | no | none | markdown | html | manifest |
| 2026-05-26T10:38:21.744068+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-26T10:38:17.317034+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-26T10:38:14.906886+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-26T10:38:10.929414+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-26T10:38:09.252285+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 2/2 | 0.0020 | no | none | markdown | html | manifest |
| 2026-05-26T10:38:08.363877+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-26T10:34:34.446840+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 3/8 | 0.0080 | yes | wrong-file: 5 | markdown | html | manifest |
| 2026-05-26T10:34:32.305373+00:00 | nightly | OK | ci-nightly | profile | 300/301 | 3.0100 | yes | wrong-logic: 1 | markdown | html | manifest |
| 2026-05-26T10:34:25.535120+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 300/300 | 0.3000 | no | none | markdown | html | manifest |
| 2026-05-26T10:33:57.642938+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-26T10:33:52.692741+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-26T10:33:49.824268+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-26T10:33:44.675413+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-26T10:33:42.656504+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 2/2 | 0.0020 | no | none | markdown | html | manifest |
| 2026-05-26T10:33:41.106234+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-25T20:16:17.193397+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T20:44:29.711843+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 3/8 | 0.0080 | yes | wrong-file: 5 | markdown | html | manifest |
| 2026-05-23T20:44:27.644075+00:00 | nightly | OK | ci-nightly | profile | 300/301 | 3.0100 | yes | wrong-logic: 1 | markdown | html | manifest |
| 2026-05-23T20:44:22.756095+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 300/300 | 0.3000 | no | none | markdown | html | manifest |
| 2026-05-23T20:43:49.196419+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T20:43:43.052544+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:43:40.163035+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T20:43:33.979782+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:43:31.607587+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 2/2 | 0.0020 | no | none | markdown | html | manifest |
| 2026-05-23T20:43:30.617460+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:38:58.291759+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 3/8 | 0.0080 | yes | wrong-file: 5 | markdown | html | manifest |
| 2026-05-23T20:38:56.111652+00:00 | nightly | OK | ci-nightly | profile | 300/301 | 3.0100 | yes | wrong-logic: 1 | markdown | html | manifest |
| 2026-05-23T20:38:51.016618+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 300/300 | 0.3000 | no | none | markdown | html | manifest |
| 2026-05-23T20:38:11.022762+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T20:38:04.732672+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:38:01.795334+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T20:37:55.476696+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:37:53.036625+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 2/2 | 0.0020 | no | none | markdown | html | manifest |
| 2026-05-23T20:37:52.052911+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:25:35.602248+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 3/8 | 0.0080 | yes | wrong-file: 5 | markdown | html | manifest |
| 2026-05-23T20:25:33.983964+00:00 | nightly | OK | ci-nightly | profile | 300/301 | 3.0100 | yes | wrong-logic: 1 | markdown | html | manifest |
| 2026-05-23T20:25:29.720993+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 300/300 | 0.3000 | no | none | markdown | html | manifest |
| 2026-05-23T20:25:07.142157+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T20:24:59.587342+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:24:55.821733+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T20:24:51.596295+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:24:49.725951+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 2/2 | 0.0020 | no | none | markdown | html | manifest |
| 2026-05-23T20:24:48.981147+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:21:14.861420+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 3/8 | 0.0080 | yes | wrong-file: 5 | markdown | html | manifest |
| 2026-05-23T20:21:13.366720+00:00 | nightly | OK | ci-nightly | profile | 300/301 | 3.0100 | yes | wrong-logic: 1 | markdown | html | manifest |
| 2026-05-23T20:21:09.490425+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 300/300 | 0.3000 | no | none | markdown | html | manifest |
| 2026-05-23T20:20:48.706419+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T20:20:44.503328+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:20:42.531758+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T20:20:38.612354+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:20:36.757263+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 2/2 | 0.0020 | no | none | markdown | html | manifest |
| 2026-05-23T20:20:35.923861+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:14:11.077810+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 3/8 | 0.0080 | yes | wrong-file: 5 | markdown | html | manifest |
| 2026-05-23T20:14:09.634291+00:00 | nightly | OK | ci-nightly | profile | 300/301 | 3.0100 | yes | wrong-logic: 1 | markdown | html | manifest |
| 2026-05-23T20:14:06.107130+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 300/300 | 0.3000 | no | none | markdown | html | manifest |
| 2026-05-23T20:13:45.174552+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T20:13:41.327786+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:13:39.438892+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T20:13:35.595470+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:13:33.959427+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 2/2 | 0.0020 | no | none | markdown | html | manifest |
| 2026-05-23T20:13:33.211239+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:07:49.206654+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 3/8 | 0.0080 | yes | wrong-file: 5 | markdown | html | manifest |
| 2026-05-23T20:07:47.564028+00:00 | nightly | OK | ci-nightly | profile | 300/301 | 3.0100 | yes | wrong-logic: 1 | markdown | html | manifest |
| 2026-05-23T20:07:43.839478+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 300/300 | 0.3000 | no | none | markdown | html | manifest |
| 2026-05-23T20:07:24.570398+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T20:07:21.017799+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:07:19.200542+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T20:07:15.689666+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T20:07:14.211153+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 2/2 | 0.0020 | no | none | markdown | html | manifest |
| 2026-05-23T20:07:13.479490+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T19:48:37.058223+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 3/8 | 0.0080 | yes | wrong-file: 5 | markdown | html | manifest |
| 2026-05-23T19:48:35.243349+00:00 | nightly | OK | ci-nightly | profile | 300/301 | 3.0100 | yes | wrong-logic: 1 | markdown | html | manifest |
| 2026-05-23T19:48:31.098536+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 300/300 | 0.3000 | no | none | markdown | html | manifest |
| 2026-05-23T19:48:07.198752+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T19:48:02.591538+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T19:48:00.364933+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T19:47:55.780680+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T19:47:54.025090+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 2/2 | 0.0020 | no | none | markdown | html | manifest |
| 2026-05-23T19:47:53.265272+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T19:44:12.846135+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 3/8 | 0.0080 | yes | wrong-file: 5 | markdown | html | manifest |
| 2026-05-23T19:44:10.960390+00:00 | nightly | OK | ci-nightly | profile | 300/301 | 3.0100 | yes | wrong-logic: 1 | markdown | html | manifest |
| 2026-05-23T19:44:06.155147+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 300/300 | 0.3000 | no | none | markdown | html | manifest |
| 2026-05-23T19:43:38.198635+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T19:43:29.773845+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T19:43:27.489066+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T19:43:22.982381+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T19:43:21.172741+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 2/2 | 0.0020 | no | none | markdown | html | manifest |
| 2026-05-23T19:43:20.317559+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T19:15:12.407786+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 3/8 | 0.0080 | yes | wrong-file: 5 | markdown | html | manifest |
| 2026-05-23T19:15:10.803613+00:00 | nightly | OK | ci-nightly | profile | 300/301 | 3.0100 | yes | wrong-logic: 1 | markdown | html | manifest |
| 2026-05-23T19:15:06.796640+00:00 | nightly | OK | ci-nightly | gdm-swebench-lite-v1 | 300/300 | 0.3000 | no | none | markdown | html | manifest |
| 2026-05-23T19:14:45.826994+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T19:14:41.975932+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T19:14:40.123880+00:00 | post-merge | OK | ci-post-merge | gdm-swebench-lite-v1 | 50/50 | 0.0500 | no | none | markdown | html | manifest |
| 2026-05-23T19:14:36.250115+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| 2026-05-23T19:14:34.835893+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 2/2 | 0.0020 | no | none | markdown | html | manifest |
| 2026-05-23T19:14:34.134633+00:00 | pr-smoke | OK | ci-pr-smoke | gdm-swebench-lite-v1 | 15/15 | 0.0150 | no | none | markdown | html | manifest |
| Generated | Tier | Task | Taxonomy | Score | Cost | Report |
|---|---|---|---|---|---|---|
| 2026-05-26T10:38:51.459828+00:00 | nightly | canary-shell-ops-004 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-26T10:38:51.459828+00:00 | nightly | canary-python-cache-005 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-26T10:38:51.459828+00:00 | nightly | canary-python-regression-002 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-26T10:38:51.459828+00:00 | nightly | canary-typescript-auth-006 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-26T10:38:51.459828+00:00 | nightly | canary-typescript-session-003 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-26T10:38:49.454381+00:00 | nightly | canary-1 | wrong-logic | 0.489 | 0.0100 | report |
| 2026-05-26T10:34:34.446840+00:00 | nightly | canary-shell-ops-004 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-26T10:34:34.446840+00:00 | nightly | canary-python-cache-005 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-26T10:34:34.446840+00:00 | nightly | canary-python-regression-002 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-26T10:34:34.446840+00:00 | nightly | canary-typescript-auth-006 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-26T10:34:34.446840+00:00 | nightly | canary-typescript-session-003 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-26T10:34:32.305373+00:00 | nightly | canary-1 | wrong-logic | 0.489 | 0.0100 | report |
| 2026-05-23T20:44:29.711843+00:00 | nightly | canary-shell-ops-004 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-23T20:44:29.711843+00:00 | nightly | canary-python-cache-005 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-23T20:44:29.711843+00:00 | nightly | canary-python-regression-002 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-23T20:44:29.711843+00:00 | nightly | canary-typescript-auth-006 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-23T20:44:29.711843+00:00 | nightly | canary-typescript-session-003 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-23T20:44:27.644075+00:00 | nightly | canary-1 | wrong-logic | 0.489 | 0.0100 | report |
| 2026-05-23T20:38:58.291759+00:00 | nightly | canary-shell-ops-004 | wrong-file | 0.310 | 0.0010 | report |
| 2026-05-23T20:38:58.291759+00:00 | nightly | canary-python-cache-005 | wrong-file | 0.310 | 0.0010 | report |