Eval Report: ci-nightly

Profile: profile | Tasks: 301 | Pass rate: 99.7% | Cost: $3.0100

Task IDBandScorePassedCost
python-security-fix-easy-001easy0.999$0.0100
typescript-security-fix-easy-001easy0.999$0.0100
python-bugfix-easy-001easy0.999$0.0100
typescript-bugfix-easy-001easy0.999$0.0100
python-performance-easy-001easy0.999$0.0100
typescript-performance-easy-001easy0.999$0.0100
python-test-writing-easy-001easy0.999$0.0100
typescript-test-writing-easy-001easy0.999$0.0100
python-multi-file-easy-001easy0.999$0.0100
typescript-multi-file-easy-001easy0.999$0.0100
python-refactor-easy-001easy0.999$0.0100
typescript-refactor-easy-001easy0.999$0.0100
python-config-easy-001easy0.999$0.0100
typescript-config-easy-001easy0.999$0.0100
python-recovery-easy-001easy0.999$0.0100
typescript-recovery-easy-001easy0.999$0.0100
python-dependency-easy-001easy0.999$0.0100
typescript-dependency-easy-001easy0.999$0.0100
python-explain-easy-001easy0.999$0.0100
typescript-explain-easy-001easy0.999$0.0100
python-security-fix-medium-001medium0.999$0.0100
shell-security-fix-medium-001medium0.999$0.0100
python-bugfix-medium-001medium0.999$0.0100
shell-bugfix-medium-001medium0.999$0.0100
python-performance-medium-001medium0.999$0.0100
shell-performance-medium-001medium0.999$0.0100
python-test-writing-medium-001medium0.999$0.0100
shell-test-writing-medium-001medium0.999$0.0100
python-multi-file-medium-001medium0.999$0.0100
shell-multi-file-medium-001medium0.999$0.0100
python-refactor-medium-001medium0.999$0.0100
shell-refactor-medium-001medium0.999$0.0100
python-config-medium-001medium0.999$0.0100
shell-config-medium-001medium0.999$0.0100
python-recovery-medium-001medium0.999$0.0100
shell-recovery-medium-001medium0.999$0.0100
python-dependency-medium-001medium0.999$0.0100
shell-dependency-medium-001medium0.999$0.0100
python-explain-medium-001medium0.999$0.0100
shell-explain-medium-001medium0.999$0.0100
typescript-security-fix-hard-001hard0.999$0.0100
shell-security-fix-hard-001hard0.999$0.0100
typescript-bugfix-hard-001hard0.999$0.0100
shell-bugfix-hard-001hard0.999$0.0100
typescript-performance-hard-001hard0.999$0.0100
shell-performance-hard-001hard0.999$0.0100
typescript-test-writing-hard-001hard0.999$0.0100
shell-test-writing-hard-001hard0.999$0.0100
typescript-multi-file-hard-001hard0.999$0.0100
shell-multi-file-hard-001hard0.999$0.0100
typescript-refactor-hard-001hard0.999$0.0100
shell-refactor-hard-001hard0.999$0.0100
typescript-config-hard-001hard0.999$0.0100
shell-config-hard-001hard0.999$0.0100
typescript-recovery-hard-001hard0.999$0.0100
shell-recovery-hard-001hard0.999$0.0100
typescript-dependency-hard-001hard0.999$0.0100
shell-dependency-hard-001hard0.999$0.0100
typescript-explain-hard-001hard0.999$0.0100
shell-explain-hard-001hard0.999$0.0100
python-security-fix-easy-001easy0.999$0.0100
typescript-security-fix-easy-001easy0.999$0.0100
python-bugfix-easy-001easy0.999$0.0100
typescript-bugfix-easy-001easy0.999$0.0100
python-performance-easy-001easy0.999$0.0100
typescript-performance-easy-001easy0.999$0.0100
python-test-writing-easy-001easy0.999$0.0100
typescript-test-writing-easy-001easy0.999$0.0100
python-multi-file-easy-001easy0.999$0.0100
typescript-multi-file-easy-001easy0.999$0.0100
python-refactor-easy-001easy0.999$0.0100
typescript-refactor-easy-001easy0.999$0.0100
python-config-easy-001easy0.999$0.0100
typescript-config-easy-001easy0.999$0.0100
python-recovery-easy-001easy0.999$0.0100
typescript-recovery-easy-001easy0.999$0.0100
python-dependency-easy-001easy0.999$0.0100
typescript-dependency-easy-001easy0.999$0.0100
python-explain-easy-001easy0.999$0.0100
typescript-explain-easy-001easy0.999$0.0100
python-security-fix-medium-001medium0.999$0.0100
shell-security-fix-medium-001medium0.999$0.0100
python-bugfix-medium-001medium0.999$0.0100
shell-bugfix-medium-001medium0.999$0.0100
python-performance-medium-001medium0.999$0.0100
shell-performance-medium-001medium0.999$0.0100
python-test-writing-medium-001medium0.999$0.0100
shell-test-writing-medium-001medium0.999$0.0100
python-multi-file-medium-001medium0.999$0.0100
shell-multi-file-medium-001medium0.999$0.0100
python-refactor-medium-001medium0.999$0.0100
shell-refactor-medium-001medium0.999$0.0100
python-config-medium-001medium0.999$0.0100
shell-config-medium-001medium0.999$0.0100
python-recovery-medium-001medium0.999$0.0100
shell-recovery-medium-001medium0.999$0.0100
python-dependency-medium-001medium0.999$0.0100
shell-dependency-medium-001medium0.999$0.0100
python-explain-medium-001medium0.999$0.0100
shell-explain-medium-001medium0.999$0.0100
typescript-security-fix-hard-001hard0.999$0.0100
shell-security-fix-hard-001hard0.999$0.0100
typescript-bugfix-hard-001hard0.999$0.0100
shell-bugfix-hard-001hard0.999$0.0100
typescript-performance-hard-001hard0.999$0.0100
shell-performance-hard-001hard0.999$0.0100
typescript-test-writing-hard-001hard0.999$0.0100
shell-test-writing-hard-001hard0.999$0.0100
typescript-multi-file-hard-001hard0.999$0.0100
shell-multi-file-hard-001hard0.999$0.0100
typescript-refactor-hard-001hard0.999$0.0100
shell-refactor-hard-001hard0.999$0.0100
typescript-config-hard-001hard0.999$0.0100
shell-config-hard-001hard0.999$0.0100
typescript-recovery-hard-001hard0.999$0.0100
shell-recovery-hard-001hard0.999$0.0100
typescript-dependency-hard-001hard0.999$0.0100
shell-dependency-hard-001hard0.999$0.0100
typescript-explain-hard-001hard0.999$0.0100
shell-explain-hard-001hard0.999$0.0100
python-security-fix-easy-001easy0.999$0.0100
typescript-security-fix-easy-001easy0.999$0.0100
python-bugfix-easy-001easy0.999$0.0100
typescript-bugfix-easy-001easy0.999$0.0100
python-performance-easy-001easy0.999$0.0100
typescript-performance-easy-001easy0.999$0.0100
python-test-writing-easy-001easy0.999$0.0100
typescript-test-writing-easy-001easy0.999$0.0100
python-multi-file-easy-001easy0.999$0.0100
typescript-multi-file-easy-001easy0.999$0.0100
python-refactor-easy-001easy0.999$0.0100
typescript-refactor-easy-001easy0.999$0.0100
python-config-easy-001easy0.999$0.0100
typescript-config-easy-001easy0.999$0.0100
python-recovery-easy-001easy0.999$0.0100
typescript-recovery-easy-001easy0.999$0.0100
python-dependency-easy-001easy0.999$0.0100
typescript-dependency-easy-001easy0.999$0.0100
python-explain-easy-001easy0.999$0.0100
typescript-explain-easy-001easy0.999$0.0100
python-security-fix-medium-001medium0.999$0.0100
shell-security-fix-medium-001medium0.999$0.0100
python-bugfix-medium-001medium0.999$0.0100
shell-bugfix-medium-001medium0.999$0.0100
python-performance-medium-001medium0.999$0.0100
shell-performance-medium-001medium0.999$0.0100
python-test-writing-medium-001medium0.999$0.0100
shell-test-writing-medium-001medium0.999$0.0100
python-multi-file-medium-001medium0.999$0.0100
shell-multi-file-medium-001medium0.999$0.0100
python-refactor-medium-001medium0.999$0.0100
shell-refactor-medium-001medium0.999$0.0100
python-config-medium-001medium0.999$0.0100
shell-config-medium-001medium0.999$0.0100
python-recovery-medium-001medium0.999$0.0100
shell-recovery-medium-001medium0.999$0.0100
python-dependency-medium-001medium0.999$0.0100
shell-dependency-medium-001medium0.999$0.0100
python-explain-medium-001medium0.999$0.0100
shell-explain-medium-001medium0.999$0.0100
typescript-security-fix-hard-001hard0.999$0.0100
shell-security-fix-hard-001hard0.999$0.0100
typescript-bugfix-hard-001hard0.999$0.0100
shell-bugfix-hard-001hard0.999$0.0100
typescript-performance-hard-001hard0.999$0.0100
shell-performance-hard-001hard0.999$0.0100
typescript-test-writing-hard-001hard0.999$0.0100
shell-test-writing-hard-001hard0.999$0.0100
typescript-multi-file-hard-001hard0.999$0.0100
shell-multi-file-hard-001hard0.999$0.0100
typescript-refactor-hard-001hard0.999$0.0100
shell-refactor-hard-001hard0.999$0.0100
typescript-config-hard-001hard0.999$0.0100
shell-config-hard-001hard0.999$0.0100
typescript-recovery-hard-001hard0.999$0.0100
shell-recovery-hard-001hard0.999$0.0100
typescript-dependency-hard-001hard0.999$0.0100
shell-dependency-hard-001hard0.999$0.0100
typescript-explain-hard-001hard0.999$0.0100
shell-explain-hard-001hard0.999$0.0100
python-security-fix-easy-001easy0.999$0.0100
typescript-security-fix-easy-001easy0.999$0.0100
python-bugfix-easy-001easy0.999$0.0100
typescript-bugfix-easy-001easy0.999$0.0100
python-performance-easy-001easy0.999$0.0100
typescript-performance-easy-001easy0.999$0.0100
python-test-writing-easy-001easy0.999$0.0100
typescript-test-writing-easy-001easy0.999$0.0100
python-multi-file-easy-001easy0.999$0.0100
typescript-multi-file-easy-001easy0.999$0.0100
python-refactor-easy-001easy0.999$0.0100
typescript-refactor-easy-001easy0.999$0.0100
python-config-easy-001easy0.999$0.0100
typescript-config-easy-001easy0.999$0.0100
python-recovery-easy-001easy0.999$0.0100
typescript-recovery-easy-001easy0.999$0.0100
python-dependency-easy-001easy0.999$0.0100
typescript-dependency-easy-001easy0.999$0.0100
python-explain-easy-001easy0.999$0.0100
typescript-explain-easy-001easy0.999$0.0100
python-security-fix-medium-001medium0.999$0.0100
shell-security-fix-medium-001medium0.999$0.0100
python-bugfix-medium-001medium0.999$0.0100
shell-bugfix-medium-001medium0.999$0.0100
python-performance-medium-001medium0.999$0.0100
shell-performance-medium-001medium0.999$0.0100
python-test-writing-medium-001medium0.999$0.0100
shell-test-writing-medium-001medium0.999$0.0100
python-multi-file-medium-001medium0.999$0.0100
shell-multi-file-medium-001medium0.999$0.0100
python-refactor-medium-001medium0.999$0.0100
shell-refactor-medium-001medium0.999$0.0100
python-config-medium-001medium0.999$0.0100
shell-config-medium-001medium0.999$0.0100
python-recovery-medium-001medium0.999$0.0100
shell-recovery-medium-001medium0.999$0.0100
python-dependency-medium-001medium0.999$0.0100
shell-dependency-medium-001medium0.999$0.0100
python-explain-medium-001medium0.999$0.0100
shell-explain-medium-001medium0.999$0.0100
typescript-security-fix-hard-001hard0.999$0.0100
shell-security-fix-hard-001hard0.999$0.0100
typescript-bugfix-hard-001hard0.999$0.0100
shell-bugfix-hard-001hard0.999$0.0100
typescript-performance-hard-001hard0.999$0.0100
shell-performance-hard-001hard0.999$0.0100
typescript-test-writing-hard-001hard0.999$0.0100
shell-test-writing-hard-001hard0.999$0.0100
typescript-multi-file-hard-001hard0.999$0.0100
shell-multi-file-hard-001hard0.999$0.0100
typescript-refactor-hard-001hard0.999$0.0100
shell-refactor-hard-001hard0.999$0.0100
typescript-config-hard-001hard0.999$0.0100
shell-config-hard-001hard0.999$0.0100
typescript-recovery-hard-001hard0.999$0.0100
shell-recovery-hard-001hard0.999$0.0100
typescript-dependency-hard-001hard0.999$0.0100
shell-dependency-hard-001hard0.999$0.0100
typescript-explain-hard-001hard0.999$0.0100
shell-explain-hard-001hard0.999$0.0100
python-security-fix-easy-001easy0.999$0.0100
typescript-security-fix-easy-001easy0.999$0.0100
python-bugfix-easy-001easy0.999$0.0100
typescript-bugfix-easy-001easy0.999$0.0100
python-performance-easy-001easy0.999$0.0100
typescript-performance-easy-001easy0.999$0.0100
python-test-writing-easy-001easy0.999$0.0100
typescript-test-writing-easy-001easy0.999$0.0100
python-multi-file-easy-001easy0.999$0.0100
typescript-multi-file-easy-001easy0.999$0.0100
python-refactor-easy-001easy0.999$0.0100
typescript-refactor-easy-001easy0.999$0.0100
python-config-easy-001easy0.999$0.0100
typescript-config-easy-001easy0.999$0.0100
python-recovery-easy-001easy0.999$0.0100
typescript-recovery-easy-001easy0.999$0.0100
python-dependency-easy-001easy0.999$0.0100
typescript-dependency-easy-001easy0.999$0.0100
python-explain-easy-001easy0.999$0.0100
typescript-explain-easy-001easy0.999$0.0100
python-security-fix-medium-001medium0.999$0.0100
shell-security-fix-medium-001medium0.999$0.0100
python-bugfix-medium-001medium0.999$0.0100
shell-bugfix-medium-001medium0.999$0.0100
python-performance-medium-001medium0.999$0.0100
shell-performance-medium-001medium0.999$0.0100
python-test-writing-medium-001medium0.999$0.0100
shell-test-writing-medium-001medium0.999$0.0100
python-multi-file-medium-001medium0.999$0.0100
shell-multi-file-medium-001medium0.999$0.0100
python-refactor-medium-001medium0.999$0.0100
shell-refactor-medium-001medium0.999$0.0100
python-config-medium-001medium0.999$0.0100
shell-config-medium-001medium0.999$0.0100
python-recovery-medium-001medium0.999$0.0100
shell-recovery-medium-001medium0.999$0.0100
python-dependency-medium-001medium0.999$0.0100
shell-dependency-medium-001medium0.999$0.0100
python-explain-medium-001medium0.999$0.0100
shell-explain-medium-001medium0.999$0.0100
typescript-security-fix-hard-001hard0.999$0.0100
shell-security-fix-hard-001hard0.999$0.0100
typescript-bugfix-hard-001hard0.999$0.0100
shell-bugfix-hard-001hard0.999$0.0100
typescript-performance-hard-001hard0.999$0.0100
shell-performance-hard-001hard0.999$0.0100
typescript-test-writing-hard-001hard0.999$0.0100
shell-test-writing-hard-001hard0.999$0.0100
typescript-multi-file-hard-001hard0.999$0.0100
shell-multi-file-hard-001hard0.999$0.0100
typescript-refactor-hard-001hard0.999$0.0100
shell-refactor-hard-001hard0.999$0.0100
typescript-config-hard-001hard0.999$0.0100
shell-config-hard-001hard0.999$0.0100
typescript-recovery-hard-001hard0.999$0.0100
shell-recovery-hard-001hard0.999$0.0100
typescript-dependency-hard-001hard0.999$0.0100
shell-dependency-hard-001hard0.999$0.0100
typescript-explain-hard-001hard0.999$0.0100
shell-explain-hard-001hard0.999$0.0100
canary-1hard0.489$0.0100

Leaderboard Snapshot

No leaderboard data recorded yet.

Recent Trend

Run IDModelGit SHAScoreCreated
(no data)

Failure Breakdown

TaxonomyFailuresBar
(no failures)0

Recent Failures

Run IDTask IDTaxonomyScoreCostCreated
(no failures)

Cost Frontier

(no data)