EVALARC / SUITE
Every job, explicit criteria.
Python and JavaScript reference conformance · PASSED
3
jobs with every attempt resolved
Each job has its own task, budget, and acceptance rules. Scores stay within their task; there is no cross-domain average.
Job decisions
durable-kv · coding · Gate: ACCEPTED
Mean assessed score: 1. Resolved attempts: 1/1. Completed: 1. Invalid: 0.
Acceptance rules and checks
{
"gate": {
"min_mean_score": 1.0,
"min_resolution_rate": 1.0,
"required_dimensions": []
},
"decision": {
"accepted": true,
"valid": true,
"checks": [
{
"name": "mean_score",
"minimum": 1.0,
"observed": 1.0,
"passed": true
},
{
"name": "resolution_rate",
"minimum": 1.0,
"observed": 1.0,
"passed": true
}
],
"reasons": []
}
}durable-kv · coding · Gate: ACCEPTED
Mean assessed score: 1. Resolved attempts: 1/1. Completed: 1. Invalid: 0.
Acceptance rules and checks
{
"gate": {
"min_mean_score": 1.0,
"min_resolution_rate": 1.0,
"required_dimensions": []
},
"decision": {
"accepted": true,
"valid": true,
"checks": [
{
"name": "mean_score",
"minimum": 1.0,
"observed": 1.0,
"passed": true
},
{
"name": "resolution_rate",
"minimum": 1.0,
"observed": 1.0,
"passed": true
}
],
"reasons": []
}
}support-routing · business-tools · Gate: ACCEPTED
Mean assessed score: 1. Resolved attempts: 1/1. Completed: 1. Invalid: 0.
Acceptance rules and checks
{
"gate": {
"min_mean_score": 1.0,
"min_resolution_rate": 1.0,
"required_dimensions": []
},
"decision": {
"accepted": true,
"valid": true,
"checks": [
{
"name": "mean_score",
"minimum": 1.0,
"observed": 1.0,
"passed": true
},
{
"name": "resolution_rate",
"minimum": 1.0,
"observed": 1.0,
"passed": true
}
],
"reasons": []
}
}Run record
Manifest SHA-256: ae478f5b926dab4eee42bb1b4eb0c3a87446da0d09f5b27f8ebd273199802478
Created: 2026-09-14T04:55:44.416536+00:00
Host wall seconds: 27.208
Suite JSON · Original configuration · Resolved plan · JUnit acceptance gates · Progress events