← Dashboard

Human Review {{ item.module_type }}

Assess the response quality and confirm the evaluator signal.

{% if error %}
{{ error }}
{% endif %}
{% if item %} {% else %} {% endif %}
Project{{ project }}
Module{{ item.module_type }}
Raw Score{{ item.raw_score | round(4) if item.raw_score is not none else '-' }}
Calibrated Score{{ item.calibrated_score | round(4) if item.calibrated_score is not none else '-' }}
Trigger{{ item.trigger_reason }}
Created{{ item.created_at.strftime('%Y-%m-%d %H:%M UTC') if item.created_at else '-' }}
Review item not available

User Request

{{ item.prompt or "No request available" }}

Model Response

{{ item.model_response }}
{% if item.judge_details %}

Evaluation Details

{% if item.judge_details['attack_type'] %} {% endif %} {% if item.judge_details['subtype'] %} {% endif %} {% if item.judge_details['risk_level'] %} {% endif %} {% if item.judge_details['risk_reason'] %} {% endif %} {% if item.judge_details['type'] %} {% endif %} {% if item.judge_details['source'] %} {% endif %} {% if item.judge_details['patterns_found'] %} {% endif %} {% if item.judge_details['category'] %} {% endif %} {% if item.judge_details['subtypes'] %} {% endif %} {% if item.judge_details['heuristic_only'] is defined %} {% endif %}
Module{{ item.judge_details['module'] }}
Label{{ item.judge_details['label'] }}
Confidence{{ item.judge_details['confidence'] | round(4) }}
Explanation{{ item.judge_details['explanation'] }}
Attack Type{{ item.judge_details['attack_type'] }}
Subtype{{ item.judge_details['subtype'] }}
Risk Level{{ item.judge_details['risk_level'] }}
Risk Reason{{ item.judge_details['risk_reason'] }}
Hallucination Type{{ item.judge_details['type'] }}
Source{{ item.judge_details['source'] }}
Detected Patterns{{ item.judge_details['patterns_found'] | join(', ') }}
Category{{ item.judge_details['category'] }}
Subtypes{{ item.judge_details['subtypes'] | join(', ') }}
Evaluation Method{{ "Heuristic Only" if item.judge_details['heuristic_only'] else "Heuristic + Judge" }}
{% endif %}

Overall Assessment

Is the model response acceptable?

Agreement with Automated Evaluation

Do you agree with the automated evaluation?

Issue Classification

Which issues were present? (Select all that apply)

Judge Error Analysis

Why was the automated evaluation incorrect? (Only fill if you selected Disagree/Partially Agree above)

Reviewer Notes

Additional comments