{% extends "base.html" %} {% block title %}Uncertainty Report - {{ data.model_name }}{% endblock %} {% block content %}

Overview

Uncertainty Score

{{ data.metrics.uncertainty_score | format_number(3) }}

Avg Coverage

{{ data.metrics.avg_coverage | format_percentage(2) }}

Avg Interval Width

{{ data.metrics.avg_width | format_number(4) }}

Num Alphas

{{ data.metrics.num_alphas }}

Interpretation: {% if data.metrics.uncertainty_score >= 0.8 %} Excellent uncertainty quantification! The prediction intervals provide reliable coverage with narrow widths. {% elif data.metrics.uncertainty_score >= 0.6 %} Good uncertainty quantification. Prediction intervals are reasonably reliable. {% else %} Low uncertainty quantification. Prediction intervals may not be reliable. Intervals may be too narrow or coverage too low. {% endif %}

{% if include_charts %}

Coverage vs Expected Coverage

Analysis

{% if data.crqr_results %}

At the lowest alpha level (highest confidence), the coverage achieved was {{ data.crqr_results[0].actual_coverage | format_percentage(2) }}, compared to an expected {{ data.crqr_results[0].expected_coverage | format_percentage(2) }}.

{% endif %}

Interval Width by Alpha

Analysis

{% endif %}

Detailed Results - CRQR Analysis

{% if data.crqr_results %} {% for result in data.crqr_results %} {% endfor %}
Alpha Expected Coverage Actual Coverage Coverage Gap Mean Width Min Width Max Width
{{ result.alpha | format_number(3) }} {{ result.expected_coverage | format_percentage(2) }} {{ result.actual_coverage | format_percentage(2) }} {{ ((result.actual_coverage - (1 - result.alpha)) | abs) | format_percentage(2) }} {{ result.mean_width | format_number(4) }} {{ result.min_width | format_number(4) if result.min_width else 'N/A' }} {{ result.max_width | format_number(4) if result.max_width else 'N/A' }}
{% else %}

No CRQR results available.

{% endif %}
{% if data.test_config %}

Test Configuration

{% for key, value in data.test_config.items() %} {% endfor %}
{{ key | format_metric_name }} {{ value }}
{% endif %} {% endblock %} {% block extra_js %} {% if include_charts %} {% endif %} {% endblock %}