{% extends "base.html" %} {% block title %}AI Observatory — ICDEV{% endblock %} {% block content %}

AI Observatory

Cross-canvas AI decision traceability — compliance findings, threat assessments, risk scores, and confabulation flags across all 10 design canvases.

NIST AI RMF MEASURE 2.5/2.7/2.8 · DoD RAI Traceable · FedRAMP SI-4 · OMB M-25-21
{{ stats.total or 0 }}
Decisions (7d)
{% if stats.avg_confidence is not none %}
{{ (stats.avg_confidence * 100)|round(0)|int }}%
{% else %}
—
{% endif %}
Avg Confidence
{{ stats.top_canvas|upper if stats.top_canvas else '—' }}
Most Active Canvas
{{ stats.confab_flags or 0 }}
Confabulation Flags (7d)
{{ stats.low_conf or 0 }}
Low-Confidence (<30%)
Canvas Type Decision Model Confidence Time Trace
Loading decisions…
Confidence Heatmap — Canvas × Decision Type
Loading heatmap…
Model Usage (all time)
{% if stats.by_model %} {% set max_cnt = stats.by_model[0].cnt if stats.by_model else 1 %} {% for row in stats.by_model[:10] %}
{{ row.model }}
{{ row.cnt }}
{% endfor %} {% else %}
No model usage data yet.
{% endif %}
{% if confab_flags %}
Confabulation Flags (7d) — NIST AI 600-1 GAI.1
{% for f in confab_flags[:20] %}
{{ (f.canvas_type or 'unknown')|upper }} {{ f.created_at or '' }}
{{ f.decision[:200] if f.decision else '—' }}
{% if f.confidence is not none %}
Risk score: {{ (f.confidence * 100)|round(0)|int }}% — {{ f.model_used or 'unknown model' }}
{% endif %}
{% endfor %}
{% endif %} {% set iqe_canvas = "ai_observatory" %} {% set iqe_api_route = "/ai-observatory/api/iqe-query" %} {% set iqe_title = "IQE Query — AI Observatory" %} {% set iqe_examples = [ {"label": "All AI decisions", "query": "foreach d in observatory.decisions select d.canvas_type, d.decision_type, d.decision, d.confidence, d.model_used"}, {"label": "Low-confidence decisions", "query": "foreach d in observatory.decisions where d.confidence < 0.5 select d.canvas_type, d.decision_type, d.decision, d.confidence"}, {"label": "Confabulation flags", "query": "foreach d in observatory.confabulation_flags select d.canvas_type, d.decision, d.confidence, d.created_at"} ] %} {% include "includes/iqe_query_widget.html" %} {% endblock %} {% block scripts %} {% endblock %}