{% extends "base.html" %} {% block title %}LLMOps โ€” Ops Hub{% endblock %} {% block extra_css %} {% endblock %} {% block content %} {% from "includes/classification_macros.html" import design_classification_banner %} {{ design_classification_banner(classification) }} โ† Ops Hub

๐Ÿค– LLMOps

Gateway ยท Cost Intelligence ยท Drift ยท Prompt Registry ยท Evals

{% set gw = data.gateway %} {% set cost = data.cost %}
{{ gw.get('total_invocations_24h', 'โ€”') }}
Invocations (24h)
{{ gw.get('injection_blocks_24h', 0) }}
Injection Blocks (24h)
{{ data.model_health.get('monitored_models', 'โ€”') }}
Monitored Models
{{ 'โš ' if data.has_drift else 'โœ“' }}
Drift Status

๐Ÿ“‰ Drift Events

{% set drift_events = data.model_health.get('recent_drift', []) %} {% if drift_events %} {% for ev in drift_events[:5] %}
โš ๏ธ {{ ev.get('model_name','?') }} {{ ev.get('drift_type','?') }} {{ ev.get('drift_score',0)|round(3) }}
{% endfor %} {% else %}

No drift events detected โœ“

{% endif %} View full JSON โ†’

๐Ÿ“ Prompt Registry

{% set prompts = data.model_health.get('active_prompts', []) %} {% for p in data.get('model_health', {}).get('active_prompts', [])[:4] %}
{{ p.get('name','?') }} v{{ p.get('version',1) }}
{% else %}

No active prompts registered.

{% endfor %} Manage prompts โ†’
{% if cost and not cost.get('error') %}

๐Ÿ’ฐ Cost Intelligence

${{ cost.get('total_cost_30d', 0)|round(2) }}
30-day Spend
{{ cost.get('anomaly_count', 0) }}
Anomalies
{% endif %} {% set proxy = data.get('proxy', {}) %}

๐Ÿ”€ LLM Proxy {% if proxy.get('proxy_enabled') %}enabled{% else %}off (default){% endif %}

{% if proxy.get('error') %}

Proxy metrics unavailable: {{ proxy.get('error') }}

{% else %} {% set led = proxy.get('ledger_spend', {}) %} {% set rate = proxy.get('ledger_rate', {}) %} {% set prom = proxy.get('prometheus', {}) %}
${{ led.get('total_spend_usd', 0)|round(4) }}
Key Spend ({{ proxy.get('window_hours', 24) }}h, ledger)
{{ led.get('event_count', 0) }}
Spend Events
{{ rate.get('total_requests', 0) }}
Team Requests (rate ledger)
{{ prom.get('rate_limit_errors', 0) if prom.get('available') else 'โ€”' }}
Rate-limit Errors (proxy)
{% set topkeys = led.get('by_key', []) %} {% if topkeys %}
Top spenders (by key / scope):
{% for k in topkeys[:5] %}
{{ k.get('scope_type','?') }}:{{ k.get('key_id','?')[:12] }}โ€ฆ ${{ k.get('spend_usd', 0)|round(4) }} ยท {{ k.get('requests',0) }} req
{% endfor %} {% else %}

No proxy spend recorded in the window. {% if not proxy.get('proxy_enabled') %}The proxy is opt-in and off by default.{% endif %}

{% endif %}
Prometheus scrape: {{ 'available' if prom.get('available') else prom.get('reason','unavailable') }}.
{% endif %} View full JSON โ†’
{% include "includes/reasoned_codegen_widget.html" %} {% include "includes/iqe_query_widget.html" %} {% endblock %}