LLM Benchmark Report

{{ summary.total }} tests executed

Pass Rate

{{ "%.1f"|format(summary.pass_rate * 100) }}%

Avg Latency

{{ "%.0f"|format(summary.avg_latency_ms) }}ms

Total Cost

${{ "%.6f"|format(summary.total_cost_usd) }}

Total Tokens

{{ "{:,}".format(summary.total_tokens) }}

Test Results

{% for result in results %} {% endfor %}

Status	Name	Model	Latency	Cost	Tags	Actions
{% if result.passed %} PASS {% else %} FAIL {% endif %}	{{ result.test_case.name }}	{{ result.test_case.model }}	{{ "%.0f"\|format(result.metrics.latency_ms if result.metrics else 0) }}ms	${{ "%.6f"\|format(result.metrics.cost_usd if result.metrics and result.metrics.cost_usd else 0) }}	{% for tag in result.test_case.tags %} {{ tag }} {% endfor %}