{% extends "base.html" %} {% block title %}Rerank · {{ profile.name }}{% endblock %} {% block content %}

Reranking benchmark · {{ profile.name }}

Benchmarks a reranking request's latency and throughput (Lemonade's llamacpp GGUF recipe only -- FastFlowLM doesn't support reranking -- /v1/rerank). Deliberately separate from the model/router leaderboard -- reranking throughput isn't comparable to LLM token throughput. This runs synchronously.

{% if capabilities.error %}

Couldn't reach this instance ({{ capabilities.error }}) -- engine and backend fall back to free text.

{% endif %}
{% if rerank_models %}
Lemonade doesn't flag which pulled models are reranker-labeled -- pick one you know supports it. It errors clearly at run time if not.
{% else %}
No llamacpp models pulled yet on this profile -- pull one first, then reload this page.
{% endif %}
{% if rerank_backends %} {% else %}
No backend detected -- install it on the profile page first, or enter it manually.
{% endif %}
{% if default_os %}
{{ default_os }} (fixed by this profile)
{% else %}
Couldn't detect -- see profile page to fix discovery.
{% endif %}
Each non-blank line is one document reranked against the query -- document count materially affects latency.

Rerank results for {{ profile.name }}

{% if not results %}

No rerank results yet.

{% else %}
{% for r in results %} {% endfor %}
TimestampModelLatency (ms)Throughput (/sec)DocumentsTop NValidNotes
{{ r.timestamp }} {{ r.model.name }} {{ "%.1f"|format(r.metrics.latency_ms) }} {{ "%.2f"|format(r.metrics.documents_per_sec) }} {{ r.metrics.document_count }} {{ r.metrics.top_n or "–" }} {{ "valid" if r.validity.valid else "invalid" }} {{ r.validity.notes or "" }}
{% endif %}
{% endblock %}