{% extends "base.html" %} {% block title %}Embeddings · {{ profile.name }}{% endblock %} {% block content %}
Benchmarks a batched-embedding request's latency and throughput (Lemonade's llamacpp GGUF / FastFlowLM
NPU recipes, /v1/embeddings). Deliberately separate from the model/router leaderboard --
embeddings throughput isn't comparable to LLM token throughput. This runs synchronously.
Couldn't reach this instance ({{ capabilities.error }}) -- engine and backend fall back to free text.
{% endif %}No embeddings results yet.
{% else %}| Timestamp | Model | Latency (ms) | Throughput (/sec) | Batch size | Dim | Valid | Notes |
|---|---|---|---|---|---|---|---|
| {{ r.timestamp }} | {{ r.model.name }} | {{ "%.1f"|format(r.metrics.latency_ms) }} | {{ "%.2f"|format(r.metrics.embeddings_per_sec) }} | {{ r.metrics.batch_size }} | {{ r.metrics.embedding_dim or "–" }} | {{ "valid" if r.validity.valid else "invalid" }} | {{ r.validity.notes or "" }} |