KV Holder
This device keeps the oldest part of a model's context and does the attention over it. Keep this tab open and the screen on.
starting
Held keys (layer 0)0
Memory used0 MB
Attention calls0
Last call-
This device keeps the oldest part of a model's context and does the attention over it. Keep this tab open and the screen on.