load_backend: loaded RPC backend from /var/home/rybens/.local/share/ggufone/runtime/b11026-linux-x64-vulkan/libggml-rpc.so
ggml_vulkan: Found 1 Vulkan devices:
ggml_vulkan: 0 = NVIDIA GeForce RTX 3060 Ti (NVIDIA) | uma: 0 | fp16: 1 | bf16: 1 | fp4: 0 | warp size: 32 | shared memory: 49152 | int dot: 1 | matrix cores: NV_coopmat2
load_backend: loaded Vulkan backend from /var/home/rybens/.local/share/ggufone/runtime/b11026-linux-x64-vulkan/libggml-vulkan.so
load_backend: loaded CPU backend from /var/home/rybens/.local/share/ggufone/runtime/b11026-linux-x64-vulkan/libggml-cpu-haswell.so
~llama_context:    Vulkan0 compute buffer size is 483.8672 MiB, matches expectation of 483.8672 MiB
~llama_context: Vulkan_Host compute buffer size is   7.9877 MiB, matches expectation of   7.9877 MiB
~llama_context:    Vulkan0 compute buffer size is 483.8672 MiB, matches expectation of 483.8672 MiB
~llama_context: Vulkan_Host compute buffer size is   7.9877 MiB, matches expectation of   7.9877 MiB

item c01: serving prefix 119 tokens, bench prefix 119 tokens, framing chat-template: spark2_5 / internal
.
1 passed in 8.68s
