LLamaStudio

{% if server_running %}{{ current_model_name }}{% else %}No model loaded{% endif %}

Please load a model to start playing with local LLMs.

Model Details	Arch	Size	Quant	Status

File Path

File Size

Quantization

Context Length

Max context size in tokens

2048

GPU Offload

Layers to offload (999 = Max VRAM)

999

CPU Threads

Size of the thread pool

Flash Attention

Speed up context processing

Use mmap()

Enable fast virtual memory maps

CPU Mode Only

Force running strictly on host CPU

K Cache Quant

V Cache Quant

Seed Override -1 represents completely random

ROPE Freq Base

ROPE Freq Scale

Override KV e.g. qwen35.context_length=int:262144

Chat Template Override

Custom Jinja Template

System Prompt

Temperature 0.7

Top P 0.9

Top K 40

Min P 0.05

Repeat Penalty 1.1

Max Generation Tokens

Stop Sequences (comma-separated)

Search the Hugging Face Hub for community-quantized GGUF models. Download them directly with a single click.

Server Execution Logs

Real-time output stream from the active llama-server process.

                    No log output recorded yet. Load a model to spin up the server.
                