Your Box, Your Default
Born on real hardware: deploying to an NVIDIA DGX Spark exposed how much of the local-first story assumed bare metal. Now the Docker deployment discovers what your box actually runs - a host Ollama, a local vLLM - lists its models in the onboarding wizard, and one click makes one the default for every step that doesn't name a model. Cloud keys stay one paste away, side by side.
-
local · headline
Default model picker
New
workflow_default_modelsetting: steps without an explicitmodel:use it instead of the built-in default. Pick it in the wizard from detected local models or set it viaPATCH /api/settings- values are validated against the model registry before they can ever break a run. -
local
Any Ollama model, first-class
ollama/<tag>now resolves dynamically likenim/<id>always has - any locally pulled model at$0/run, region local, with the same injection-safe character discipline. Base URLs honourOLLAMA_HOSTeverywhere. -
discovery
Docker finds your local models
Provider discovery (0.41.2) respects
OLLAMA_HOSTand probesNIM_BASE_URL, so a containerized Sandcastle detects the host’s Ollama and any OpenAI-compatible vLLM./health/providersnow returns each local provider’s model list. And Spark Mode works in Docker via the newdocker-compose.gpu.ymloverride (0.41.1).