{% extends "_base.html" %} {% block content %}
Connect two or more Macs over Thunderbolt and use them as one. Peers are found automatically, so there are no IPs or hostfiles to set up. OptiQ splits a model's layers across the Macs by RAM and keeps them resident, so the combined memory serves models that wouldn't fit on any one machine.
optiq cluster up on your other Mac, connected over Thunderbolt.
Serves the model split across the ring, with an OpenAI endpoint that Chat and Arena use automatically. Thunderbolt only. Pipeline inference needs the low latency, so a slow link is refused rather than run slower than one Mac. Layers are held resident, so the model has to fit the the cluster can spare right now; anything larger is refused before it loads. Free up memory on a busy Mac to make room for a bigger model.