gpu-broker connecting…

GPU

–

–

idle

–

–

kind	model	VRAM	status

–

–

–

–

–

● time to first token ● total

gen tok/s–prompt tok/s– first token–total– queue wait–model switch–

#	job	requested	using	from	waiting

model	done	failed	avg s	max s

when	job	requested	used	state	s	error

when	kind	job	detail

slug	ref	state	updated