Smallint8
5.7Mparameters
A whole smart-home assistant in a few megabytes.
- On disk6.0 MB (int8) · 4.1 MB (int4)
- Compared with the 0.5B to 1B models usually used for this~90 to 170× smaller
- Home Assistant actions13
English only for now. The accuracy figures come from our own tests and are not directly comparable with the numbers other projects publish on their own test sets. The official-test number is the more favourable one (we fixed failures we saw there); the acon96 set is the independent check. Not yet supported: fan speed, scenes, timers, volume, blind position and questions about state. Switch int8 and int4 above and the numbers change with the model.