PrismML just put a 27B multimodal model on a phone. First time anyone's done it.
Bonsai 27B, built on Qwen3.6 27B with end-to-end ultra-low quantization.
Ternary: 5.9GB, 80.49 avg. Keeps 95% of FP16.
1-bit: 3.9GB, 76.11 avg. Math hits 93.40 — 2 points off FP16.
iPhone 17 Pro: 11 tok/s, 262K context.
A 27B model running locally on a phone. Wild.