PrismML’s Bonsai 27B Shows Why Local AI Is Getting Serious

If you’ve ever wanted to run a powerful AI model locally without buying top-tier hardware, PrismML’s new Bonsai 27B is a glimpse of where AI may be heading next. PrismML, a company with research roots at Caltech, released Bonsai 27B on July 14, 2026 and describes it as its largest and most capable Bonsai model so far. It is based on Qwen3.6-27B, and PrismML says it is the first 27B-class model that can run on a phone.

That claim stands out because the original model is large by local-AI standards. Qwen3.6-27B is a multimodal model with a 262,144-token default context length, and PrismML says a 16-bit version of a 27B model takes up roughly 54 GB of memory. Even a conventional 4-bit build is still around 18 GB, which is too large for phones and still inconvenient for many laptops.

## Understanding Low-Bit Quantization

Model weights are stored using a certain number of bits per weight, and quantization reduces that precision so the model needs less memory and less bandwidth during inference. Instead of using 16-bit floating point values for every weight, low-bit models restrict weights to a much smaller set of possible values. PrismML’s ternary version uses weights from {-1, 0, +1}, while the 1-bit version uses {-1, +1}, both with group-wise scaling to preserve quality.

In the official release, the 1-bit Bonsai 27B variant has an effective 1.125 bits per weight and a 3.9 GB footprint, while Ternary Bonsai 27B has an effective 1.71 bits per weight and a 5.9 GB footprint. Both versions are multimodal, running end-to-end on device.

## Benchmark Performance & Implications

According to PrismML’s published benchmark results, Ternary Bonsai 27B retains about 94.6% of the full-precision baseline across a 15-benchmark suite, while 1-bit Bonsai 27B retains about 89.5%. The memory savings allow 11 tokens per second on an iPhone 17 Pro Max, unlocking true offline, private AI on consumer mobile devices.