PrismML releases Ternary Bonsai 2 models at 2B, 4B and 9B sizes
Original title (Chinese)
Ternary Bonsai 2 系列 AI 模型登场:苹果 iPhone 18 Pro Max 上本地吞吐最高每秒 120 个词元
AISummary
PrismML releases the Ternary Bonsai 2 series in 2B, 4B and 9B sizes, built on Alibaba's Qwen 3.5 base and using ternary weights of -1, 0 and +1, with storage of about 0.43GB, 0.95GB and 2GB. The company says the models cut tokens by about 40% on standard instruction and daily math tasks for the 9B model, and reaches up to 5x throughput and 3x energy efficiency versus full-precision counterparts on hardware such as the RTX 4090 and M5 Pro.
Source: IThome · AI · ithome.comPublished · added here