Taobao's MNN team open-sources MNN-Pocket-0.3B, a 173MB on-device model for phone apps
AIAlibaba's MNN team at Taobao has open-sourced MNN-Pocket-0.3B, a roughly 300-million-parameter language model for mobile apps. The INT4 package is 173MB, and the team reports about 350 tokens per second decoding on an iPhone 18 Pro, running fully offline.
Source details
Pandaily · contact@pandaily.com (Pandaily) · pandaily.comPublished · added here
Original title: Taobao's MNN Team Open-Sources MNN-Pocket-0.3B, a 173MB On-Device Model Built for Phone Apps