Skip to content
Trending storyDeveloping

Alibaba's Taobao MNN team open-sources MNN-Pocket-0.3B on-device language model

1 article1 sourcesince Nov 6Last article 1h ago ·

Overview

AISummary of 1 article

Alibaba's MNN team at Taobao has open-sourced MNN-Pocket-0.3B, a language model of about 300 million parameters built to run inside mobile apps.

The INT4 package is 173MB, and the team reports decoding at about 350 tokens per second on an iPhone 18 Pro with no network connection. The model scores 73.20 on IFEval and averages 50.00 across 11 Chinese and English benchmarks, according to Pandaily's report.

Written by AI from the articles below · updated Nov 6, 3:19 AM ET

Check the sources:

Latest developmentNov 6, 2:45 AM ET
Taobao's MNN team open-sources MNN-Pocket-0.3B, a 173MB on-device model for phone apps

Article timeline

The articles in this story. Times are ET.

Nov 6
  1. PandailyNews
    Taobao's MNN team open-sources MNN-Pocket-0.3B, a 173MB on-device model for phone apps

    AIAlibaba's MNN team at Taobao has open-sourced MNN-Pocket-0.3B, a roughly 300-million-parameter language model for mobile apps. The INT4 package is 173MB, and the team reports about 350 tokens per second decoding on an iPhone 18 Pro, running fully offline. It scores 73.20 on IFEval and an average of 50.00 across 11 Chinese and English benchmarks.

Heat Trend

Not enough continuous observations to show a trend yet.