MiniCPM5-2B runs at 37 tok/s on iPhone Air
Original title37 tok/s on an iPhone Air is pretty wild. 🚀
AISummary
OpenBMB reports that its MiniCPM5-2B model runs at 37 tokens per second on an iPhone Air. The post presents this as evidence that small open multimodal models can run on mobile devices without a cloud GPU, with NobodyWho noting the model is available in its Chat app.
Source: OpenBMB · x.comPublished · added here