OpenBMB's MiniCPM-V 4.7 runs locally on iPhone at 20.51 tokens per second

35B multimodal AI. Running locally on an iPhone. Now at over 20 tokens/sec. 🚀

MiniCPM-V 4.7 achieves 20.51 tokens/sec average decoding speed on iPhone 18 Pro Max (12GB) — a 6.07× speedup over the same device’s unoptimized SSD expert-loading baseline.

⚡ Behind the speed: Lookahead Expert Scheduling (LES), optimized expert loading, fine-grained quantization, and DSpark speculative decoding.

📱 Watch the new on-device demo below. Powerful multimodal AI, right in your pocket.

Try it 👇
🔗 GitHub: http://github.com/OpenBMB/MiniCPM-V
🤗 Hugging Face: http://huggingface.co/collections/openbmb/minicpm-v-47
LES: https://github.com/tc-mb/llama.cpp-omni/blob/master/docs/les/lookahead-expert-scheduling.md

#MiniCPM #OpenBMB