Skip to content
Trending storyDeveloping

OpenBMB brings MiniCPM-V 4.7 to Apple Silicon Macs via Nativ

1 article1 sourcesince Oct 13Last article 1h ago ·

Overview

AISummary of 1 article

OpenBMB says its MiniCPM-V 4.7 models, in 1B and 35B-A3B sizes, now run fully on-device on Mac through a partnership with Nativ, with Day 0 support.

The company describes the setup as fully local, so user data stays on the device. Tested on Apple Silicon with Nativ v0.4.x, OpenBMB reports 24K+ prefill tokens/s and 315 tokens/s decode for the 1B model, and 4K+ prefill tokens/s and 90 tokens/s decode for the 35B-A3B model.

Written by AI from the articles below · updated Oct 13, 3:04 AM ET

Check the sources:

Latest developmentOct 13, 2:46 AM ET
OpenBMB says MiniCPM-V 4.7 runs on Apple Silicon via Nativ

Article timeline

The articles in this story. Times are ET.

Oct 13
  1. OpenBMBOfficial
    OpenBMB says MiniCPM-V 4.7 runs on Apple Silicon via Nativ

    AIOpenBMB says MiniCPM-V 4.7 in its 1B and 35B-A3B sizes now supports fully on-device inference on Mac through Nativ, with Day 0 support. The company reports 24K+ prefill tokens/s and 315 tok/s decode for the 1B model, and 4K+ prefill tokens/s and 90 tok/s decode for the 35B-A3B model, tested on Nativ v0.4.x.

    Image from @OpenBMB's post

Heat trend

Not enough continuous observations to show a trend yet.