🚀 MiniCPM-V 4.7 is now supported in vLLM v0.32.0! Thanks @vllm_project for the support. This makes it easier to serve MiniCPM-V 4.7 with high throughput and low latency.
MiniCPM-V 4.7 now supported in vLLM v0.32.0
AISummary
OpenBMB says MiniCPM-V 4.7 is now supported in vLLM v0.32.0, enabling high-throughput, low-latency serving of the model. The support was added in vLLM v0.32.0, which also includes the new /v1/systemone endpoint, NVFP4 KV support, and Model Runner V2.
Post on XView on X
OpenBMBVerified on X
@OpenBMB
🚀 vLLM v0.32.0 is out! 814 commits · 363 contributors · 121 first-timers 🧭 New /v1/systemone structured-decision endpoint + generic hf tool/reasoning parser 🗜️ Low-precision KV everywhere: NVFP4 on SM8x/90/12x, FP8 KV default for GLM-5.x, 4-bit KV on ROCm 🛠️ Model Runner V2: GPU n-gram speculator, Elastic EP, PP+CP for MLA, now default on ROCm ⚡ Faster startup & serving: precompiled kernel downloads, autotune preload, +43–85% req/s with multi-API workers 🆕 EmbeddingGemma 2, MiniCPM-V 4.7, Nemotron 3.5 ASR 🔒 3 security fixes + CORS hardening Full notes → http://github.com/vllm-project/vllm/releases/tag/v0.32.0
Source: OpenBMB · x.comPublished