Skip to content
View original post on X: vLLMOfficial
Published
38/100

vLLM reports 10.2x token throughput for MiniMax-M3.1-Flash on NVIDIA Vera Rubin

AIvLLM says MiniMax-M3.1-Flash runs 10.2x faster per chip on NVIDIA Vera Rubin NVL72 than on GB300 NVL72 in SemiAnalysis AgentX, at 546 P90 tokens per second per user. The gain is 6.5x at 376 P90 tokens per second per user, and up to 1,205 P90 tokens per second per user at low concurrency.
vLLMVerified on XOfficial
@vllm_project
View on X

vLLM keeps pushing MiniMax-M3.1-Flash performance on NVIDIA Vera Rubin NVL72! 🚀

On @SemiAnalysis_ AgentX, vLLM on Rubin vs. on GB300 NVL72:

🔥 10.2x total tok/s/chip (incl. cached) at 546 P90 tok/s/user
📈 6.5x at 376 P90 tok/s/user
⚡ Up to 1,205 P90 tok/s/user at low concurrency

Source details

vLLM · x.comPublished · added here

Original title: vLLM keeps pushing MiniMax-M3.1-Flash performance on NVIDIA Vera Rubin NVL72! 🚀

Topics

Deployment & engineeringChina AIProduct updates