Beyond matching DeepInfer's performance, we also put vLLM to the test on @SemiAnalysis_ AgentX with real-world agentic workloads.
At DeepSeek's off-peak pricing, vLLM delivers $38.96/GPU-hour revenue, with 954K tokens/s/GPU total throughput (cached+input+output) at 196 tokens/s P90 per user.
This is the best DeepSeek-V4.1-Flash result on AgentX ever, powered by recent advancement in vLLM!
Check out our blog for the full optimization story and how to reproduce the results 👇 Enjoy the read.
Scaled out with P/D disaggregation and Wide-EP on a GB300 NVL72 rack, vLLM serves V4.1-Flash on SemiAnalysis AgentX at 954K tokens/s per GPU with 196 tokens/s P90 per user, 7.9× our single-node result. Our engineering blog covers the work behind it: https://vllm.ai/blog/2026-10-23-deepseek-v41-flash-pd-wide-epView quoted post on X
This story is featured in top picks: “vLLM serves DeepSeek-V4.1-Flash at 954K tokens/s per GPU on GB300 NVL72”
vLLM · x.comPublished · added here
Original title: Beyond matching DeepInfer's performance, we also put vLLM to the test on @SemiAnalysis_ AgentX with real-world agentic workloads.
