Skip to content
View original post on X: vLLMOfficial· 43/100AI score43/100

vLLM reports DeepSeek-V4.1-Flash-1017 serving throughput and cost on SemiAnalysis AgentX

AISummary

vLLM congratulates DeepSeek on DeepSeek-V4.1-Flash-1017, which the post says has better scores and shorter outputs for long agent loops. vLLM says it delivers 1.3B tokens per dollar TCO on SemiAnalysis AgentX, at 830K tok/s per GPU (cached + input + output) at 100 tok/s per user. The model is live on DeepSeek's website, app, and API, and the post links a vLLM blog on the work.

Post on XView on X
vLLMVerified on X
@vllm_project

🎉 Congrats @deepseek_ai on DeepSeek-V4.1-Flash-1017! Better scores and shorter outputs make it a great fit for long agent loops. Making each step fast is the serving side's job.

On DeepSeek-V4.1-Flash, vLLM delivers 1.3B tokens per dollar TCO on SemiAnalysis AgentX: 830K tok/s per GPU (cached + input + output) at 100 tok/s per user. 🚀

It's been a fun few weeks building with the community. Chapter one, 5x agentic throughput since day 0:
🔗 https://vllm.ai/blog/2026-10-07-deepseek-v41-flash

Next chapter coming soon. 👀

DeepSeek@deepseek_ai
🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
View quoted post on X

Source: vLLM · x.comPublished

Topics

DeepSeekAI agentsDeployment & engineeringChina AIProduct updatesEvals & benchmarks