vLLM thanks DeepSeek for open-sourcing DeepInfer under Apache 2.0, noting it was built primarily on vLLM. DeepSeek says DeepInfer powers DeepSeek-V4.1-Flash at scale and shares its production stack to lower compute costs. vLLM says it will keep improving DeepSeek V4.1 Flash inference efficiency using ideas from DeepInfer.
Grateful to @deepseek_ai for releasing DeepInfer, initially built primarily on @vllm_project, under Apache 2.0 and crediting the open-source community!
We've worked hard on DeepSeek V4.1 Flash inference efficiency and will keep improving with ideas from DeepInfer! Stay tuned 🙌
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 http://github.com/deepseek-ai/DeepInfer 1/4View quoted post on X
Source: vLLM · x.comPublished · added here
