Skip to content
View original post on X: Thomas Wolf
Published
72/100

DeepSeek open-sources DeepInfer, its inference framework behind DeepSeek-V4.1-Flash

AIDeepSeek has released DeepInfer, its in-house inference framework, as open source, sharing the production stack used to serve DeepSeek-V4.1-Flash at scale. Thomas Wolf says the release follows FlashMLA, DeepEP, DeepGEMM and 3FS, which he lists with their performance figures.
Thomas WolfVerified on X
@Thom_Wolf
View on X

DeepSeek's open-source streak is getting absurd:
- FlashMLA: 580 TFLOPS attention on H800
- DeepEP: MoE comms
- DeepGEMM: 1350+ FP8 TFLOPS matmul
- 3FS: they built an entire file system
- and today: the full inference engine behind V4.1-Flash, Apache 2.0

Mad respect

DeepSeek@deepseek_ai
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 http://github.com/deepseek-ai/DeepInfer 1/4
View quoted post on X
Source details

Thomas Wolf · x.comPublished · added here

Original title: DeepSeek's open-source streak is getting absurd: