DeepSeek 开源 DeepInfer
Respect!
DeepSeek open-sources DeepInfer, a large-scale inference framework
AISummary
Dongxi NLP reports that DeepSeek has open-sourced DeepInfer, a high-performance, large-scale inference framework, under the Apache-2.0 license. The quoted post lists supported features including optimized kernels, Attention DP and MoE EP parallelism, asynchronous scheduling, batch-invariant inference, deterministic sampling, and structured output. The repository is at
Post on XView on X
Dongxi NLPVerified on X
@dongxi_nlp
DeepSeek just open sourced its high-performance, large-scale inference framework DeepInfer in Apache-2.0 license. https://github.com/deepseek-ai/DeepInfer Supported features: - Optimized kernels, model and sampler runtime - Parallelism: Attention DP / balanced CP, MoE EP + EPLB - DSpark and confidence-scheduled verification - SWA bounded replay - Asynchronous scheduling (zero-overhead batch scheduler) - Batch-invariant inference - Deterministic sampling - Structured outputView quoted post on X
Source: Dongxi NLP · x.comPublished