Lots of you have been wondering how SGLang matched DeepInfer.
So we made a 2-minute explainer: the benchmarks, the DeepSeek kernels now in SGLang, and how you can reproduce the results. Check it out! 👇
SGLang explains how it matched DeepInfer on prefill and decode
AISGLang's account of matching DeepInfer's throughput is out as a two-minute explainer covering the benchmarks and the DeepSeek kernels now in SGLang. Its earlier post reports up to 1.04× prefill throughput on 4× GB300 and 4× B300, and up to 7.4% decode throughput on 64× GB300.
@sgl_project
DeepInfer set the bar. SGLang pushed it higher! 🚀 SGLang now matches DeepInfer performance on BOTH prefill and decode: • Prefill: Up to 1.04× throughput on 4× GB300 and 4× B300 • Decode: Up to 7.4% throughput on 64× GB300 We also provide an end-to-end reproduction guide and a full serving stack to run it in production.
Source details
SGLang · x.comPublished · added here
Original title: Lots of you have been wondering how SGLang matched DeepInfer.