DeepSeek raised the bar, and SGLang pushed it even further 🧡
https://lmsys.org/blog/2026-10-24-dsv41-deepinfer
Read our blog to learn more about the performance results, engineering optimizations, and how SGLang brings it all together in a production-ready serving stack!
DeepInfer set the bar. SGLang pushed it higher! 🚀 SGLang now matches DeepInfer performance on BOTH prefill and decode: • Prefill: Up to 1.04× throughput on 4× GB300 and 4× B300 • Decode: Up to 7.4% throughput on 64× GB300 We also provide an end-to-end reproduction guide and a full serving stack to run it in production.
LMSYS Org · x.comPublished · added here
Original title: DeepSeek raised the bar, and SGLang pushed it even further 🧡
