# ByteDance explains faster open-model inference on Hopper with SGLang

> Original title: 5 | ByteDance

- Source: LMSYS Org
- Published: 2026-11-04T22:51:50.000Z
- Bad Influence: https://badinfluence.news/items/qf7lf8dn5lc5qwiefdsngcjyy
- Original: https://x.com/lmsysorg/status/2118114023329931283

## Summary

ByteDance engineer Ho-Ren (Jack) Chuang describes the attention, MoE, and speculative decoding work behind faster open-model inference on Hopper GPUs using SGLang. The post shares the techniques without giving benchmark figures or specific speedups.

## Post

5 | ByteDance
Making Frontier Open Models Fast on Hopper with SGLang

Ho-Ren (Jack) Chuang shares the attention, MoE, and speculative decoding work behind faster open-model inference on Hopper.

![](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHWUMKviaoAAZvrd.jpg&mode=thumb&exp=1794096000&sig=bae476b83f027341)