HeyGen's Rui Zhang shares GPU optimization and scheduling lessons for inference costs
Overview
SGLang's X account posted on November 8, 2026, that HeyGen's Rui Zhang discusses GPU performance optimization and intelligent scheduling for lowering AI inference costs.
The post says the talk draws on lessons from running HeyGen's production AI inference and treats the GPU as the starting point for reducing serving costs.
The report is a single social media post announcing the talk. It does not include specific cost figures, benchmark results, or the individual techniques Zhang covers.
Written by AI from the articles below · updated Nov 9, 4:15 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
SGLang@sgl_projectOfficialRui Zhang of HeyGen shares GPU optimization and scheduling lessons for lower AI inference costsAIHeyGen's Rui Zhang discusses GPU performance optimization and intelligent scheduling, drawing on lessons from running production AI inference. The post frames the GPU as the starting point for lowering serving costs.

Heat Trend
- Current comparable heat
- 5
- Peak comparable heat
- 6Nov 9, 5:00 PM ET
- Change in past 24 hours
- –
The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.