Skip to content
Trending storyDeveloping

SGLang reports Qwen3.8 Flash Next runs up to 6.6× faster on Vera Rubin than GB300

2 articles1 sourcesince Oct 14Last article 1h ago ·

Overview

AISummary of 2 articles

SGLang says Qwen3.8 Flash Next on NVIDIA Vera Rubin, running with NVIDIA Dynamo and SGLang, delivers up to 6.6× throughput per chip versus GB300, and up to 76% lower modeled cost per total token at matched per-user speed.

SGLang credits NVIDIA for partnership and early access, and SemiAnalysis for the results. SemiAnalysis's separate analysis puts Rubin at 4.23× performance per dollar over GB300 NVL72 on SGLang.

SGLang also shares a link to an InferenceX comparison of Qwen3.8-Flash-Next on GB300 and VR200. The linked page compares per-GPU throughput under agentic-trace workloads at FP4 precision.

Written by AI from the articles below · updated Oct 14, 12:33 AM ET

Check the sources:

Developments

2 developments

  1. Oct 14, 12:19 AM ET · 1 article
    SGLang points to an InferenceX comparison of Qwen3.8-Flash-Next on GB300 vs VR200
    SGLang: SGLang links a GB300 vs VR200 comparison for Qwen3.8-Flash-Next
  2. Oct 14, 12:18 AM ET · 1 article
    SGLang reports Qwen3.8 Flash Next on Vera Rubin with NVIDIA Dynamo shows higher throughput and lower cost than GB300
    SGLang: Qwen3.8 Flash Next on Vera Rubin shows up to 6.6× throughput over GB300

Article timeline

The articles in this story. Times are ET.

Oct 14
  1. SGLangOfficial
    SGLang links a GB300 vs VR200 comparison for Qwen3.8-Flash-Next

    AISGLang (@sgl_project) shares a link to an InferenceX comparison of Qwen3.8-Flash-Next on GB300 and VR200 hardware. The linked page compares per-GPU throughput under agentic-trace workloads at FP4 precision.

  2. SGLangOfficial
    Qwen3.8 Flash Next on Vera Rubin shows up to 6.6× throughput over GB300

    AISGLang says Qwen3.8 Flash Next on NVIDIA Vera Rubin, running with NVIDIA Dynamo and SGLang, delivers up to 6.6× throughput per chip versus GB300. It also reports up to 76% lower modeled cost per total token at matched per-user speed. SemiAnalysis's separate analysis puts Rubin at 4.23× performance per dollar over GB300 NVL72 on SGLang.

    Image from @sgl_project's post

Heat trend

Not enough continuous observations to show a trend yet.