Skip to content
Trending storyMonitoring

SemiAnalysis reports AMD MI355 runs 1.42x faster than GB300 NVL72 on TileRT

1 article1 sourcesince Nov 8Last article

Overview

AISummary of 1 article

SemiAnalysis says AMD's MI355 is 1.42x faster than Nvidia's GB300 NVL72 on long-context inference when running the TileRT software, which it says reaches 1330 p90 tokens per second per user.

The claim is posted on X by SemiAnalysis, and the post credits AMD leadership for providing an MI350 cluster to TileRT maintainers for the test.

The post does not include the full benchmark setup or the workload details beyond long context, so the comparison cannot be checked from the report alone.

Written by AI from the articles below · updated Nov 9, 9:26 PM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Nov 8
  1. SemiAnalysisX
    SemiAnalysis reports AMD MI355 is 1.42x faster than GB300 NVL72 on TileRT

    AIALERT🚨🚨: AMD MI355 is 1.42x FASTER THAN GB300 NVL72. THIS IS ACHIEVED USING THE TILERT SOFTWARE, WHICH GETS 1330 p90 tok/s/user on long context workloads! Thanks to AMD leadership for providing an MI350 cluster to TileRT maintainers, enabling them to achieve this great result!

    Image from @SemiAnalysis_'s post

Heat Trend

Not enough continuous observations to show a trend yet.