Skip to content
Trending storyDeveloping

Google submits first TPUv7 FP8 vLLM results to SemiAnalysis inference benchmark

1 article1 sourcesince Oct 14Last article 2h ago ·

Overview

AISummary of 1 article

Google has submitted its first TPUv7 FP8 vLLM results to SemiAnalysis's Agentic Inference Benchmark, according to a SemiAnalysis post on X. SemiAnalysis says the TPUv7 delivers 1.67x better performance per dollar than the Nvidia GB300 NVL72 running FP4.

The only source is SemiAnalysis's X thread, which is the first of four posts. The post's claim rests on the benchmark's own results, and no other report or independent verification is included in this story.

Written by AI from the articles below · updated Oct 14, 10:59 PM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 14
  1. SemiAnalysisX
    Google's TPUv7 beats GB300 NVL72 by 1.67x on performance per dollar

    AIBREAKING NEWS🚨: Google has submitted its FIRST TPUv7 FP8 vLLM results to our Agentic Inference Benchmark and has demonstrated 1.67x better perf per dollar than even GB300 NVL72 FP4. 🚀 It is amazing to see Google go full steam ahead with externalizing the power of TPUs outside of Google.👇️ (1/4)🧵

    Image from @SemiAnalysis_'s post

Heat trend

Not enough continuous observations to show a trend yet.