Google submits first TPUv7 FP8 vLLM results to SemiAnalysis inference benchmark
Overview
Google has submitted its first TPUv7 FP8 vLLM results to SemiAnalysis's Agentic Inference Benchmark, according to a SemiAnalysis post on X. SemiAnalysis says the TPUv7 delivers 1.67x better performance per dollar than the Nvidia GB300 NVL72 running FP4.
The only source is SemiAnalysis's X thread, which is the first of four posts. The post's claim rests on the benchmark's own results, and no other report or independent verification is included in this story.
Written by AI from the articles below · updated Oct 14, 10:59 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
SemiAnalysis@SemiAnalysis_XGoogle's TPUv7 beats GB300 NVL72 by 1.67x on performance per dollarAIBREAKING NEWS🚨: Google has submitted its FIRST TPUv7 FP8 vLLM results to our Agentic Inference Benchmark and has demonstrated 1.67x better perf per dollar than even GB300 NVL72 FP4. 🚀 It is amazing to see Google go full steam ahead with externalizing the power of TPUs outside of Google.👇️ (1/4)🧵

Heat trend
Not enough continuous observations to show a trend yet.