Skip to content
View original post on X: SemiAnalysis
Published
34/100

Inferact and Google submit first preliminary TPUv7 Kimi K3 benchmark

AIInferact and Google submitted their first preliminary TPUv7 results for the 2.8T-parameter Kimi K3 model. The post says the submission shows strong performance per TCO against GB200 NVL72, B300, and MI355 in the ultra-high-interactivity regime, using a megakernel approach for external customers.
SemiAnalysisVerified on X
@SemiAnalysis_
View on X

BREAKING NEWS🚨: @Inferact & Google submit their FIRST preliminary TPUv7 Kimi K3 2.8T Model Submission, and it is already delivering strong perf per TCO against GB200 NVL72, B300, and MI355 in the ultra-high-interactivity regime due to their megakernel approach for external customers.

One of the most important aspects of an external compute platform is a strong community, and what makes this submission special is that Inferact (Makers of vLLM) led the submission end to end using the TorchTPU vLLM stack.👇️(1/6)🧵

Source details

SemiAnalysis · x.comPublished · added here

Original title: BREAKING NEWS🚨: @Inferact & Google submit their FIRST preliminary TPUv7 Kimi K3 2.8T Model Submission, and it is already delivering stro...