Skip to content
Trending storyDeveloping

Google and Meta open-source TorchTPU, a native PyTorch backend for Cloud TPUs

4 articles4 sourcessince Oct 19Last article 2h ago ·

Overview

AISummary of 4 articles

Google and Meta have open-sourced TorchTPU, a native PyTorch backend for Google TPUs, announced at PyTorch Conference 2026.

Google says it replaces PyTorch/XLA and recommends it for all new workloads. The PyTorch team says the backend supports eager execution and torch.compile, and that it validated out-of-box execution on about 5,000 Hugging Face models. Porting a model requires changing model.to("cuda") to model.to("tpu"), according to the PyTorch blog, which says peak performance needs further tuning.

Google's developer blog reports self-reported, unverified benchmarks: about 57% model FLOPs utilization (MFU) for Llama 3 405B on up to 1,024 chips, 32.42% MFU for Qwen3 235B on a 1,024-chip slice, and a FLUX.1 step time falling from 11.49 seconds to 2.78 seconds. A MarkTechPost report cites Google's own figure of 52% MFU training Qwen 3 8B with TorchTitan on Ironwood TPUs.

Written by AI from the articles below · updated Oct 20, 2:25 PM ET

Check the sources:

Developments

2 developments

  1. Oct 20, 10:02 AM ET · 3 articles
    Google open-sources TorchTPU, a native PyTorch backend for Cloud TPUs
    PyTorch Blog: Google and Meta introduce TorchTPU, a native PyTorch backend for Google TPUs
  2. Oct 19, 8:00 PM ET · 1 article
    Google describes integrating TorchTPU into TorchTitan and optimizing models for TPU
    Google Developers Blog: Google explains how to integrate TorchTPU into TorchTitan and optimize models for TPU

Article timeline

The articles in this story. Times are ET.

Oct 20
  1. PyTorch BlogOfficialPick
    Google and Meta introduce TorchTPU, a native PyTorch backend for Google TPUs

    AIGoogle and Meta announce TorchTPU, an open source project that runs PyTorch natively on Google TPUs. The backend supports eager execution and torch.compile, and the team reports validating out-of-box execution on about 5,000 Hugging Face models. Porting a model requires changing model.to("cuda") to model.to("tpu"), though peak performance needs further tuning.

  2. MarkTechPostNewsPick
    Google open-sources TorchTPU, a native PyTorch backend for Cloud TPUs

    AIGoogle has open-sourced TorchTPU, a native PyTorch backend for Cloud TPUs, co-developed with Meta and announced at PyTorch Conference 2026. Google says it replaces PyTorch/XLA and recommends it for all new workloads. Self-reported results include 52% MFU training Qwen 3 8B with TorchTitan on Ironwood TPUs.

  3. Swayam SinghX
    Google releases TorchTPU, open-source PyTorch support for TPUs

    AIGoogle has open-sourced TorchTPU, which lets native PyTorch code run on TPUs, according to a post linking to a Google Cloud blog announcement. The post's author says they are excited about the release, but it gives no further technical details.

Oct 19
  1. Google Developers BlogOfficialPick
    Google explains how to integrate TorchTPU into TorchTitan and optimize models for TPU

    AIGoogle Developers describes running PyTorch training on Cloud TPUs through TorchTitan, using a native torch.device("tpu") backend and a fork of Meta's TorchTitan. The post lays out a model optimization playbook and reports results for Llama 3 405B (about 57% MFU on up to 1,024 chips), Qwen3 235B (32.42% MFU on a 1,024-chip slice), and FLUX.1, where a step time fell from 11.49 seconds to 2.78 seconds.

Heat Trend

Current comparable heat
34
Peak comparable heat
35Oct 20, 1:00 PM ET
Change in past 24 hours
–

The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.