Google and Meta open-source TorchTPU, a native PyTorch backend for Cloud TPUs
Overview
Google and Meta have open-sourced TorchTPU, a native PyTorch backend for Google TPUs, announced at PyTorch Conference 2026.
Google says it replaces PyTorch/XLA and recommends it for all new workloads. The PyTorch team says the backend supports eager execution and torch.compile, and that it validated out-of-box execution on about 5,000 Hugging Face models. Porting a model requires changing model.to("cuda") to model.to("tpu"), according to the PyTorch blog, which says peak performance needs further tuning.
Google's developer blog reports self-reported, unverified benchmarks: about 57% model FLOPs utilization (MFU) for Llama 3 405B on up to 1,024 chips, 32.42% MFU for Qwen3 235B on a 1,024-chip slice, and a FLUX.1 step time falling from 11.49 seconds to 2.78 seconds. A MarkTechPost report cites Google's own figure of 52% MFU training Qwen 3 8B with TorchTitan on Ironwood TPUs.
Written by AI from the articles below · updated Oct 20, 2:25 PM ET
Check the sources:
Developments
2 developments
- Oct 20, 10:02 AM ET · 3 articlesGoogle open-sources TorchTPU, a native PyTorch backend for Cloud TPUsPyTorch Blog: Google and Meta introduce TorchTPU, a native PyTorch backend for Google TPUs
- Oct 19, 8:00 PM ET · 1 articleGoogle describes integrating TorchTPU into TorchTitan and optimizing models for TPUGoogle Developers Blog: Google explains how to integrate TorchTPU into TorchTitan and optimize models for TPU
Article timeline
The articles in this story. Times are ET.
- PyTorch BlogOfficialPickGoogle and Meta introduce TorchTPU, a native PyTorch backend for Google TPUs
AIGoogle and Meta announce TorchTPU, an open source project that runs PyTorch natively on Google TPUs. The backend supports eager execution and torch.compile, and the team reports validating out-of-box execution on about 5,000 Hugging Face models. Porting a model requires changing model.to("cuda") to model.to("tpu"), though peak performance needs further tuning.
- MarkTechPostNewsPickGoogle open-sources TorchTPU, a native PyTorch backend for Cloud TPUs
AIGoogle has open-sourced TorchTPU, a native PyTorch backend for Cloud TPUs, co-developed with Meta and announced at PyTorch Conference 2026. Google says it replaces PyTorch/XLA and recommends it for all new workloads. Self-reported results include 52% MFU training Qwen 3 8B with TorchTitan on Ironwood TPUs.
Swayam Singh@swayaminsyncXGoogle releases TorchTPU, open-source PyTorch support for TPUsAIGoogle has open-sourced TorchTPU, which lets native PyTorch code run on TPUs, according to a post linking to a Google Cloud blog announcement. The post's author says they are excited about the release, but it gives no further technical details.
- Google Developers BlogOfficialPickGoogle explains how to integrate TorchTPU into TorchTitan and optimize models for TPU
AIGoogle Developers describes running PyTorch training on Cloud TPUs through TorchTitan, using a native torch.device("tpu") backend and a fork of Meta's TorchTitan. The post lays out a model optimization playbook and reports results for Llama 3 405B (about 57% MFU on up to 1,024 chips), Qwen3 235B (32.42% MFU on a 1,024-chip slice), and FLUX.1, where a step time fell from 11.49 seconds to 2.78 seconds.
Heat Trend
- Current comparable heat
- 34
- Peak comparable heat
- 35Oct 20, 1:00 PM ET
- Change in past 24 hours
- –
The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.