# Google adds long-context training support to MaxText on Cloud TPUs

> Original title: Announcing Long-Context Training on TPUs with MaxText Context Parallelism

- Source: Google Developers Blog
- Published: 2026-11-09T00:00:00.000Z
- Bad Influence: https://badinfluence.news/items/jpej5ktavif0qksewtsaw3swj
- Original: https://developers.googleblog.com/announcing-long-context-training-on-tpus-with-maxtext-context-parallelism/

## Summary

Google Cloud announces long-context training support in MaxText, its open-source JAX training framework, with four context-parallel strategies on Cloud TPU. Google says Llama 3.1 8B reaches 70% Model FLOPs Utilization on TPU 5p at sequence lengths up to 4 million tokens, and context can extend to 14 million tokens with TPU 7 maintaining 50% MFU below 6 million tokens. The feature is available in MaxText v0.2.4.