Google adds native PyTorch vLLM and SGLang backends for TPU, with vLLM TorchTPU release

1. vLLM BlogOfficialPick

   vLLM releases TorchTPU backend for running vLLM on Google Cloud TPUs

   AIvLLM releases vllm-torchtpu, an out-of-tree platform plugin that runs vLLM on Google Cloud TPUs, so most models that already run in vLLM can be served on TPU without model code changes. The plugin keeps vLLM's CLI, OpenAI-compatible server, scheduler, and KV cache manager unchanged, and adds Pallas kernels for attention, Mixture-of-Experts, and quantized matmul.

2. Google Developers BlogOfficialPick

   Google launches native PyTorch vLLM and SGLang inference engines on TPU

   AIGoogle announces native PyTorch backends for vLLM and SGLang on TPU, built on TorchTPU and developed with Inferact and RadixArk. The engines add production features such as prefix caching, KV cache offloading, and disaggregated serving, with KV cache transfers handled by the open-source TPU Sync library.

The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.