Skip to content
View original post on X: Inferact· 42/100AI score42/100

Inferact and Google Cloud partner to make TPUs first-class in vLLM

AISummary

Inferact and Google Cloud announce a partnership to make Google TPUs a first-class platform in the vLLM open-source project.

The collaboration targets production serving features, optimized kernels, a native PyTorch path via TorchTPU, and day-0 support for frontier model releases.

A community program will offer shared TPU capacity and review and design help from vLLM core maintainers, with all outputs released as open source.

Post on XView on X
Inferact
@inferact

@googlecloud and Inferact are announcing today a partnership to make TPU a first-class citizen in @vllm_project.

This partnership puts both teams on one engineering roadmap to bring TPU to the broader open model ecosystem, optimizing vLLM as the agentic production serving engine for TPU:

  • Production serving features and optimized kernels
  • A native PyTorch path via TorchTPU
  • Moving towards day-0 support for frontier model releases

We're also launching a community program: shared TPU capacity for open-source contributors, plus dedicated review and design help from the core vLLM maintainers at Inferact.

Everything this collaboration produces is open source. Read the full announcement: https://inferact.ai/news/google-tpu-partnership

Source: Inferact · x.comPublished · added here

Topics

Google / GeminiOpen-source ecosystemDeployment & engineeringIndustry news