# SGLang launches a beta plugin for AWS Trainium

> Original title: Welcome AWS Trainium to the SGLang family!

- Source: LMSYS Org
- Published: 2026-10-22T16:06:57.000Z
- Bad Influence: https://badinfluence.news/items/f5drqasnqyiz8acv0x3tk4hb9
- Original: https://x.com/lmsysorg/status/2113301090502639666

## Summary

LMSYS Org announces the beta of the SGLang AWS Trainium plugin, built on TorchNeuron and running on Trainium2 and Trainium3. The beta covers inference serving and RL rollouts for Qwen3, DeepSeek, and GLM model families, with an early preview of heterogeneous RL that runs rollouts on Trainium and training via Miles.

## Why it matters

The post names the hardware, supported model families, and beta scope, which helps readers gauge how far SGLang now reaches beyond GPUs.

## Post

Welcome AWS Trainium to the SGLang family!

Built on TorchNeuron, AWS’s native PyTorch backend, so SGLang’s model components and abstractions carried over largely intact. Our write-up covers what’s in the beta, why we built on TorchNeuron from day one, and our first end-to-end heterogeneous RL run. 
Beta sign-up is in the blog!

https://www.lmsys.org/blog/2026-10-22-sglang-trainium-beta

## Quoted post @sgl_project

> Today, in close collaboration with @awscloud and alongside the TorchNeuron launch, we’re announcing the beta of the SGLang AWS Trainium plugin, built on TorchNeuron and running on Trainium2 and Trainium3.
> 
> What’s in the beta:
> - Inference serving and RL rollouts
> - Support for Qwen3, DeepSeek, and GLM model families, with more frontier models on the way
> - Early preview of heterogeneous RL, with rollouts on Trainium and training via Miles (@radixark)
> 
> Stay tuned for more at the SGLang Summit next month!

https://x.com/sgl_project/status/2113299489394205121