# SGLang explains model serving and RL rollouts on AWS Trainium

> Original title: Serve models and generate RL rollouts on AWS Trainium through the SGLang interface you already use.

- Source: SGLang
- Published: 2026-11-07T00:28:52.000Z
- Bad Influence: https://badinfluence.news/items/u3gil055zun2uwe3n5demq8xk
- Original: https://x.com/sgl_project/status/2118863216445149292

## Summary

SGLang says serving models and generating RL rollouts on AWS Trainium works through its existing interface. AWS's Pinak Panigrahi and RadixArk's Alex Nails cover the TorchNeuron plugin beta, NKI kernels, parallelism, speculative decoding, and an introduction to Miles.

## Post

Serve models and generate RL rollouts on AWS Trainium through the SGLang interface you already use.

@AWS's Pinak Panigrahi and @radixark's Alex Nails cover the TorchNeuron plugin beta, NKI kernels, parallelism, speculative decoding and an introduction to Miles.

![](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHWeyxpebAAA7Ksa.jpg&mode=thumb&exp=1794268800&sig=c0dd9ce0ede210d1)