AWS announces TorchNeuron, an open source native PyTorch backend for Trainium
Original titleIntroducing TorchNeuron: Native PyTorch backend for AWS Trainium
AWS announces TorchNeuron, an open source native PyTorch backend that lets existing PyTorch code run on AWS Trainium through the standard device API. It supports eager execution, torch.compile, and the Neuron Kernel Interface on Trainium2 and Trainium3, with the source code released under Apache 2.0 and a public beta starting Oct.
20. The post reports that 100k Hugging Face models were tested, with gaps in operator coverage that AWS plans to close in later releases.
The post specifies the device API, eager and compile modes, and the known coverage gaps, which helps readers judge whether their PyTorch code can run on Trainium.
Source: PyTorch Blog · pytorch.orgPublished · added here