Profiling TorchNeuron on AWS Trainium: system-level profiling walkthrough
AIHugging Face's blog post walks through profiling AWS Trainium workloads with TorchNeuron, the open source native PyTorch backend, using torch.profiler configured through NeuronConfig and NeuronProfiler. The example profiles three RMSNorm implementations: naive PyTorch operations, the built-in torch.rms_norm() lowered to a fused Neuron kernel, and naive operations under torch.compile.
Source details
Hugging Face Blog · huggingface.coPublished · added here
Original title: Profiling TorchNeuron (Part 1): System-level profiling on AWS Trainium.