# Ray Train DLC and EFA run PyTorch FSDP fine-tuning across two EKS nodes

> Original title: Distributed training with Ray Train DLCs and EFA on EKS

- Source: AWS Machine Learning Blog
- Published: 2026-10-28T18:19:54.000Z
- Bad Influence: https://badinfluence.news/items/yussceo1h3p9q8vp8c85via3n
- Original: https://aws.amazon.com/blogs/machine-learning/distributed-training-with-ray-train-dlcs-and-efa-on-eks/

## Summary

AWS Machine Learning Blog describes a sample that fine-tunes Qwen2.5-1.5B with PyTorch Fully Sharded Data Parallel across eight NVIDIA L4 GPUs on two g6.12xlarge instances. The job uses the Ray Train Deep Learning Container as published, with KubeRay running a single RayCluster manifest on Amazon EKS. Inter-node collectives run over Elastic Fabric Adapter (EFA), and no custom image is built.