# Nouamane shares a guide to large-scale MoE training

> Original title: Leandro's thread:

- Source: Thomas Wolf
- Published: 2026-11-05T19:57:17.000Z
- Bad Influence: https://badinfluence.news/items/fyyuincmd0zyaqg73emlgkszl
- Original: https://x.com/Thom_Wolf/status/2118432483150594402

## Summary

Nouamane, following his Ultra Scale Playbook, has published a guide to training mixture-of-experts models at large scale. Leandro Von Werra calls it probably the most comprehensive resource on the topic, featuring extensive visualizations.

## Post

Leandro's thread:
https://x.com/lvwerra/status/2118415483603177956?s=20

## Quoted post @lvwerra

> After the Ultra Scale Playbook, Nouamane is back with this crazy guide to train MoEs! 
> 
> It's probably the most comprehensive resource if you want to get into large scale MoE training and an absolute gem packed with beautiful visualization!

https://x.com/lvwerra/status/2118415483603177956