# Moore Threads open-sources Megatron-MUSA-Titan for trillion-parameter MoE training on its GPUs

> Original title: Moore Threads Open-Sources Megatron-MUSA-Titan for Trillion-Parameter MoE Training on Its GPUs

- Source: Pandaily
- Published: 2026-10-29T02:00:28.000Z
- Bad Influence: https://badinfluence.news/items/swjqf5a7qmd0k8abj1nce2npm
- Original: https://pandaily.com/moore-threads-open-sources-megatron-musa-titan-trillion-parameter-moe-training-10000-gpu-blockwise-fp8

## Summary

Moore Threads has open-sourced Megatron-MUSA-Titan, training infrastructure for trillion-parameter mixture-of-experts models on clusters of more than 10,000 of its GPUs. The company says the stack has been used for trillion-parameter MoE pretraining, but has not published a specific MFU figure. The project is built on NVIDIA's Megatron-LM, and the company says it runs on its GPUs through torch_musa and MUSA C without modifying upstream code, with blockwise FP8 training and reinforcement learning support.