Comparing prime-rl with Mega MoE against TorchTitan:
- Training steps on Qwen3-30B-A3B are 48% faster
- Training steps on Qwen3-235B-A22B are 55% faster
prime-rl with Mega MoE trains Qwen3 MoE models faster than TorchTitan
AIPrime Intellect says prime-rl with Mega MoE completes training steps 48% faster than TorchTitan on Qwen3-30B-A3B. On Qwen3-235B-A22B, the same comparison shows steps 55% faster.
@PrimeIntellect
Part of a thread · earlier post
Source details
Prime Intellect · x.comPublished · added here
Original title: Comparing prime-rl with Mega MoE against TorchTitan: