Skip to content
View original post on X: BAAIOfficial
Published
23/100

BAAI says standard diffusion schedules waste most of their training budget

AIBAAI (@BAAIBeijing) says standard continuous diffusion trajectories waste over 90% of the optimization budget. Tokens keep their identity for most of the noising trajectory, then collapse abruptly in a narrow window near the end.
BAAIVerified on XOfficial
@BAAIBeijing
View on X

Part of a thread · earlier post

Why did previous continuous diffusion struggle?

Standard trajectories waste over 90% of the optimization budget. Tokens retain their original identity for most of the noising trajectory, then collapse abruptly in a tiny window near the end!

Previous schedules allocated training steps uniformly, training the model where token identity didn't even change.

Source details

BAAI · x.comPublished

Original title: Why did previous continuous diffusion struggle?