BAAI says standard continuous diffusion schedules waste over 90% of training budget
Overview
BAAI says standard continuous diffusion noising trajectories waste over 90% of the optimization budget.
According to BAAI, tokens keep their original identity for most of the trajectory, then collapse abruptly in a narrow window near the end. Previous schedules spread training steps uniformly, so the model trains on stages where token identity does not change.
The claim comes from a BAAI post on X dated 2026-11-03. The post reports no experiments or results for an alternative schedule.
Written by AI from the articles below · updated Nov 3, 9:07 AM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
BAAI@BAAIBeijingOfficialBAAI says standard diffusion schedules waste most of their training budgetAIBAAI (@BAAIBeijing) says standard continuous diffusion trajectories waste over 90% of the optimization budget. Tokens keep their identity for most of the noising trajectory, then collapse abruptly in a narrow window near the end. Previous schedules spread training steps uniformly, so they train the model where token identity does not change.

Heat Trend
Not enough continuous observations to show a trend yet.