Skip to content
Trending storyDeveloping

BAAI says standard continuous diffusion schedules waste over 90% of training budget

1 article1 sourcesince Nov 3Last article 1h ago ·

Overview

AISummary of 1 article

BAAI says standard continuous diffusion noising trajectories waste over 90% of the optimization budget.

According to BAAI, tokens keep their original identity for most of the trajectory, then collapse abruptly in a narrow window near the end. Previous schedules spread training steps uniformly, so the model trains on stages where token identity does not change.

The claim comes from a BAAI post on X dated 2026-11-03. The post reports no experiments or results for an alternative schedule.

Written by AI from the articles below · updated Nov 3, 9:07 AM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Nov 3
  1. BAAIOfficial
    BAAI says standard diffusion schedules waste most of their training budget

    AIBAAI (@BAAIBeijing) says standard continuous diffusion trajectories waste over 90% of the optimization budget. Tokens keep their identity for most of the noising trajectory, then collapse abruptly in a narrow window near the end. Previous schedules spread training steps uniformly, so they train the model where token identity does not change.

    GIF from @BAAIBeijing's post

Heat Trend

Not enough continuous observations to show a trend yet.