BAAI finds IAMFlow, Causal-Forcing and SWIFT trade off quality, drift and responsiveness

BAAI reports that its comparison of three interactive video models shows visual quality, drift and response speed do not predict whether user updates succeed.

IAMFlow scores highest on visual quality at 2.840 but has the largest quality drift at 0.425. Causal-Forcing has lower absolute quality but the lowest visual drift at 0.189. SWIFT responds in 10.3 seconds but succeeds in only 24.6% of updates, according to the BAAI post on X.

BAAI says this means a fast response can hide ignored user instructions, so speed alone does not show a model is reliable.