Skip to content
View original post on X: BAAIOfficial
Published
31/100

LLaCO, an 8B continuous diffusion language model, beats LLaDA-8B and Dream-7B on math and code

AIBAAI, BUPT, and PKU introduce LLaCO, an 8B continuous diffusion language model. The post says it outperforms previous continuous baselines and discrete diffusion models LLaDA-8B and Dream-7B on math and code tasks.
BAAIVerified on XOfficial
@BAAIBeijing
View on X

Continuous Diffusion for LLMs just got its breakthrough moment.

Meet LLaCO: a breakthrough 8B Continuous Diffusion Language Model that not only shatters previous continuous baselines, but beats competitive discrete diffusion models like LLaDA-8B and Dream-7B in Math & Code! Continuous Diffusion truly rivals state-of-the-art LLMs in deep reasoning.

Joint work by @BAAIBeijing, BUPT, and PKU👇

Source details

BAAI · x.comPublished

Original title: Continuous Diffusion for LLMs just got its breakthrough moment.

Topics

Data & trainingPapers & researchEvals & benchmarks