Baidu open-sources ERNIE 5.5 Flash Base with 280B total parameters
AIBaidu open-sourced ERNIE 5.5 Flash Base on November 5, a MoE base model with 280 billion total parameters and 14 billion active per token. The company says it was pretrained on 33.5 trillion tokens, supports up to 128K context in pretraining and up to 1 million tokens in fine-tuning and inference, and outperforms DeepSeek-V4-Flash-Base, Hy3-preview-Base, and MiMo-V2.5-Base on several benchmarks of its size class.
Loading source posts…
Source details
Leiphone · leiphone.comPublished · added here
Original title: 百度开源文心5.5 Flash Base，多基准测试刷新同尺寸模型 SOTA