Ai2 at COLM 2026 presents Olmo Hybrid, Olmo-core 3, and AstaBrief
Original titleAi2 at COLM 2026: Open research, from models to agents for science
AISummary
Ai2 says its Olmo Hybrid paper shows a model combining transformer attention with linear recurrent layers reached the same MMLU accuracy as Olmo 3 7B using 49% fewer training tokens.
The lab says a next Olmo model with a hybrid mixture-of-experts architecture is in pre-training, and that it released Olmo-core 3 for training large mixture-of-experts models.
Ai2 also released AstaBrief, an open-weights model that generates cited reports from research questions and retrieved literature.
Source: Ai2 (Allen Institute for AI) · allenai.orgPublished · added here