Mustafa Suleyman says MAI now has state-of-the-art pre-trained base models in the 3T-parameter weight class, built entirely in-house. He says post-training results are coming soon and points readers to a technical blog post for more details.
The post names a specific parameter class and says the pre-trained base models were built in-house, giving readers a concrete starting point before the technical details are published.
We now have state-of-the-art pre-trained base models in the 3T-parameter weight class, built entirely in-house at MAI.
Post-training results coming soon -- stay tuned!
Lots of details in our technical blog post.
https://microsoft.ai/news/frontier-pre-training-at-microsoft-ai/
Source: Mustafa Suleyman · x.comPublished · added here
