Our new silicon is 🔥
40% more tokens per watt!
Microsoft announces Maia 300 chip with 40% more tokens per watt
AISummary
Microsoft says Maia 300 delivers 40% more tokens per watt than leading GPU-based systems.
The quoted announcement from Satya Nadella says the Maia family will scale to multi-gigawatt deployments starting next calendar year as the primary inference system for Microsoft's own products and services.
It also says Maia 200 is already deployed in the US, Europe, and Australia, delivering up to 1.7x more tokens per watt in Teams and Copilot.
Post on XView on X
Mustafa SuleymanVerified on X
@mustafasuleyman
Today we are announcing our biggest bet yet on our own silicon. Starting next calendar year, we will scale our Maia family to multi-gigawatt deployments, making it the primary inference system for our own product and services. And we’re introducing Maia 300, which delivers 40% more tokens per watt compared to leading GPU-based systems. We are already deploying Maia 200 across the US, Europe, and Australia, delivering up to 1.7x more tokens per watt across experiences in Teams and Copilot. Our goal is to build on the full-stack efficiency gains we’ve already seen, while continuing to bring the latest innovations from across the ecosystem into our fleet.
Source: Mustafa Suleyman · x.comPublished · added here