Skip to content
View original post on X: Ethan MollickX· 57/100AI score57/100

Ethan Mollick says Gemini 4 passes a top-tier bar but lags in multi-agent work

AISummary

Ethan Mollick says Gemini 4 is a big jump over earlier Gemini models and is the first non-OpenAI or Anthropic model to pass his top-tier bar. He says it matches rivals on creative writing but lags on complex multi-agent work, and tends to be overly certain and a little lazy. He tested all models on the same city-builder prompt, with Gemini 4 running in the Antigravity harness.

Post on XView on X
Ethan MollickVerified on X
@emollick

I spent a decent amount of time with Gemini 4 before launch. Overall, Gemini 4 is a big jump over previous Gemini models and it is the first non-OpenAI/Anthropic model to pass the Fable/Mythos/Astra bar. It is also much more pleasant and more agentic then previous Gemini models, without the weird personality issues that you often found in Gemini 3 series models. In fact, a big advantage is that has a very different personality and sense of taste than Claude or Astra, making it a good addition to the AI world.

On the usefulness side, in some areas it is at least at par with OpenAI and Anthropic (it is quite creative and a good writer), but in others it lags, including at complex multi-agent work. It has a tendency to be too certain about its conclusions and a little lazy, issues not helped by the Antigravity harness not being quite as good as the competition. Still, I expect to see rapid improvements in model abilities using Gemini 4 as a base.

Here is a fun example: "create the ultimate brutalist city builder. you should have lots of controls over buildings in ways that are delightful and inuitive to people who just want to play, but are sophisticated and deep for people who know something about architecture. you should be able to play a lot with design and approach. there should be simulation modes and different ways to view or experience the city. make it stunning. i want to host this on netlify in the end"

Astra Max in Codex: https://formwork-city.netlify.app/Fable
5.1 Max in Code: https://brut-city.netlify.app/
Argon in Antigravity: https://rainbow-panda-689e6b.netlify.app/

Source: Ethan Mollick · x.comPublished · added here