Skip to content
View original post on X: Varun Mohan
Published
42/100

Gemini 4 Carbon scores 57.3 on Bug Bunt Bench at lower cost

AIVarun Mohan says Gemini 4 Carbon jumped from Gemini 4 Argon on Bug Bunt Bench using the Antigravity CLI. Pawel Huryn reports Gemini 4 Carbon (high) scored 57.3 for $31.32, just behind Fable 5.2 (max) at 58 for $139.65.
Varun MohanVerified on X
@_mohansolo
View on X

Insane jump from Argon to Carbon on Bug Bunt Bench using Antigravity CLI. Crazy how fast we are moving and how much more cost efficient the Gemini models are for the capability!

Paweł Huryn@PawelHuryn
What a day! I tested Gemini 4 Carbon on real work. 2 repos, 105 replanted bugs. Find and fix what you can. It scores just behind Fable 5.2. The results: - Fable 5.2 (max): 58 for $139.65 - Gemini 4 Carbon (high): 57.3 for $31.32 - Sonnet 5.5 (max): 51.3 for $154.03 - GPT-6 Astra (max): 45 for $33.03 - GPT-6.1 Sol (max): 44.3 for $5.88 - Gemini 4 Argon (high): 40.7 for $7.16 Google's own benchmarks looked super strong, but nobody could access the model. Turns out they didn't lie: +16.6 points over Argon, at less than a quarter of Fable 5.2's cost. Nobody should be laughing at Google anymore. (the next effort level drops soon in the thread 🧵)
View quoted post on X
Source details

Varun Mohan · x.comPublished · added here

Original title: Insane jump from Argon to Carbon on Bug Bunt Bench using Antigravity CLI. Crazy how fast we are moving and how much more cost efficient t...