Skip to content
View original post on X: ARC PrizeOfficial
Published
34/100

ARC Prize reports Gemini 4 Carbon costs twice Argon on ARC-AGI-2

AIARC Prize says Gemini 4 Carbon averaged 68k reasoning tokens per completed ARC-AGI-2 task at high reasoning, versus 28k for Argon. With the same token pricing, Carbon's extra reasoning raised the cost to $0.75 per task, compared with $0.36 for Argon, or 2.1x.
ARC PrizeVerified on XOfficial
@arcprize
View on X

Part of a thread · earlier post

Similarly, on ARC-AGI-2 public at high reasoning, Carbon averaged 68k reasoning tokens per completed task vs 28k for Argon. With the same token pricing and similar input and non-reasoning output, Carbon’s extra reasoning drove cost to $0.75/task vs $0.36/task (2.1x).

Full results: https://arcprize.org/results/google-gemini-4-carbon

Source details

ARC Prize · x.comPublished

Original title: Similarly, on ARC-AGI-2 public at high reasoning, Carbon averaged 68k reasoning tokens per completed task vs 28k for Argon. With the same...

Topics

Google / GeminiReasoningEvals & benchmarks