ARC Prize compares Google's Carbon and Argon on ARC-AGI-3 public games
Overview
ARC Prize reports that Google's Carbon used more reasoning tokens than Argon on ARC-AGI-3 public games.
It says Carbon used more first-action reasoning tokens than Argon on 24 of 25 games, averaging 6k tokens for its first action at high reasoning versus 2k for Argon.
On 23 of the public games, both models won at high reasoning with the provider adapter, according to ARC Prize. Carbon used 5,731 actions compared with Argon's 5,846, or 2% fewer. Human speedruns on the same games totaled 4,804 actions, so Carbon used 19.3% more than that human reference. The post does not give further detail on the models or methodology.
Written by AI from the articles below · updated Nov 10, 3:36 PM ET
Check the sources:
Developments
3 developments
- Nov 10, 3:31 PM ET · 1 articleARC Prize compares Carbon and Argon on ARC-AGI-3 gamesARC Prize: Carbon uses 2% fewer actions than Argon on 23 ARC-AGI-3 games
- Nov 10, 3:31 PM ET · 1 articleARC Prize reports Carbon and Argon reasoning-token usageARC Prize: ARC Prize reports Carbon used more reasoning tokens than Argon
- Nov 10, 3:31 PM ET · 1 articleARC Prize compares Carbon and Argon reasoning token use on ARC-AGI-3ARC Prize: ARC Prize reports Carbon used more reasoning tokens than Argon on 24 of 25 games
Article timeline
The articles in this story. Times are ET.
ARC Prize@arcprizeOfficialCarbon uses 2% fewer actions than Argon on 23 ARC-AGI-3 gamesAIOn the 23 ARC-AGI-3 public games, both Carbon and Argon won at high with the provider adapter, according to ARC Prize. Carbon used 5,731 actions compared with Argon's 5,846, or 2% fewer. Human speedruns totaled 4,804 actions, so Carbon used 19.3% more than the human reference.

ARC Prize@arcprizeOfficialARC Prize reports Carbon used more reasoning tokens than Argon on 24 of 25 gamesAIARC Prize says Google's Carbon used more first-action reasoning tokens than Argon on 24 of 25 ARC-AGI-3 public games. The comparison is posted on X by ARC Prize, and the post gives no further detail on the models or methodology.

ARC Prize@arcprizeOfficialARC Prize reports Carbon used more reasoning tokens than ArgonAIARC Prize says Carbon used more reasoning tokens than Argon on each of its benchmarks. On ARC-AGI-3 Public games, Carbon at high reasoning averaged 6k reasoning tokens for its first action, compared with 2k for Argon.

Heat Trend
Not enough continuous observations to show a trend yet.