Skip to content
Trending storyDeveloping

ARC Prize compares Google's Carbon and Argon on ARC-AGI-3 public games

3 articles1 sourcesince Nov 10Last article 19m ago ·

Overview

AISummary of 3 articles

ARC Prize reports that Google's Carbon used more reasoning tokens than Argon on ARC-AGI-3 public games.

It says Carbon used more first-action reasoning tokens than Argon on 24 of 25 games, averaging 6k tokens for its first action at high reasoning versus 2k for Argon.

On 23 of the public games, both models won at high reasoning with the provider adapter, according to ARC Prize. Carbon used 5,731 actions compared with Argon's 5,846, or 2% fewer. Human speedruns on the same games totaled 4,804 actions, so Carbon used 19.3% more than that human reference. The post does not give further detail on the models or methodology.

Written by AI from the articles below · updated Nov 10, 3:36 PM ET

Check the sources:

Developments

3 developments

  1. Nov 10, 3:31 PM ET · 1 article
    ARC Prize compares Carbon and Argon on ARC-AGI-3 games
    ARC Prize: Carbon uses 2% fewer actions than Argon on 23 ARC-AGI-3 games
  2. Nov 10, 3:31 PM ET · 1 article
    ARC Prize reports Carbon and Argon reasoning-token usage
    ARC Prize: ARC Prize reports Carbon used more reasoning tokens than Argon
  3. Nov 10, 3:31 PM ET · 1 article
    ARC Prize compares Carbon and Argon reasoning token use on ARC-AGI-3
    ARC Prize: ARC Prize reports Carbon used more reasoning tokens than Argon on 24 of 25 games

Article timeline

The articles in this story. Times are ET.

Nov 10
  1. ARC PrizeOfficial
    Carbon uses 2% fewer actions than Argon on 23 ARC-AGI-3 games

    AIOn the 23 ARC-AGI-3 public games, both Carbon and Argon won at high with the provider adapter, according to ARC Prize. Carbon used 5,731 actions compared with Argon's 5,846, or 2% fewer. Human speedruns totaled 4,804 actions, so Carbon used 19.3% more than the human reference.

    Image from @arcprize's post
  2. ARC PrizeOfficial
    ARC Prize reports Carbon used more reasoning tokens than Argon on 24 of 25 games

    AIARC Prize says Google's Carbon used more first-action reasoning tokens than Argon on 24 of 25 ARC-AGI-3 public games. The comparison is posted on X by ARC Prize, and the post gives no further detail on the models or methodology.

    Image from @arcprize's post
  3. ARC PrizeOfficial
    ARC Prize reports Carbon used more reasoning tokens than Argon

    AIARC Prize says Carbon used more reasoning tokens than Argon on each of its benchmarks. On ARC-AGI-3 Public games, Carbon at high reasoning averaged 6k reasoning tokens for its first action, compared with 2k for Argon.

    Image from @arcprize's post

Heat Trend

Not enough continuous observations to show a trend yet.