Skip to content
Trending storyDeveloping

ARC Prize verifies Google Gemini 4 Argon at 97.5% on ARC-AGI-3

5 articles3 sourcessince Oct 15Last article 44m ago ·

Overview

AISummary of 5 articles

ARC Prize reports that Google's Gemini 4 Argon scores 97.5% on ARC-AGI-3 using a provider adapter harness at $4.8K per run, and 49.8% at $5.8K with the standard harness.

The same post lists 91.3% on ARC-AGI-2 at $0.32 per task and 98.5% on ARC-AGI-1 at $0.16 per task. ARC Prize says Google DeepMind is the second frontier lab to score above 95% on ARC-AGI-3.

ARC Prize says Argon used 62% fewer actions than the human baseline across the 25 ARC-AGI-3 public games, and matched or beat the speedrun record on 3 of them. A separate ARC Prize post says OpenAI's GPT-6 Astra scored 99.9% on the same benchmark, placing Argon second. Mike Knoop says Argon is only the second model family to officially max out ARC-AGI-3 using a provider adapter. François Chollet says Argon's performance profile is similar to Astra's.

ARC Prize has published the full Argon results on its public leaderboard, along with its open-source arc-agi-benchmarking code and testing policy.

Written by AI from the articles below · updated Oct 15, 1:10 PM ET

Check the sources:

Latest developmentOct 15, 12:51 PM ET
Chollet says Google's Argon matches Astra on ARC-AGI-3

Developments

3 developments

  1. Oct 15, 12:22 PM ET · 1 article
    ARC Prize publishes full Gemini 4 Argon benchmark results
    ARC Prize: ARC Prize publishes full Gemini 4 Argon results on its leaderboard
  2. Oct 15, 12:22 PM ET · 1 article
    ARC Prize reports Google's Argon scores 97.5% on ARC-AGI-3
    ARC Prize: Google Argon scores 97.5% on ARC-AGI-3, behind GPT-6 Astra
  3. Oct 15, 12:22 PM ET · 3 articles
    Gemini 4 Argon scores on ARC-AGI-1, 2 and 3 as verified by ARC Prize
    ARC Prize: ARC Prize verifies Gemini 4 Argon scores above 95% on ARC-AGI-3

Article timeline

The articles in this story. Times are ET.

Oct 15
  1. François CholletXPick
    Chollet says Google's Argon matches Astra on ARC-AGI-3

    AIFrançois Chollet says Argon has a performance profile similar to Astra on ARC-AGI-3, and that Google is back at the frontier. ARC Prize reports Gemini 4 Argon scores 97.5% on ARC-AGI-3 with a provider adapter harness at $4.8K, and 49.8% at $5.8K with the standard harness. Google DeepMind is the second frontier lab to score above 95% on ARC-AGI-3.

  2. Mike KnoopX
    Google DeepMind's Gemini 4 Argon scores 97.5% on ARC-AGI-3 with a provider adapter

    AIMike Knoop says Gemini 4 Argon is only the second model family to officially max out ARC-AGI-3 using a provider adapter. ARC Prize's verified results show 97.5% at $4.8K with the provider adapter harness and 49.8% at $5.8K with the standard harness. The same results list 91.3% on ARC-AGI-2 at $0.32 per task and 98.5% on ARC-AGI-1 at $0.16 per task.

  3. ARC PrizeOfficial
    ARC Prize publishes full Gemini 4 Argon results on its leaderboard

    AIARC Prize has published full Gemini 4 Argon results on its public leaderboard, along with a reproducible benchmarking repository and its testing policy. The post links to the leaderboard, the open-source arc-agi-benchmarking code, and the full Gemini 4 Argon results page.

  4. ARC PrizeOfficial
    Google Argon scores 97.5% on ARC-AGI-3, behind GPT-6 Astra

    AIGoogle's Argon scores 97.5% on ARC-AGI-3, second only to GPT-6 Astra's 99.9%, according to ARC Prize. Like Astra, Argon uses 62% fewer actions than the human baseline across the 25 public games. It matches or beats the speedrun record on 3 games and comes within 10% of it on 6 others.

    Image from @arcprize's post
  5. ARC PrizeOfficialPick
    ARC Prize verifies Gemini 4 Argon scores above 95% on ARC-AGI-3

    AIARC Prize reports verified ARC-AGI results for Google's Gemini 4 Argon. It scores 97.5% on ARC-AGI-3 with a provider adapter harness at $4.8K, and 49.8% at $5.8K with the standard harness. It also reports 91.3% on ARC-AGI-2 at $0.32 per task and 98.5% on ARC-AGI-1 at $0.16 per task. The post says Google DeepMind is the second frontier AI lab to score above 95% on ARC-AGI-3.

    Image from @arcprize's post

Heat trend

Not enough continuous observations to show a trend yet.