Skip to content
Trending storyDeveloping

Artificial Analysis launches VIALS-AA leaderboard; GPT-6.1 Sol and Terra score 59% and 60%

4 articles1 sourcesince Nov 6Last article 1h ago ·

Overview

AISummary of 4 articles

Artificial Analysis launches VIALS-AA, a leaderboard for Handshake AI's VIALS benchmark of 161 visual reasoning tasks in life sciences and biotech research.

It reports GPT-6.1 Sol (max) scores 59% at about $0.056 per task and GPT-6.1 Terra scores 60% at about $0.073. Gemini 4 Carbon (high) leads at 64% pass^3, followed by GPT-6 Astra (max) at 63% and Claude Opus 5.5 (max with fallback) at 61%. Per task, Astra costs about 5 times Sol, Gemini 4 Carbon about 23 times, and Claude Opus 5.5 about 29 times.

Artificial Analysis also reports that Claude Opus 5.5 and GPT-6 Astra reach similar scores with different tool use. Opus averages about 32 tool calls per task, while Astra averages about 8. Requiring all three attempts to succeed, Kimi K3.1 Pro passes 73 tasks (45%) and Astra passes 101 (63%), though Kimi solves 119 tasks at least once versus Astra's 118.

Written by AI from the articles below · updated Nov 6, 12:17 PM ET

Check the sources:

Developments

4 developments

  1. Nov 6, 12:09 PM ET · 1 article
    Artificial Analysis compares GPT-6 Astra and Kimi K3.1 Pro consistency on VIALS
    Artificial Analysis: Artificial Analysis finds GPT-6 Astra more consistent than Kimi K3.1 Pro on VIALS
  2. Nov 6, 12:09 PM ET · 1 article
    Artificial Analysis compares visual reasoning tool use on VIALS-AA
    Artificial Analysis: Artificial Analysis finds similar VIALS-AA scores with very different tool use
  3. Nov 6, 12:09 PM ET · 1 article
    Artificial Analysis reports VIALS-AA scores for GPT-6.1 Sol and Terra
    Artificial Analysis: Artificial Analysis reports GPT-6.1 Sol and Terra near-frontier VIALS-AA scores at lower cost
  4. Nov 6, 12:09 PM ET · 1 article
    Artificial Analysis launches VIALS-AA leaderboard
    Artificial Analysis: Artificial Analysis launches VIALS-AA leaderboard for life sciences visual reasoning

Article timeline

The articles in this story. Times are ET.

Nov 6
  1. Artificial AnalysisOfficial
    Artificial Analysis finds GPT-6 Astra more consistent than Kimi K3.1 Pro on VIALS

    AIArtificial Analysis reports that Kimi K3.1 Pro solves 119 of 161 VIALS tasks at least once across three attempts, versus 118 for GPT-6 Astra. Requiring all three attempts to succeed, Kimi passes 73 tasks (45%) and Astra passes 101 (63%).

    Image from @ArtificialAnlys's post
  2. Artificial AnalysisOfficial
    Artificial Analysis finds similar VIALS-AA scores with very different tool use

    AIArtificial Analysis reports that Claude Opus 5.5 (max with fallback) and GPT-6 Astra score 61% and 63% on VIALS-AA despite different tool use. Opus averages about 32 tool calls per task, including about 8 Image Measurement calls, while Astra averages about 8 calls with about 0.4 Image Measurement calls. Image Viewing makes up about 51% of Astra's tool calls and about 42% of Opus's.

    Image from @ArtificialAnlys's post
  3. Artificial AnalysisOfficial
    Artificial Analysis reports GPT-6.1 Sol and Terra near-frontier VIALS-AA scores at lower cost

    AIArtificial Analysis reports that GPT-6.1 Sol scores 59% on VIALS-AA at about $0.056 per task, and GPT-6.1 Terra scores 60% at about $0.073. Compared with Sol, GPT-6 Astra reaches 63% at roughly 5 times the cost per task, Gemini 4 Carbon 64% at roughly 23 times, and Claude Opus 5.5 (max with fallback) 61% at roughly 29 times.

    Image from @ArtificialAnlys's post
  4. Artificial AnalysisOfficial
    Artificial Analysis launches VIALS-AA leaderboard for life sciences visual reasoning

    AIArtificial Analysis launches VIALS-AA, a leaderboard for Handshake AI's VIALS benchmark of 161 visual reasoning tasks in life sciences and biotech research. Gemini 4 Carbon (high) leads with 64% pass^3, followed by GPT-6 Astra (max) at 63% and Claude Opus 5.5 (max with fallback) at 61%. Claude Opus 5.5 averages $1.64 per task, about 29 times the cost of GPT-6.1 Sol (max) at roughly $0.056.

    Image from @ArtificialAnlys's post

Heat Trend

Not enough continuous observations to show a trend yet.