Artificial Analysis launches VIALS-AA leaderboard; GPT-6.1 Sol and Terra score 59% and 60%
Overview
Artificial Analysis launches VIALS-AA, a leaderboard for Handshake AI's VIALS benchmark of 161 visual reasoning tasks in life sciences and biotech research.
It reports GPT-6.1 Sol (max) scores 59% at about $0.056 per task and GPT-6.1 Terra scores 60% at about $0.073. Gemini 4 Carbon (high) leads at 64% pass^3, followed by GPT-6 Astra (max) at 63% and Claude Opus 5.5 (max with fallback) at 61%. Per task, Astra costs about 5 times Sol, Gemini 4 Carbon about 23 times, and Claude Opus 5.5 about 29 times.
Artificial Analysis also reports that Claude Opus 5.5 and GPT-6 Astra reach similar scores with different tool use. Opus averages about 32 tool calls per task, while Astra averages about 8. Requiring all three attempts to succeed, Kimi K3.1 Pro passes 73 tasks (45%) and Astra passes 101 (63%), though Kimi solves 119 tasks at least once versus Astra's 118.
Written by AI from the articles below · updated Nov 6, 12:17 PM ET
Check the sources:
Developments
4 developments
- Nov 6, 12:09 PM ET · 1 articleArtificial Analysis compares GPT-6 Astra and Kimi K3.1 Pro consistency on VIALSArtificial Analysis: Artificial Analysis finds GPT-6 Astra more consistent than Kimi K3.1 Pro on VIALS
- Nov 6, 12:09 PM ET · 1 articleArtificial Analysis compares visual reasoning tool use on VIALS-AAArtificial Analysis: Artificial Analysis finds similar VIALS-AA scores with very different tool use
- Nov 6, 12:09 PM ET · 1 articleArtificial Analysis reports VIALS-AA scores for GPT-6.1 Sol and TerraArtificial Analysis: Artificial Analysis reports GPT-6.1 Sol and Terra near-frontier VIALS-AA scores at lower cost
- Nov 6, 12:09 PM ET · 1 articleArtificial Analysis launches VIALS-AA leaderboardArtificial Analysis: Artificial Analysis launches VIALS-AA leaderboard for life sciences visual reasoning
Article timeline
The articles in this story. Times are ET.
Artificial Analysis@ArtificialAnlysOfficialArtificial Analysis finds GPT-6 Astra more consistent than Kimi K3.1 Pro on VIALSAIArtificial Analysis reports that Kimi K3.1 Pro solves 119 of 161 VIALS tasks at least once across three attempts, versus 118 for GPT-6 Astra. Requiring all three attempts to succeed, Kimi passes 73 tasks (45%) and Astra passes 101 (63%).

Artificial Analysis@ArtificialAnlysOfficialArtificial Analysis finds similar VIALS-AA scores with very different tool useAIArtificial Analysis reports that Claude Opus 5.5 (max with fallback) and GPT-6 Astra score 61% and 63% on VIALS-AA despite different tool use. Opus averages about 32 tool calls per task, including about 8 Image Measurement calls, while Astra averages about 8 calls with about 0.4 Image Measurement calls. Image Viewing makes up about 51% of Astra's tool calls and about 42% of Opus's.

Artificial Analysis@ArtificialAnlysOfficialArtificial Analysis reports GPT-6.1 Sol and Terra near-frontier VIALS-AA scores at lower costAIArtificial Analysis reports that GPT-6.1 Sol scores 59% on VIALS-AA at about $0.056 per task, and GPT-6.1 Terra scores 60% at about $0.073. Compared with Sol, GPT-6 Astra reaches 63% at roughly 5 times the cost per task, Gemini 4 Carbon 64% at roughly 23 times, and Claude Opus 5.5 (max with fallback) 61% at roughly 29 times.

Artificial Analysis@ArtificialAnlysOfficialArtificial Analysis launches VIALS-AA leaderboard for life sciences visual reasoningAIArtificial Analysis launches VIALS-AA, a leaderboard for Handshake AI's VIALS benchmark of 161 visual reasoning tasks in life sciences and biotech research. Gemini 4 Carbon (high) leads with 64% pass^3, followed by GPT-6 Astra (max) at 63% and Claude Opus 5.5 (max with fallback) at 61%. Claude Opus 5.5 averages $1.64 per task, about 29 times the cost of GPT-6.1 Sol (max) at roughly $0.056.

Heat Trend
Not enough continuous observations to show a trend yet.