Skip to content
View original post on X: Artificial AnalysisOfficial
Published
32/100

Artificial Analysis finds similar VIALS-AA scores with very different tool use

AIArtificial Analysis reports that Claude Opus 5.5 (max with fallback) and GPT-6 Astra score 61% and 63% on VIALS-AA despite different tool use. Opus averages about 32 tool calls per task, including about 8 Image Measurement calls, while Astra averages about 8 calls with about 0.4 Image Measurement calls.
Artificial AnalysisVerified on XOfficial
@ArtificialAnlys
View on X

Part of a thread · earlier post

Similar VIALS-AA scores can result from very different approaches to visual reasoning

Claude Opus 5.5 (max with fallback) averages ~32 tool calls per task, compared with ~8 for GPT-6 Astra, while their VIALS-AA scores are similar (61% and 63%, respectively). This is because Opus performs extensive annotation and measurement, averaging ~8 Image Measurement tool calls per task, compared to ~0.4 for Astra. Image Viewing accounts for a larger share of Astra’s tool calls at ~51% vs. ~42% for Opus

Source details

Artificial Analysis · x.comPublished · added here

Original title: Similar VIALS-AA scores can result from very different approaches to visual reasoning