Skip to content
View original post on X: Artificial AnalysisOfficial
Published
30/100

Models that score lowest without tools gain the most from them

AIArtificial Analysis finds the largest gains from tool use go to models that score lowest without tools. The ten models below 31% without tools average about 42 tool calls per task, versus about 23 for the seven above average.
Artificial AnalysisVerified on XOfficial
@ArtificialAnlys
View on X

Part of a thread · earlier post

The largest gains from tools go mostly to models that score lowest without them. The ten models that score below 31% without tools average ~42 tool calls per task, while the seven above average ~23.

MiMo-V2.6-Pro shows the largest gain of any model: it scores 5% without tools and 43% with them, making ~49 tool calls per task. Gemini 3.8 Flash (high) makes ~68 tool calls per task and moves from 16% to 41%.

Astra and Sol make the fewest tool calls of any model, ~8 per task, and gain 13 and 16 points, respectively.

Source details

Artificial Analysis · x.comPublished · added here

Original title: The largest gains from tools go mostly to models that score lowest without them. The ten models that score below 31% without tools averag...