Artificial Analysis finds tools raise task costs unevenly across AI models

AIArtificial Analysis reports that tools raise the cost per task for every model, but by very different amounts. Fable costs $4.20 per task with tools versus $0.73 without, a 5.8× difference, while Qwen3.8 Max (0902, xhigh) shows the largest multiple at 28×. Haiku with tools scores 49% at $0.07 per task, versus Opus without tools at 34% and $0.33.

Artificial AnalysisOfficial

@ArtificialAnlys

View on X

Part of a thread · earlier post

Tools raise the cost per task for every model, but by very different amounts. Astra costs $0.27 per task with tools and $0.21 without, and Sol $0.06 and $0.05. Fable costs $4.20 with tools and $0.73 without, a 5.8× difference. The largest multiples are Qwen3.8 Max (0902, xhigh) at 28×, Gemini 3.8 Flash at 20× and MiMo-V2.6-Pro at 15×.

The cheapest way to reach a given score is often a smaller model with tools. Haiku with tools scores 49% at $0.07 per task, while Opus without tools scores 34% at $0.33.

Source details

Artificial Analysis · x.comPublished Nov 11, 6:46 PM ET · added here 7:02 PM ET

Original title: Tools raise the cost per task for every model, but by very different amounts. Astra costs $0.27 per task with tools and $0.21 without, an...

Artificial Analysis finds tools raise task costs unevenly across AI models

Topics