Skip to content
Trending storyDeveloping

Arena reports time and cost gaps among top models on Agent Arena long-horizon tasks

3 articles1 sourcesince Nov 4Last article 1h ago ·

Overview

AISummary of 3 articles

Arena's Agent Arena comparison of the top model from each of five labs finds a 55-minute gap in time spent on long-horizon tasks, according to an Arena post on X. Claude Opus 5.5, ranked #1, takes the longest at every task length, peaking at 1 hour 51 minutes, while Kimi K3.1 Pro takes the least, at 56 minutes on long-horizon tasks.

A later Arena post reports that a median hour of work costs $10.51 with Gemini 4 Carbon, $21.13 with Claude Opus 5.5 and $31.08 with GPT-6 Astra. Arena says Claude Opus 5.5 still scores higher but costs twice as much per hour as Gemini 4 Carbon. The cost comparison covers nearly 30,000 tasks run for over an hour in the last 14 days.

Another Arena post says Google's Gemini 4 Argon and Xiaomi's MiMo-V2.6 gain frontier spots on the most expensive 5% of sessions, where OpenAI and Anthropic hold 7 spots, versus 10 of 11 on cheaper tasks.

Written by AI from the articles below · updated Nov 4, 12:52 PM ET

Check the sources:

Developments

3 developments

  1. Nov 4, 12:49 PM ET · 1 article
    Arena compares model costs on long-running agent tasks
    Arena: Arena finds Gemini 4 Carbon costs half as much as Claude Opus 5.5 per hour
  2. Nov 4, 12:41 PM ET · 1 article
    Arena reports model ranking shifts on more expensive agent tasks
    Arena: Arena ranks Gemini 4 Argon and MiMo-V2.6 higher on costly agent sessions
  3. Nov 4, 12:30 PM ET · 1 article
    Arena compares frontier models' time spent on long-horizon tasks
    Arena: Arena finds a 55-minute gap in long-horizon task time among top models

Article timeline

The articles in this story. Times are ET.

Nov 4
  1. Arena.aiOfficial
    Arena finds Gemini 4 Carbon costs half as much as Claude Opus 5.5 per hour

    AIArena reports that Gemini 4 Carbon costs a median $10.51 per hour-long task on Agent Arena, versus $21.13 for Claude Opus 5.5 and $31.08 for GPT-6 Astra. Arena says Claude Opus 5.5 still scores higher but costs twice as much per hour of work. The comparison covers nearly 30,000 tasks run for over an hour in the last 14 days, averaging 332 tool calls per task.

    Video from @arena's post
  2. Arena.aiOfficial
    Arena ranks Gemini 4 Argon and MiMo-V2.6 higher on costly agent sessions

    AIArena says Google's Gemini 4 Argon and Xiaomi's MiMo-V2.6 Flash and Pro gain frontier spots on the most expensive 5% of Agent Arena sessions, where OpenAI and Anthropic hold 7 spots versus 10 of 11 on cheaper tasks. More than 1,000 sessions costing $100 or more occurred in the last two weeks.

    Video from @arena's post
  3. Arena.aiOfficial
    Arena finds a 55-minute gap in long-horizon task time among top models

    AIArena's Agent Arena comparison of the top model from each of five leading labs shows a 55-minute gap in time spent on long-horizon tasks. Claude Opus 5.5, ranked #1 on Agent Arena, takes the longest at every task length, peaking at 1 hour 51 minutes. Kimi K3.1 Pro spends the least time at every length, with 56 minutes on long-horizon tasks.

    Video from @arena's post

Heat Trend

Not enough continuous observations to show a trend yet.