Arena reports time and cost gaps among top models on Agent Arena long-horizon tasks
Overview
Arena's Agent Arena comparison of the top model from each of five labs finds a 55-minute gap in time spent on long-horizon tasks, according to an Arena post on X. Claude Opus 5.5, ranked #1, takes the longest at every task length, peaking at 1 hour 51 minutes, while Kimi K3.1 Pro takes the least, at 56 minutes on long-horizon tasks.
A later Arena post reports that a median hour of work costs $10.51 with Gemini 4 Carbon, $21.13 with Claude Opus 5.5 and $31.08 with GPT-6 Astra. Arena says Claude Opus 5.5 still scores higher but costs twice as much per hour as Gemini 4 Carbon. The cost comparison covers nearly 30,000 tasks run for over an hour in the last 14 days.
Another Arena post says Google's Gemini 4 Argon and Xiaomi's MiMo-V2.6 gain frontier spots on the most expensive 5% of sessions, where OpenAI and Anthropic hold 7 spots, versus 10 of 11 on cheaper tasks.
Written by AI from the articles below · updated Nov 4, 12:52 PM ET
Check the sources:
Developments
3 developments
- Nov 4, 12:49 PM ET · 1 articleArena compares model costs on long-running agent tasksArena: Arena finds Gemini 4 Carbon costs half as much as Claude Opus 5.5 per hour
- Nov 4, 12:41 PM ET · 1 articleArena reports model ranking shifts on more expensive agent tasksArena: Arena ranks Gemini 4 Argon and MiMo-V2.6 higher on costly agent sessions
- Nov 4, 12:30 PM ET · 1 articleArena compares frontier models' time spent on long-horizon tasksArena: Arena finds a 55-minute gap in long-horizon task time among top models
Article timeline
The articles in this story. Times are ET.
Arena.ai@arenaOfficialArena finds Gemini 4 Carbon costs half as much as Claude Opus 5.5 per hourAIArena reports that Gemini 4 Carbon costs a median $10.51 per hour-long task on Agent Arena, versus $21.13 for Claude Opus 5.5 and $31.08 for GPT-6 Astra. Arena says Claude Opus 5.5 still scores higher but costs twice as much per hour of work. The comparison covers nearly 30,000 tasks run for over an hour in the last 14 days, averaging 332 tool calls per task.

Arena.ai@arenaOfficialArena ranks Gemini 4 Argon and MiMo-V2.6 higher on costly agent sessionsAIArena says Google's Gemini 4 Argon and Xiaomi's MiMo-V2.6 Flash and Pro gain frontier spots on the most expensive 5% of Agent Arena sessions, where OpenAI and Anthropic hold 7 spots versus 10 of 11 on cheaper tasks. More than 1,000 sessions costing $100 or more occurred in the last two weeks.

Arena.ai@arenaOfficialArena finds a 55-minute gap in long-horizon task time among top modelsAIArena's Agent Arena comparison of the top model from each of five leading labs shows a 55-minute gap in time spent on long-horizon tasks. Claude Opus 5.5, ranked #1 on Agent Arena, takes the longest at every task length, peaking at 1 hour 51 minutes. Kimi K3.1 Pro spends the least time at every length, with 56 minutes on long-horizon tasks.

Heat Trend
Not enough continuous observations to show a trend yet.