Skip to content
Trending storyDeveloping

Sophia Yang shares a new model's agentic benchmark scores and pricing

1 article1 sourcesince Oct 17Last article 2h ago ·

Overview

AISummary of 1 article

Sophia Yang posts on X that a new model is out, sharing its benchmark results and pricing.

The reported figures show the model scoring 77.0 on DeepSWE, above Opus 5's 74.0, at about $0.20 per task versus about $12 for Opus 5. The model also beats Opus 5 on AutomationBench, Agents' Last Exam and Apex, but trails it on HLE, Terminal-Bench, ProgramBench, NL2Repo and the visual benchmarks.

The quoted thread describes a 552B-parameter mixture-of-experts model with a 1M context window, priced at $0.30 per million input tokens and $1.20 per million output tokens at peak, half off-peak. These benchmark and price figures come from the quoted thread, not from independent testing.

Written by AI from the articles below · updated Oct 17, 8:55 AM ET

Check the sources:

Latest developmentOct 17, 8:51 AM ET
This is the first model drop on a Saturday? Interesting choice 😄

Article timeline

The articles in this story. Times are ET.

Oct 17
  1. Sophia YangXPick
    This is the first model drop on a Saturday? Interesting choice 😄

    AIA new model reportedly scores 77.0 on DeepSWE, above the prior 74.2 and Opus 5's 74.0, at about $0.20 per task versus about $12 for Opus 5. It also beats Opus 5 on AutomationBench, Agents' Last Exam and Apex, but trails it on HLE, Terminal-Bench, ProgramBench, NL2Repo and the visual benchmarks. The quoted thread describes a 552B-parameter mixture-of-experts model with 196B Engram memory and a 1M context window, priced at $0.30 per million input tokens and $1.20 output at peak.

Heat trend

Current comparable heat
9
Peak comparable heat
10Oct 17, 9:00 AM ET
Change in past 24 hours
–

The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.

Related stories