Skip to content
View original post on X: Artificial AnalysisOfficial
Published
Pick78/100

Artificial Analysis launches Progress Index to track language model capability since 2022

AIArtificial Analysis has announced the Progress Index, a single capability scale covering every language model since 2022, launched alongside Intelligence Index v5. It uses item response theory to estimate one general capability score from all its evaluations, including retired ones, so models can be compared across time.

AIWhy it matters.

The post explains how the Progress Index differs from the Intelligence Index, showing that model capability can be compared across time using one scale.

Artificial AnalysisVerified on XOfficial
@ArtificialAnlys
View on X

We’ve announced the Artificial Analysis Progress Index: a single capability scale for every language model since 2022, launched alongside Intelligence Index v5

The Intelligence Index is still our primary measure of current model intelligence. It uses the evaluations most relevant to developers today, so its mix changes as evaluations are added and retired, and scores from different versions can’t be compared.

The Progress Index is built for comparisons across time. It uses item response theory, a statistical method used to score standardized tests, to estimate one general capability score for each model from the underlying tasks in all our evaluations, including those that are retired or excluded from the Intelligence Index.

Use the Intelligence Index to choose a model today. Use the Progress Index to see how capability has changed over time.

The Progress Index builds on prior work placing models on a single capability scale, in particular @EpochAIResearch's Epoch Capabilities Index and the capability scale @AnthropicAI published in its Claude Mythos Preview system card.

Key takeaways:

➤ Since reasoning models arrived, the frontier has risen ~65 to 70 points a year, about double the 2023 pace: the highest score among released models rose 35 points in 2023 (GPT-3.5 Turbo 125 to GPT-4 Turbo 160), 67 in 2024 (to o1 at 228), 68 in 2025 (to GPT-5.2 at 296) and 56 so far in 2026 (to Gemini 4 Carbon at 352).

➤ Open weights models generally trail proprietary models by about 4 months: since January 2025, each new highest open weights score came 2-8 months (median ~4) after a proprietary model first reached it. DeepSeek V4.1 Flash 1017 is the highest-scoring model with released weights at 324, a level Claude Fable 5 reached in June 2026. Kimi K3.1 Pro (weights not yet released) scores 341, about two months after the closed frontier

➤ New frontier scores are being set more often: the highest score among released models was raised on 2 release dates in 2023, 4 in 2024, 9 in 2025 and 11 so far in 2026. That is about once every four weeks this year.

➤ OpenAI has held the top score most of the time since November 2022, but the frontier has become a close contest: OpenAI held the number one position for the first 27 months measured, but in 2026 especially there have been rapid changes in the leader between OpenAI, Anthropic, and now Google

Source details

Artificial Analysis · x.comPublished

Original title: We’ve announced the Artificial Analysis Progress Index: a single capability scale for every language model since 2022, launched alongside...