Skip to content
View original post on X: Artificial AnalysisOfficial· 36/100AI score36/100

Artificial Analysis says Inception's Mercury 3 scores are not comparable to its index

AISummary

Artificial Analysis says a recent announcement cited AA-Omniscience and GDPval-AA v2 scores for Inception's Mercury 3 that are not part of its Intelligence Index. It says AA-Omniscience uses a private dataset, with only a 10% public subset open sourced, and GDPval-AA v2 must use its grading methodology and model comparison set to be comparable.

Post on XView on X
Artificial AnalysisVerified on X
@ArtificialAnlys

Note that this is not our Intelligence Index. The announcement also referred to scores for AA-Omniscience and GDPval-AA v2, which do not follow our methodology and are not comparable to scores on Artificial Analysis.

AA-Omniscience uses a private dataset (though we open sourced a public subset of 10%) and GDPval-AA v2 needs to use our grading methodology and our model comparison set to be comparable.

Inception@_inception_ai
Mercury 3 is live: the most capable diffusion LLM released to date. It outperforms GPT-6 Luna and Claude Haiku 5.5 across a range of benchmarks while running at over 1,000 tokens per second. More than 40x the size of Mercury 1, 3x more intelligent across standard benchmarks, and just as fast, with a 1M-token context window. Available today on the Inception API, @baseten, and @OpenRouter .
View quoted post on X

Source: Artificial Analysis · x.comPublished · added here