Skip to content
View original post on X: Artificial AnalysisOfficial
Published
31/100

Gemini Decision 1 leads decision models on Artificial Analysis knowledge and reasoning tests

AIArtificial Analysis says Gemini Decision 1 scores highest among decision models on the knowledge and reasoning evaluations in its Decision Index. It scores 66 on AA-Omniscience-Decision, level with GPT-6 Luna (Max) and ahead of d1-ultra (64), answering 45% of questions correctly.
Artificial AnalysisVerified on XOfficial
@ArtificialAnlys
View on X

Part of a thread · earlier post

Gemini Decision 1 has the highest scores among decision models on the knowledge and reasoning evaluations in the Decision Index. On AA-Omniscience-Decision it scores 66, ahead of d1-ultra (64) and GLiDE v1.2 (61) and level with GPT-6 Luna (Max) (66). It answers 45% of questions correctly, compared with 28% for Drex Max v1.1 and 27% for GLiDE v1.2

On HLE-MultiChoice it scores 49, ahead of Mammoth 27B and d1-ultra (both 47). Its accuracy is in line with Decider v1.2 and Jev 1.14, but it leads on Decision Score due to calibration: its Brier score of 0.20 is among the lowest of all models on the evaluation

Source details

Artificial Analysis · x.comPublished · added here

Original title: Gemini Decision 1 has the highest scores among decision models on the knowledge and reasoning evaluations in the Decision Index. On AA-Om...