Skip to content
View original post on X: Varun Mohan
Published
34/100

Varun Mohan praises a new eval where top scores sit below 15%

AIVarun Mohan says he likes new evals where the highest score stays under 15%, pointing to the jump from Argon to Carbon and the cost-effectiveness of Gemini models. He expects the leaderboard to change substantially within a few months given the pace of progress.
Varun MohanVerified on X
@_mohansolo
View on X

Always great to see new evals where the highest score is less than 15%. Also, cool to see the jump from Argon to Carbon and how cost effective the Gemini models are for their level of performance.

Excited to see how this leaderboard looks like in a couple months given the rate of progress.

SemiAnalysis@SemiAnalysis_
Today we’re releasing GDPx, a benchmark for measuring agentic capabilities across the most valuable domains. GDPx is a true frontier-level benchmark: even the best model scores just 12% (1/7)🧵
View quoted post on X
Source details

Varun Mohan · x.comPublished · added here

Original title: Always great to see new evals where the highest score is less than 15%. Also, cool to see the jump from Argon to Carbon and how cost effe...

Topics

Google / GeminiEvals & benchmarks