Skip to content
View original post on X: Ethan Mollick
Published
38/100

Ethan Mollick says GDPx needs human baselines like GDPval

AIEthan Mollick welcomes GDPx as a successor to GDPval but says it needs human baselines. He reports that GPT-6 Pro flagged errors in the grading and argues that the 0% scores hide economically meaningful differences in success rates.
Ethan MollickVerified on X
@emollick
View on X

Nice to see a successor to GDPval to evaluate AI work but really needs human baselines like GDPval.

Funnily enough, GPT-6 Pro spotted some errors in the grading. I also think the 0% scores hide economically meaningful differences in success rates. But still a valuable benchmark!

SemiAnalysis@SemiAnalysis_
Today we’re releasing GDPx, a benchmark for measuring agentic capabilities across the most valuable domains. GDPx is a true frontier-level benchmark: even the best model scores just 12% (1/7)🧵
View quoted post on X
Source details

Ethan Mollick · x.comPublished · added here

Original title: Nice to see a successor to GDPval to evaluate AI work but really needs human baselines like GDPval.

Topics

Evals & benchmarksExpert opinion