I’m happy that @OpenAI presents model evals this way. We should measure intelligence as a function of cost.
OpenAI's Noam Brown says AI evals should measure intelligence against cost
AISummary
Noam Brown praised OpenAI for presenting model evaluations as intelligence plotted against cost, arguing that cost should be part of how intelligence is measured. OpenAI's linked context says GPT-6.1 Sol delivers near-Astra intelligence at one-fifth the price and is the most cost-efficient model for its performance available today.
Post on XView on X
@polynoamial
GPT-6.1 Sol: near-Astra intelligence for a fifth of the price. It’s the most cost-efficient model for its performance available today.
Source: Noam Brown · x.comPublished · added here