Skip to content
View original post on X: Epoch AIOfficial
Published
34/100

Epoch AI gives probabilistic capability rankings for Astra, Opus 5.5 and Fable 5.1

AIEpoch AI now produces uncertainty estimates and a joint distribution over all models' ECIs, enabling direct model comparisons. It says Astra has a 72% probability of being more capable than Opus 5.5 and a 99% probability of being more capable than Fable 5.1.
Epoch AIVerified on XOfficial
@EpochAIResearch
View on X

Part of a thread · earlier post

With better uncertainty estimates and a joint distribution over all models’ ECIs, we can now compare models directly.

For example, we can now say Astra has a 72% probability of being more capable than Opus 5.5, but a 99% probability of being more capable than Fable 5.1.

Source details

Epoch AI · x.comPublished

Original title: With better uncertainty estimates and a joint distribution over all models’ ECIs, we can now compare models directly.