Epoch AI updates its Capabilities Index to use Bayesian methodology

We’ve updated the Epoch Capabilities Index (ECI) to use a Bayesian methodology. This improves uncertainty estimates and lets us compare models more accurately, even when their individual ECI uncertainty intervals overlap.

Frontier model scores are largely unchanged: models stronger than GPT-4 move by less than 1 ECI point on average.