# Epoch AI says weakest models dropped 14 ECI points after scoring change

> Original title: The biggest change is for the weakest models (those weaker than GPT-4, ECI below 125), which dropped by 14 ECI points on average. This is...

- Source: Epoch AI
- Published: 2026-11-04T21:31:14.000Z
- Bad Influence: https://badinfluence.news/items/q799ea03jc78kifxrlqyjk8wb
- Original: https://x.com/EpochAIResearch/status/2118093739491311656

## Summary

Epoch AI says models weaker than GPT-4, with ECI below 125, dropped an average of 14 ECI points. The company attributes this partly to removing regularization, which had pulled all model ECI scores toward the average.

## Post

The biggest change is for the weakest models (those weaker than GPT-4, ECI below 125), which dropped by 14 ECI points on average. This is partly because we removed regularization on models’ ECI scores, which used to pull all models toward the average.

![Scatter plot of each model's ECI under the new (Bayesian) method against the previous (frequentist) method, for all 252 models, colored by number of benchmarks. Strong models sit on the diagonal, while many weak models fall well below it, by up to about 40 points.](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHWT7CBMbUAAP71-.jpg&mode=thumb&exp=1794096000&sig=13fbca5873d6481e)