The biggest change is for the weakest models (those weaker than GPT-4, ECI below 125), which dropped by 14 ECI points on average. This is partly because we removed regularization on models’ ECI scores, which used to pull all models toward the average.
Epoch AI says weakest models dropped 14 ECI points after scoring change
AIEpoch AI says models weaker than GPT-4, with ECI below 125, dropped an average of 14 ECI points. The company attributes this partly to removing regularization, which had pulled all model ECI scores toward the average.
Source details
Epoch AI · x.comPublished
Original title: The biggest change is for the weakest models (those weaker than GPT-4, ECI below 125), which dropped by 14 ECI points on average. This is...