Anthropic reportedly scores 178.6 on internal AECI index with secret Model 4
Overview
AI Era (新智元) reports that Anthropic trained a model called Model 4 in secret during September and October, and that it scored 178.6 on the company's internal Comprehensive Capability Index (AECI).
The report says existing test sets are nearly saturated by the model's performance.
The report is based on the AI Era account alone. The source does not give the scale of the AECI, what the test sets contain, or any independent evaluation of Model 4, and Anthropic has not been cited as confirming the figures.
Written by AI from the articles below · updated Nov 7, 8:27 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
- AI EraNewsAnthropic's secret Model 4 reportedly scores 178.6 on internal AECI index
AIAnthropic reportedly trained a model called Model 4 in secret during September and October, which scored 178.6 on its internal Comprehensive Capability Index (AECI). The source says the score is high enough that existing test sets are nearly saturated.
Heat Trend
Not enough continuous observations to show a trend yet.