1. Benchmarks provide one piece of evidence for acceleration. Since Oct 2025, AECI scores for Anthropic’s models have grown at 1.9x [95%: 1.5–2.8] the earlier rate. Analysis choices affect this estimate, and it remains unclear how benchmark scores map to real-world capabilities.
METR finds Anthropic model benchmark scores growing 1.9x faster since October 2025
AIMETR reports that since October 2025, AECI scores for Anthropic's models have grown at 1.9x [95%: 1.5–2.8] the earlier rate. The post says analysis choices affect this estimate and that it remains unclear how benchmark scores map to real-world capabilities.
Source details
METR · x.comPublished · added here
Original title: 1. Benchmarks provide one piece of evidence for acceleration. Since Oct 2025, AECI scores for Anthropic’s models have grown at 1.9x [95%:...