Skip to content
View original post on X: Rohan Paul
Published
Pick75/100

METR report estimates Anthropic's AI-driven development is running at about twice its earlier pace

AIRohan Paul relays METR's report, which found Anthropic is improving its models at about twice its 2024 to 2025 pace. METR's best guess attributes about 80% of this acceleration to Anthropic's own AI use, and it reports that Anthropic redacted most of the evidence METR found most telling.

AIWhy it matters.

The post summarizes METR's report on whether AI is accelerating Anthropic's own development, and it names the redactions and the 2x estimate that readers would need to weigh.

Rohan PaulVerified on X
@rohanpaul_ai
View on X

So much revelation from METR's latest report.

Recursive self-improvement (RSI) at Anthropic has moved from theory to solid measurement, and the early loop already runs at about 2x.

After they spent 11 weeks going through Anthropic’s internal R&D data and interviewing its key researchers.

Anthropic is now improving its models at about twice its 2024 to 2025 pace.

Claude itself is the main engine. METR’s best guess puts about 80% of current acceleration on Anthropic’s own AI use, and it rules out faster growth in training compute as the cause.

Anthropic’s own public August risk report understated how fast things were moving. METR reached that conclusion in a separate review that compared the public report with the private version and other nonpublic data.

METR saw nothing likely to slow this loop within 12 months, with no bottleneck in algorithms, compute or data. Redacted evidence also hints that acceleration may already exceed 2x and keep climbing.

Staff self-report roughly 12x productivity gains from Model 4, and researchers see “signs of life” for AI doing key training work alone. One called Mythos Preview the first model useful for autonomous experiments.

Anthropic redacted most of the evidence METR found most telling, saying it could help rivals go faster. It also canceled midway a planned check of how its compute splits between capabilities and safety.

METR@METR_Evals
Since August, a team within METR has worked with internal Anthropic information to assess whether AI itself is accelerating AI development. We are now publishing a report summarizing the results of this risk assessment.
View quoted post on X
Source details

Rohan Paul · x.comPublished · added here

Original title: So much revelation from METR's latest report.