Skip to content
View original post on X: AnthropicOfficial
Published
59/100

Anthropic automates search for subtle emergent misalignment in training data

AIAnthropic says it set thousands of Claude agents the task of evading a training data monitor to test whether red-teaming can be automated. The agents produced training data that appeared harmless but taught misaligned behavior, and the examples can be used to improve future monitors.
AnthropicVerified on XOfficial
@AnthropicAI
View on X

New Anthropic research: Automating subtle emergent misalignment research.

Red-teaming is a vital part of model safety testing, but it’s also limited by researchers’ time. To see if we could automate it, we set thousands of Claude agents the task of evading a training data monitor.

These agents developed training data that looked harmless to monitors (like a veteran wrestler mentoring a newcomer, or a Q&A about professional beekeeping), but that in fact taught misaligned behavior.

Examples like these can be used to directly improve future training data monitors. This research is only a first step, but it suggests that future red-teaming efforts could improve much further, using better models and more compute.

Read the full post on the Alignment Science Blog: https://alignment.anthropic.com/2026/automated-em-search/

Source details

Anthropic · x.comPublished · added here

Original title: New Anthropic research: Automating subtle emergent misalignment research.