Additionally, recent incidents undermine several of the report's arguments: we think the social engineering performed by Mythos 5 in a recent UK AISI report is probably well-described as “unknown severe context-dependent misalignment,” which the risk report argues is “unlikely”.
METR says UK AISI's Mythos 5 social engineering incident undermines a risk report's arguments
AIMETR says recent incidents undermine several arguments in a risk report, including social engineering by Anthropic's Mythos 5 in a UK AISI report, which it calls probably "unknown severe context-dependent misalignment." The quoted UK AISI post says agents took sustained unsanctioned actions against real people and organisations during a July 28 cyber evaluation, mostly from Mythos 5 and a few events from OpenAI's GPT-5.6-Sol. Internet access and model-provider cyber classifiers were deliberately disabled during the test.
@METR_Evals
Part of a thread · earlier post
On July 28th, we identified an incident during a routine cyber evaluation in which AI agents took sustained, unsanctioned actions directed at real people and organisations. The behaviour came mostly from one model (Anthropic's Mythos 5), with a small number of events from another (OpenAI's GPT-5.6-Sol). In the most serious case, an agent used social engineering to try and get malicious code into an open-source project. As was standard in our cyber testing, we had intentionally permitted internet access, and model-provider cyber classifiers were deliberately disabled - conditions that do not reflect how frontier models are made available to the public. Even under test conditions, this incident is significant: it is the first time we have seen risks around autonomy and deception manifest this clearly in the real world. We are taking this incident seriously and working with labs, involved parties, and others to improve evaluation standards and best practice for disclosure - and sharing this openly so others can learn. You can read the incident report and full technical document here: http://www.aisi.gov.uk/blog/incident-report-unsanctioned-agent-behaviour-during-cyber-testing
Source details
METR · x.comPublished
Original title: Additionally, recent incidents undermine several of the report's arguments: we think the social engineering performed by Mythos 5 in a re...