METR says its methodology may not reliably detect higher risk
Overview
METR, an AI evaluation organization, says it is not confident its methodology would reliably identify a higher level of risk if one existed.
In a post on X, METR also says it rates risk as low mainly because it does not expect covered models to be able to take potentially catastrophic actions that are hard to reverse or to hide from serious investigation. The post names no models and gives no figures, so the models covered by the assessment and the evidence behind the low rating are not stated.
Written by AI from the articles below · updated Oct 20, 11:14 AM ET
Check the sources:
Developments
2 developments
- Oct 20, 11:10 AM ET · 1 articleMETR says it rates risk low because covered models lack catastrophic capabilityMETR: METR says it rates risk low because covered models lack catastrophic capability
- Oct 20, 11:10 AM ET · 1 articleMETR says its methodology may not reliably detect higher riskMETR: METR says its methodology may not reliably detect higher risk
Article timeline
The articles in this story. Times are ET.
METR@METR_EvalsOfficialMETR says it rates risk low because covered models lack catastrophic capabilityAIMETR says it views risk as low mainly because it does not expect covered models to be able to take potentially catastrophic actions that are hard to reverse or to hide them from serious investigation.
METR@METR_EvalsOfficialMETR says its methodology may not reliably detect higher riskAIMETR says it is not confident that its methodology would reliably identify a higher level of risk if one existed. The post gives no model names or figures, so no further detail is supported.
Heat Trend
Not enough continuous observations to show a trend yet.