Skip to content
Trending storyDeveloping

METR says its methodology may not reliably detect higher risk

2 articles1 sourcesince Oct 20Last article 1h ago ·

Overview

AISummary of 2 articles

METR, an AI evaluation organization, says it is not confident its methodology would reliably identify a higher level of risk if one existed.

In a post on X, METR also says it rates risk as low mainly because it does not expect covered models to be able to take potentially catastrophic actions that are hard to reverse or to hide from serious investigation. The post names no models and gives no figures, so the models covered by the assessment and the evidence behind the low rating are not stated.

Written by AI from the articles below · updated Oct 20, 11:14 AM ET

Check the sources:

Developments

2 developments

  1. Oct 20, 11:10 AM ET · 1 article
    METR says it rates risk low because covered models lack catastrophic capability
    METR: METR says it rates risk low because covered models lack catastrophic capability
  2. Oct 20, 11:10 AM ET · 1 article
    METR says its methodology may not reliably detect higher risk
    METR: METR says its methodology may not reliably detect higher risk

Article timeline

The articles in this story. Times are ET.

Oct 20
  1. METROfficial
    METR says it rates risk low because covered models lack catastrophic capability

    AIMETR says it views risk as low mainly because it does not expect covered models to be able to take potentially catastrophic actions that are hard to reverse or to hide them from serious investigation.

  2. METROfficial
    METR says its methodology may not reliably detect higher risk

    AIMETR says it is not confident that its methodology would reliably identify a higher level of risk if one existed. The post gives no model names or figures, so no further detail is supported.

Heat Trend

Not enough continuous observations to show a trend yet.