imo a lack of good enough benchmarks is a bottleneck. At least for the type of RSI describe as an intelligence explosion. You can use existing benchmarks to make models way cheaper, though.
Nathan Lambert says benchmarks are a bottleneck for intelligence explosion
AINathan Lambert says a lack of good enough benchmarks is a bottleneck for the kind of recursive self-improvement described as an intelligence explosion. He adds that existing benchmarks can still be used to make models much cheaper.
Nathan LambertVerified on X
@natolambert
Since August, a team within METR has worked with internal Anthropic information to assess whether AI itself is accelerating AI development. We are now publishing a report summarizing the results of this risk assessment.View quoted post on X
Source details
Nathan Lambert · x.comPublished · added here
Original title: imo a lack of good enough benchmarks is a bottleneck. At least for the type of RSI describe as an intelligence explosion. You can use exi...