OpenAI research finds AI models get harder to monitor through their chain of thought
Overview
OpenAI publishes research finding that AI models become harder to monitor through their chain of thought as they scale toward more intelligent systems.
The study measures chain-of-thought monitorability as no-CoT capability and CoT controllability across the model training lifecycle.
OpenAI says further progress in pretraining will require new approaches to monitorability. Max Zeff and Elvis Saravia reported the findings on X, citing OpenAI's thread.
Written by AI from the articles below · updated Nov 11, 4:12 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
will depue@willdepueOfficialOpenAI shares research on chain-of-thought monitorability across model trainingAIOpenAI shares new research on how chain-of-thought monitorability, covering no-CoT capability and CoT controllability, changes over the model training lifecycle. The researchers report that as models scale toward greater intelligence, they become harder to monitor through their chain of thought.
elvis@omarsar0XOpenAI research finds smarter models are harder to monitor through CoTAIOpenAI researchers study how chain-of-thought monitorability, covering no-CoT capability and CoT controllability, changes across the model training lifecycle. They report that as models become more intelligent, they are harder to monitor through their CoT.
Max Zeff@ZeffMaxXOpenAI research finds AI models are harder to monitor through their chain of thoughtAIOpenAI shares research on how chain-of-thought monitorability, covering no-CoT capability and CoT controllability, changes over the model training lifecycle. The research finds models become harder to monitor through their chain of thought as they scale toward more intelligent systems. OpenAI says further progress in pretraining will require new approaches to monitorability.
Heat Trend
- Current comparable heat
- 19
- Peak comparable heat
- 29Nov 11, 5:00 PM ET
- Change in past 24 hours
- –
The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.