Berkeley paper proposes periodic session resets to keep research agents improving
Overview
UC Berkeley researchers propose periodically discarding research agents' session and candidate history and restarting from the best candidate found so far, according to a paper titled Scaling Discovery Requires Forgetting.
The paper says agents that keep their full history become anchored on past attempts and stop improving.
According to a post by Elvis Saravia, the method gives up to 15% over parallel agents and up to 39% over a single agent with the same budget across heuristic programming, kernel optimization, and model training tasks.
Written by AI from the articles below · updated Oct 15, 9:55 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
elvis@omarsar0XUC Berkeley paper finds research agents need periodic forgetting to keep improvingAIA UC Berkeley paper, Scaling Discovery Requires Forgetting, reports that research agents that keep their full history become anchored on past attempts and stop improving. The authors periodically discard each agent's session and candidate history and restart from the best candidate found so far. The post reports gains of up to 15% over parallel agents and up to 39% over a single agent with the same budget across heuristic programming, kernel optimization, and model training tasks.

Heat trend
Not enough continuous observations to show a trend yet.