Elvis Saravia urges building evals for open-ended AI improvement
Overview
Elvis Saravia, an AI researcher posting on X as @omarsar0, says recursive self-improvement depends on being able to measure what is being improved, whether that is a model, a codebase or a business function.
He argues AI performs best on verifiable problems and that open-ended work needs different methods and rigorous evaluations, not short-term benchmark chasing. He says DAIR.AI is researching and building evals in this area and invites collaboration.
Written by AI from the articles below · updated Oct 31, 12:55 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
elvis@omarsar0XElvis Saravia urges building evals to measure open-ended AI improvementsAIElvis Saravia says recursive self-improvement requires knowing how to measure what you want to improve, whether a model, codebase, or business function. He argues AI excels mostly at verifiable problems and that open-ended work needs different methods and rigorous evals rather than short-term benchmark chasing. He says DAIR.AI is researching and building evals in this space and invites collaboration.
Heat Trend
Not enough continuous observations to show a trend yet.