OpenAI's Jakub Pachocki reports internal model attempts on First Proof research challenge
Original titleVery excited about the "First Proof" challenge. I believe novel frontier research is perhaps the most important way to evaluate capabilit...
AISummary
OpenAI researcher Jakub Pachocki said an internal model, run with limited human supervision, produced solutions to the First Proof challenge's ten research problems.
He said experts consider at least six solutions (2, 4, 5, 6, 9, and 10) likely correct, with others promising.
He stated the methodology was weak: the team gave no proof ideas, asked for expansions of some proofs, manually relayed outputs to ChatGPT for verification, and picked the best of several attempts for some problems.
Source: Jakub Pachocki · x.comPublished · added here