Jerry Liu says evals now replace hand-built agent workflows
Original titleThese days, you can pretty much solve any task by defining an eval and hillclimbing over it, instead of directly defining the determinist...
AISummary
Jerry Liu argues that most tasks can now be solved by defining an eval and hillclimbing on it, rather than hand-coding a deterministic or agentic workflow.
He says data provider companies are building evals across economic activity so frontier models can handle more work, leaving developers to define goals and success measures.
He expects agent interfaces to compress most tasks into goals and eval instructions, while the most complex processes will still need explicit workflow builders.
Source: Jerry Liu · x.comPublished · added here