Jerry Liu argues evals can replace hand-built agent workflows for most tasks

AIHarrison Chase's post is titled "eval driven development," presenting evals as a development approach. The main post gives no further detail beyond the title. The quoted context from Jerry Liu argues that most tasks can be solved by defining an eval and hillclimbing over it rather than hand-building a deterministic or agentic workflow.

AIJerry Liu argues that most tasks can now be solved by defining an eval and hillclimbing on it, rather than hand-coding a deterministic or agentic workflow. He says data provider companies are building evals across economic activity so frontier models can handle more work, leaving developers to define goals and success measures. He expects agent interfaces to compress most tasks into goals and eval instructions, while the most complex processes will still need explicit workflow builders.