Harrison Chase questions eval-driven development for autonomous agents

Harrison Chase argues that eval-driven development works for narrowly scoped tasks but breaks down for more autonomous agents, invoking Goodhart's Law that a measure ceases to be useful once it becomes a target. He asks how such agents can be hill-climbed, and the post does not provide an answer.