Karpathy argues verifiability predicts which tasks AI automates fastest

Karpathy argues that verifiability, not specifiability, is the most predictive feature for AI automation, since verifiable tasks can be optimized directly or through reinforcement learning.

He says a task is suited to this approach when the environment is resettable, efficient, and rewardable.

This explains the jagged frontier of LLM progress, with verifiable domains like math and code advancing rapidly while creative and strategic tasks lag behind.