Joshua Achiam argues human inconsistency limits perfect AI alignment
Overview
Joshua Achiam, on X, argues that AI alignment is hard partly because humans do not fully understand what they want and cannot state it perfectly.
He says that even an AI that could read minds would not produce a coherent extrapolated volition (CEV) that people would accept, because enforcing consistency would remove the inconsistencies he considers part of what makes life valuable. He concludes that humanity will have to muddle through under high uncertainty. The post is a single report, and no other sources or responses are cited.
Written by AI from the articles below · updated Oct 15, 7:58 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
Joshua Achiam@jachiam0XJoshua Achiam argues human inconsistency limits perfect AI alignmentAIJoshua Achiam says alignment is hard partly because humans do not fully understand what they want and cannot request it perfectly. He argues that even a mind-reading AI could not deliver a CEV that people would accept, since enforcing conformity would destroy the human inconsistencies that make life valuable. He concludes that humanity will have to muddle through under high uncertainty.
Heat trend
Not enough continuous observations to show a trend yet.