People have a really confused sense of what "power" is and will mean in the post-singularity future. There's a frequent conflation between the power to max out your personal reward registers - e.g. being wealthy and having all the nice experiences you want to have - and causal power to influence the organization of matter and energy in the future. People are on track to obtain the former at the expense of the latter, and this distinction is lost on many. That's not to say we're heading towards something necessarily bad, but IMHO we should be much more careful about what specific choices we make in the details with a clear-eyed understanding of this distinction.
Achiam says people confuse personal reward with causal power over the future
AIJoshua Achiam argues that people misunderstand "power" in a post-singularity future, conflating personal reward, such as wealth and pleasant experiences, with causal power to shape how matter and energy are organized. He says people are on track to gain the former at the expense of the latter, and that this distinction is lost on many.
Joshua AchiamVerified on X
@jachiam0
Source details
Joshua Achiam · x.comPublished · added here
Original title: People have a really confused sense of what "power" is and will mean in the post-singularity future. There's a frequent conflation betwee...