Come on broski
Lucas Beyer mocks AI executives as dependent on Yudkowsky's ideas
AISummary
Lucas Beyer (@giffmana) posts a short jab, "Come on broski," in response to a long quoted post by Eliezer Yudkowsky. Yudkowsky argues that AI companies' concepts like recursive self-improvement and AGI originated with him and reached executives through Bostrom and others, and that executives cannot independently articulate a positive vision for AGI or ASI.
Post on XView on X
Lucas Beyer (bl16)Verified on X
@giffmana
So not to go all Yudkowsky Monocause Theory. But a lot of AI company talk that *sounds smart* did come from me, or me via Bostrom or other diffusion modes. High-powered ideas like "recursive self-improvement" and "AGI" are ideas they did not invent themselves, but got off higher-quality outside thinkers. There's a big intellectual history behind me in turn, but the AI companies did not study this history independently; they got it downstream of my writing it up. I naturally spent some time trying to figure out what the positive vision for AGI and ASI would look like, back in the mid-2000s. But I considered it a lower priority to write up. And AI company executives are not at the intellectual level where they can invent coherent answers to questions like that, if they don't have my answer sheet to copy from. They can't tell you what the positive vision for AGI or ASI looks like, because I didn't prioritize writing up that part of my earlier thoughts. They can't copy it off from the same answer sheet they used to produce smart-sounding conversation like "general intelligence" or "recursive self-improvement" or "extinction risk" or "AI alignment problem". If they're not reading off my answer sheet, AI company executives are pretty ordinary as intellectuals. Being able to spend billions on GPUs does not make you a genius inventor, even if we're used to amazing inventions coming from genius rather than black-box optimization. AI company executives are not going to give you better answers about "what's the positive vision" than any other random intellectual challenged with a question beyond their wits. If you start hearing good-sounding answers from Anthropic or OpenAI, it means that Mythos or HPIM advanced to the point of learning how to sound convincing about utopia to humans. I did do an *abstract* writeup on constraints and requirements over positive ASI scenarios (see eg "31 Laws of Fun"); but that does AI companies no good, because they would need to be able to sketch a concrete AGI scenario from those abstract ideas. That again is beyond them if I have not done their homework. It is of course not in humanity's interest that I try to do this homework for the AI companies now. It would only be a lie. They have no utopia to offer.View quoted post on X
Source: Lucas Beyer (bl16) · x.comPublished · added here
