The article asserts that the AI safety and alignment movement is fundamentally driven by a centralized subculture originating from the "rationalist" community and its founder, Eliezer Yudkowsky. The author argues that the technical discourse surrounding AI—specifically concepts like "AI alignment," "superintelligence," and the "paperclip maximizer"—was popularized by Yudkowsky's non-profit and his fan fiction, *Harry Potter and the Methods of Rationality*. The author contends that this movement operates with cult-like characteristics, centered in Berkeley, California, where members often reside in communal "group houses" and engage in polyamorous social structures and organized sexual events like "SlutCon." The piece links the financial foundations of these groups to the FTX collapse, noting that Lighthaven, a Berkeley facility hosting various rationalist events, was purchased by a rationalist charity using funds from Sam Bankman-Fried. Ultimately, the author claims this "doomsday" ideology creates a conflict of interest, driving influential figures like Sam Altman, Elon Musk, and Dario Amodei to advocate for regulations focused on "pausing" or "slowing down" AI research. The author argues these policy goals are not based on empirical evidence but are products of a millenarian obsession with AI-induced extinction.
Read original
hackernews