The article examines the sociological origins of current AI safety alarmism, tracing it back to a twenty-five-year-old rationalist subculture. This community, centered around platforms like LessWrong and the Machine Intelligence Research Institute (MIRI), was shaped by figures such as Eliezer Yudkowsky, whose transhumanist interests and "Sequences" essays fostered a distinct intellectual identity. The movement utilized unique cultural technologies, including the viral fanfiction "Harry Potter and the Methods of Rationality" and secular rituals like "Secular Solstice," to build a cohesive, mission-driven membership. This subculture has transitioned from internet forums to significant influence within Silicon Valley, with alumni staffing premier AI labs like Anthropic and OpenAI. For instance, researcher Jacob Coxon’s 2026 resignation from Anthropic highlighted internal beliefs that AI could cause human extinction within a decade, a sentiment echoed by Anthropic's alignment science lead, Evan Hubinger. The author notes that this community's history is inextricably linked to controversial ideologies, including reactionary politics proposed by Curtis Yarvin and "human biodiversity" (race science) discussed by members like Nick Bostrom. Ultimately, the piece argues that the individuals currently shaping global AI regulation and safety standards are products of this specific, highly interconnected social scene, characterized by intense communal bonds and a shared sense of existential urgency.

Read original