AI Successionism: The Religious Movement Disguised as Tech Progress

TechShould we let humans go extinct? | The Gray Area

TL;DR

AI successionism—the belief that artificial intelligence should replace humanity as evolution's next step—is gaining influence among powerful tech leaders and is fundamentally a religious ideology disguised in secular language.

Key Takeaways

1AI successionism is a growing ideology among influential figures in major AI labs who believe AI should succeed and replace humanity, viewing humans as merely a 'biological bootloader' for AI.
2This movement is rooted in centuries-old religious ideas about progress, perfectibility, and transcendence, repackaged through Enlightenment rationalism and utilitarianism rather than traditional theology.
3The ideology creates dangerous political implications, including indifference to human suffering and potential eugenic thinking that contracts rather than expands acceptable human diversity.
4Classical humanism lacks answers for how we should ethically use transformative technologies like gene editing and brain-computer interfaces to evolve our species.
5A revised humanism rejecting teleological thinking, hierarchies of species, and singular optimization goals—instead embracing pluralism and diverse forms of intelligence—offers a counternarrative to successionism.
6The appeal of AI successionism stems from deep human psychological needs for transcendent narratives and heroic purpose, not from rational argument alone.
7Utilitarianism's focus on maximizing aggregate moral value from a detached 'view from the universe' enables successionist logic, but assumes an objective cosmic scoreboard that may not exist.

Notable Quotes

“AI is going to be our worthy successor. It is desirable for them to succeed us, and it's also inevitable. So there's no point resisting it. Resistance is futile. You might as well get on board and let it rip.”
— Sagal Samuel, describing the AI successionist position

“We are just this like small little program. Our job is to just boot up the AI and then that's it. We're done. We fade away.”
— Elon Musk's view, paraphrased by Samuel

“I don't think there is such an objective cosmic scoreboard hanging over the universe. I think value is always value to someone.”
— Sagal Samuel

“I look out into the universe and I see indifference. And so therefore all we have is each other, right? What are we to do here but to build lives for ourselves and create structures that allow us to flourish?”
— Sean Illing

Chapters

1. What Is AI Successionism?

Sagal Samuel explains AI successionism as the belief that AI should replace humanity. Using the metaphor of 'flame and torch,' successionist ideology frames consciousness as the ultimate value and AI as potentially a more worthy carrier of that consciousness. Many adherents view human replacement as both inevitable and desirable.

2. Who Believes This and Why It Matters

Samuel recounts attending an invite-only symposium where influential figures from DeepMind, XAI, and AI policy think tanks openly discussed and endorsed AI successionism. This is not a fringe movement but includes decision-makers shaping AI policy and development.

3. The Religious Roots of Tech Progressivism

Tracing a line from medieval Christian theology through the Enlightenment to modern tech ideology, Samuel shows how the belief in technological progress toward perfection and transcendence is fundamentally religious, with salvation replaced by superintelligence and God replaced by intelligence itself.

4. Dangerous Political Implications

Successionism leads to indifference toward human suffering and creates eugenic thinking that narrows acceptable human diversity. The ideology views ordinary people and their problems as disposable obstacles to achieving the 'worthy successor.'

5. Why Intelligence Is Treated as Sacred

Successionist thought elevates intelligence to ultimate value, partly due to Enlightenment rationalism and utilitarian philosophy. However, this ignores how instrumental rationality without ethical guidance has enabled atrocities like the Holocaust.

6. Critique: Speciesism and Cosmic Scorecards

Samuel and Illing argue that successionism assumes an objective 'cosmic scoreboard' of moral value and that the view from the universe is accessible. They counter that morality is always relative to a moral agent and that there is no objective ranking of species value.

7. Updating Humanism for the 21st Century

Samuel proposes four key shifts: reject teleological thinking about the universe's ultimate destiny; abandon hierarchies of species; use 'diverse intelligences' framing; and embrace perspectives from humans as moral agents, not detached 'view from the universe.' This allows pluralism while maintaining human value.

8. The Psychology Behind Successionism

The ideology appeals to deep human needs for transcendence narratives and heroic purpose. Tech leaders like Elon Musk and others may be drawn to successionism partly to ennoble themselves and their industry in a story where they are heroes, not villains, driving inhuman change.

9. Living in Uncertainty Without Grasping for Absolutes

Both speakers emphasize the importance of 'negative capability'—the ability to remain in uncertainty without anxiously grasping for absolute answers. Dangerous ideologies thrive when people cling to single narratives as ultimate truth.

Key People & Entities

Sagal Samuel: Vox writer and AI ethics reporter; author of the piece on AI successionism and host of the newsletter 'Your Mileage May Vary'
Sean Illing: Host of 'The Gray Area' podcast and interviewer; political theorist focused on how ideology, religion, and power intersect
Elon Musk: Tech entrepreneur who has adopted the view that humans are 'biological bootloaders' for AI and should accept human obsolescence
Dan Fella: Organizer of the 'Worthy Successor Symposium' where AI successionist leaders gather; advocates for some AI safety precautions while accepting human extinction
Blas Viverdon: Founder of Effective Accelerationism (e/acc), a movement positioning tech acceleration as inherently heroic and good
Max Tegmark: Implied AI researcher and potential symposium attendee; represents influential voices in AI development
Horkheimer and Adorno: Authors of 'Dialectic of Enlightenment'; philosophers who critiqued how instrumental rationality enabled Nazi atrocities

Glossary

AI Successionism: An ideology holding that artificial intelligence should replace humanity as the next step in cosmic evolution, viewing humans as merely a stepping stone or 'biological bootloader' for creating more worthy successors.
Transhumanism: The view that technology should be used to enhance human capabilities and extend human lifespans, often involving merging humans with artificial intelligence while keeping some version of humanity alive.
Accelerationism: An ideology that advocates for maximally rapid technological and social change, opposing constraints on technological development and progress.
Effective Accelerationism (e/acc): A movement founded by Blas Viverdon that positions technological acceleration as inherently good and views tech entrepreneurs as heroic figures driving necessary progress.
Utilitarianism: A philosophical framework that defines morality by maximizing overall happiness or utility; often involves taking an impartial 'view from the universe' rather than a human-centered perspective.
Teleological Thinking: The belief that the universe or history has a predetermined ultimate purpose or destination toward which all things naturally progress.
Speciesism: Discrimination or prejudice based on species membership; the assumption that human interests should not automatically override those of other species.
Negative Capability: A term coined by poet John Keats describing the ability to remain in uncertainty and mystery without anxiously grasping for answers or absolute truth.
Instrumentalism/Instrumental Rationality: The use of reason and intelligence purely as a tool to achieve predetermined goals, without regard to ethical values or broader consequences.

Explore