PDF Summary:God, Human, Animal, Machine, by Meghan O'Gieblyn

The most urgent questions AI raises—about consciousness, immortality, free will, and the nature of the self—aren’t new. They’re the same ones religion has always asked. In God, Human, Animal, Machine, Meghan O’Gieblyn—a former fundamentalist Christian turned essayist—argues that Silicon Valley’s biggest promises are secretly theological: Modern transhumanism (merging humans and machines) is simply Christian end-times thinking with better optics.

This guide traces her argument about how humans function as meaning-making creatures and what we give up when we let machines answer the questions that have always been essentially ours to ask. Along the way, we place her argument in conversation with moral psychologists, historians of science, and critics of computer systems’ algorithmic power who approach the same questions O’Gieblyn grapples with by very different routes.

(continued)...

O’Gieblyn argues that problems routinely arise when we mistake metaphors for reality. By adopting the brain-as-computer metaphor as literal truth, we didn’t solve the mystery of consciousness; we just stopped asking difficult questions about it. We then built machines modeled on this limited view of the mind. As those machines grow more sophisticated, the questions we set aside—“What is consciousness?” “What makes something have a self?” “What is the difference between processing information and understanding it?”—come back with new urgency, dressed in the language of AI.

(Shortform note: The people who build our most powerful AI disagree on whether these systems are conscious, and science hasn’t settled the question. Early AI researchers thought the field needed to grapple with what it would mean for a machine to understand something. But this challenge wasn’t answered—it was outrun. Researchers discovered that training AI models on huge amounts of data produced such impressive results that the harder question was easy to set aside: If AI outputs look like human understanding, why does it matter whether anything inside the system really understands?)

The Questions That Won’t Stay Answered

The great questions that religion organized itself around—What survives death? What gives history its shape? What is the self that persists through change?—didn’t disappear when science displaced religion as the dominant framework for understanding the world. They migrated. They found new vocabulary, new institutional homes, and new scholars who often didn’t see themselves as working on the same problems their predecessors had. O’Gieblyn argues that technology is the current inheritor of these questions, not just filling the role religion once played, but running into the same limits religion ran into, and generating both the same kinds of promises and the same kinds of failures.

In this section, we’ll trace three places where this pattern shows up. First, O’Gieblyn shows that Silicon Valley’s most ambitious promises—digital immortality, mind uploading, the Singularity—are the old theological questions translated into engineering terms. Second, she shows that science itself, far from having escaped these questions, keeps encountering the human subject it tried to exclude. Finally, she traces a persistent human impulse to restore meaning and aliveness to the world, which keeps reappearing in unexpected places, no matter how many times we seem to have outgrown it.

Technology Has Inherited Religion’s Questions

O’Gieblyn realized that technology is the successor to religion after she left Christianity. The questions she’d always organized her life around—“What happens after death?” “What gives life meaning?” “Is history building toward something?”—suddenly had no satisfying answers. Then a coworker gave her a book by Ray Kurzweil, a futurist and a leading voice of the transhumanist movement. Kurzweil argued that the history of the universe is a story of information becoming more complex and intelligent. The endpoint of this trajectory, which he calls the Singularity, was projected to arrive around 2045: Machines would surpass humans in intelligence, we would merge with them, and our minds would be uploaded to computers, granting us immortality.

Why the Singularity Feels Like a Promise

The book O’Gieblyn read, The Age of Spiritual Machines, announces Kurzweil’s project in its title. For Kurzweil, the word “spiritual” has nothing to do with religion; it means something closer to the experience of being aware. He defines awareness as what happens when information processing reaches a certain level of complexity and self-organization. The argument runs like this: The brain is hardware, and your mind is the software that runs on it—not metaphorically, but literally. The brain’s neurons are pattern-recognition machinery, and what you experience as thoughts, memories, and personality is the particular configuration of patterns that machinery has learned to run.

If your mind is a pattern of information, then the hardware it runs on is incidental, in the same way that a piece of music isn’t the orchestra that plays it. If you transfer the score to a different ensemble, or to a digital system sophisticated enough to perform it, the music continues. Kurzweil argues that a sufficiently capable digital system could run the pattern that constitutes you, and the result would still be you. This is what makes Kurzweil’s Singularity” sound like a promise. For O’Gieblyn, who’d organized her life around the promise of surviving the dissolution of her body (and had recently lost the beliefs that made it credible), Kurzweil’s proposal had a familiar shape.

To O’Gieblyn, Kurzweil’s ideas felt like a revelation. The Singularity is like the Rapture (when believers will be resurrected for Jesus’s second coming): a moment when the limitations of human embodiment are transcended, history reaches its culmination, and a new existence begins. Mind uploading is a secular version of resurrection. The philosophical idea underlying it—patternism, the concept that identity is just a pattern of information—was first proposed by the third-century theologian Origen, who said a pattern called eidos persists through death, explaining how the soul survives. The vocabulary had changed, but the question—“What is the self that persists through death, and can it survive the dissolution of the body?”—had not.

(Shortform note: Mind uploading assumes that what makes you you is something discrete enough to be captured and moved: a configuration of memories, personality traits, and cognitive patterns that could run on a different system and still be you. But neuroscientists have posed a challenge to that premise. They argue that the sense of being a continuous self is something the brain constructs, moment to moment, not a fixed entity that can be lifted out and relocated. If true, this would mean that even if you capture a perfect map of every neural connection in a person’s brain, what you’ll have is a snapshot of a process that generates a self, not the self itself. Patternism promises to preserve the pattern, but the pattern might not be the self.)

Science Can’t Step Outside the Human Perspective

O’Gieblyn argues that science itself can’t escape the human point of view. In the 20th century, physicists encountered what would come to be called the observer problem: The observer can’t be removed from the equation. Classical physics assumed the natural world exists independently of anyone looking at it, but quantum mechanics (the study of matter on its smallest scale) overturned this assumption. Experiments show that particles exist in multiple states simultaneously until they’re measured, at which point they settle into a specific one. Observation seems not only to record reality, but to participate in producing it, blurring the line between consciousness and matter.

What connects the physicist’s observer problem, the philosopher’s hard problem of consciousness, and the transhumanist’s dream of mind-uploading is that each is a corner we’ve painted ourselves into by assuming that a complete, third-person description of reality (of matter, mind, or selfhood) is achievable. Each problem or paradox is where that description keeps leaving something out: the first-person fact of being inside an experience rather than outside it. Physicist Niels Bohr’s observation that physics tells us only what we can say about the world from inside it isn’t a confession of failure, but a description of the wall we keep running into.

(Shortform note: O’Gieblyn treats the lack of an outside perspective as a feature rather than a flaw, which feels less surprising if you step outside the Western worldview. In The Way of Zen, Alan Watts notes that Taoism and Zen Buddhism distinguish between conventional knowledge, which is represented in language and mathematical notation, and unconventional knowledge, which encounters the world directly. Indian Buddhist philosophy asserts that there’s a truth that fits within linguistic and conceptual labels and a truth that exceeds them. What these traditions recognize is that the map is not the territory. Every conceptual framework, however precise, is a representation of the world built from inside a specific vantage point, not a view from nowhere.)

The Question Physics Decided Not to Answer

In What Is Real? Adam Becker describes Bohr’s observation as a retreat. When quantum mechanics revealed that the act of observation changes the phenomenon being observed, physicists faced a crisis: The math described a strange reality, and no one knew what that strangeness meant. Bohr’s interpretation prevailed because it made the mystery easier to ignore: It said that physics can only predict measurement outcomes, not describe what occurs between measurements. That left behind a single, undefined variable, “measurement,” into which all the strangeness gets loaded. Nobody knows what accounts for the gap between the strange behavior of matter at its smallest scales and the predictable world we inhabit.

In his critique of the Bohr interpretation, physicist David Deutsch says the view that a scientific theory’s only job is to predict measurements is “bad philosophy.” He contends that what distinguishes humans from every other physical entity is our capacity to seek and understand explanations, to ask not just what happened but why. By declaring that question out of bounds, physics chose respectability over understanding. What O’Gieblyn traces is the cost of that bargain: The questions that get papered over don’t disappear. Eventually they show up, as they have in physics for a century, in every attempt to produce a complete, outside-view account of a phenomenon that keeps insisting on an inside.

We Never Abandon the Drive to Re-Enchant the World

Transhumanism—the belief that humans can use technology to transcend the limits of our biological form and potentially achieve immortality—is contemporary culture’s most visible attempt to reverse disenchantment and restore to the world a sense of purpose and intelligence. O’Gieblyn also sees this impulse in our enthusiasm for research on plant consciousness (the idea that forests use underground fungal networks to exchange nutrients and distress signals) and in our responses to machines that behave as though they have feelings, such as robots that seem responsive and present.

(Shortform note: Our memories, personalities, and experiences correspond to patterns of neural activity. We’ve previously discussed the conclusion transhumanists draw from this (that the pattern is the person), but neuroscientists tend not to endorse it. Antonio Damasio argues that the system that produces neural activity isn’t just a brain, but a brain in conversation with the rest of the body. David Eagleman shows that what we experience as a conscious self is a small fraction of what the brain does. Both findings suggest that what transhumanists would upload is only a thin slice of what constitutes “you.” This is where O’Gieblyn sees re-enchantment: in the space between what our observations show and what the promise requires us to believe.)

O’Gieblyn identifies a trap within our attempts at re-enchantment: Each move to expand the category of consciousness defines “mind” so broadly that it no longer captures what’s distinctive about human experience. The theory of emergence—the idea that complex, intelligent-seeming behavior can arise from simple components interacting—illustrates how this happens. The same framework that explains how minds and ecosystems develop their complexity gets extended to suggest that forests, machines, and server farms have some kind of inner experience too. In trying to dissolve the Cartesian divide, we stretch “consciousness” until it applies to almost everything.

The Wrong Words for the Right Mystery

Everything we can measure about a complex system—how it transfers signals, integrates information, and responds to its surroundings—tells us what the system does, not whether any of that activity is accompanied by experience. When that distinction gets lost, scientific findings on complexity are borrowed for the purpose of re-enchantment. Peter Wohlleben’s The Hidden Life of Trees is a case study: The science the book draws on establishes that forests are functionally complex. Wohlleben translates that complexity into the vocabulary of inner life (describing trees as capable of “cooperation,” “communication,” and “personality”) to demonstrate his point that forests are deserving of moral consideration.

But critics of plant consciousness research point out that a forest’s emergent behaviors—patterns of activity that arise from chemical and biological interactions—don’t require a consciousness to produce them. Reaching for human categories to describe these phenomena doesn’t expand our idea of consciousness so much as assume that whatever a forest’s inner life might be, it must feel like ours. An alternative possibility is that if forests have an inner life, it might be so foreign to human experience that our most familiar words for experience would be the wrong ones to describe what it’s like.

By undoing our disenchantment, we attempt to restore the sense that we’re not alone in a living world. But O’Gieblyn argues that saying everything is conscious in some minimal sense doesn’t restore the richness of inner life—it just redistributes the word. If “mind” encompasses forests and robots as readily as it encompasses humans, it can no longer identify what’s morally and experientially distinctive about us. We end up with just as impoverished a picture of human beings as is offered by the most reductive materialism; we just get there from the opposite direction.

(Shortform note: O’Gieblyn’s critique of re-enchantment echoes an argument Albert Camus made from a different starting point. In The Myth of Sisyphus, Camus confronts the same disenchanted world and concludes that every attempt to resolve its emptiness by reaching for a higher source of meaning—God, cosmic purpose, or a conscious universe—is a form of self-delusion that insists on an answer the world hasn’t actually provided. Rather than seeking that resolution, Camus argues for “permanent rebellion”: a commitment to living fully and presently without demanding that life mean something beyond itself.)

Answers Without Understanding

O’Gieblyn has shown that our attempts to replace one set of metaphors with another always keep us grappling with the same problems. But increasingly, the task of wrestling with these problems is being delegated to systems that don’t ask “why” at all—and for O’Gieblyn, something essential is lost in that transfer. Asking “why” isn’t a preliminary step toward meaning: It’s how meaning gets made in the first place. To ask “why” a decision is right, or “why” an outcome matters, is to be a person for whom the world has significance, not merely an object that events happen to.

This section examines what’s at stake: what we give up when we defer to systems that operate without human understanding, why that deference has troubling historical parallels, and why O’Gieblyn sees it as a threat to the human capacity for meaning itself.

We’re Giving Up the Need to Understand

As evidence that this delegation is already underway, O’Gieblyn cites a moment when abandoning the question of “why” was proposed not as a loss but as a liberation. In 2008, the editor of Wired magazine argued that sufficiently large datasets had made scientific reasoning obsolete. He suggested that once we could feed enough data into AI, making hypotheses about scientific principles would become unnecessary. Feed enough data into an algorithm, and it will arrive at insights no human mind can reach without anyone needing to understand how it got there or what explains the prediction. In this view, the only question worth asking is whether the prediction is accurate. The question of “why” no longer matters.

(Shortform note: Critics note a problem with the logic of the Wired article: You can’t collect data without already having decided what to measure, what counts as a meaningful result, and what question you’re trying to answer. Those choices encode a working theory of the phenomenon you’re studying before a single algorithm runs. So feeding large amounts of data into AI doesn’t eliminate human judgment; it just moves it upstream into the architecture of the system, where it becomes invisible and therefore more difficult to interrogate. In other words, data-driven methods of scientific inquiry depend entirely on the questions researchers bring to them—and the answers you get from the data are only as good as the questions you thought to ask.)

An example of abandoning the need to understand is the case of AlphaGo, the AI program that defeated the Go champion in 2016. What O’Gieblyn finds most striking was not that AlphaGo won, but how: It made a move that baffled expert observers, including the engineers who built it. No human player would have made that move, and no one could explain why it was correct. AlphaGo found a path to victory through reasoning that remained opaque to everyone else. Many observers celebrated this as evidence of AI’s superhuman capabilities, but O’Gieblyn sees something more troubling: We’ve built systems that make decisions no one can explain, and we’ve treated that opacity as a feature when we should be alarmed by it.

When the Algorithm Is the Argument

O’Gieblyn’s worry about AlphaGo’s inscrutability might feel abstract—after all, the stakes of a Go tournament, however high for the players, are self-contained. In Weapons of Math Destruction, Cathy O’Neil shows what the same dynamic looks like when the game being played is your credit score, your job application, or your prison sentence. O’Neil argues that the most dangerous algorithmic systems share three traits: They’re opaque, they don’t incorporate feedback, and they operate at massive scale. The opacity that felt thrilling in a Go match becomes something else entirely when it’s a criminal behavior scoring tool that a judge consults and a defendant can’t examine.

Worse, O’Neil shows that these systems go beyond reflecting existing biases to manufacture new evidence for them. When an algorithm flags someone as high-risk and judges them accordingly, the outcome gets recorded as confirmation that the flag was correct. In the specific case of racial bias, Ruha Benjamin, in Race After Technology, adds that racism in America has repeatedly changed in form—from explicit law, to race-neutral policy, to algorithmic code—with each iteration becoming harder to see and challenge than the last. Algorithmic opacity continues this pattern, producing discriminatory outcomes while providing institutions with a ready defense—“it’s just math.”

O’Gieblyn traces the cultural roots of our acceptance of algorithmic opacity to a central belief of Calvinist theology—predestination: the idea that God has already decided who will be saved and who will be damned, independent of their actions or virtue. God’s reasoning isn’t available to human understanding, and his decisions can’t be questioned or appealed. Like the Calvinists, we’ve now accepted the same unknowability from AI systems. What was once asked of believers in a sovereign God is now asked of users of sovereign algorithms: Trust the output, and don’t ask how it got there.

(Shortform note: In The Protestant Ethic and the Spirit of Capitalism, Max Weber shows that Calvin’s doctrine of predestination didn’t just hold that God’s decisions were unknowable, but that wanting to know was a failure of faith. Weber argues that the result was an “intense inner isolation.” Since no one could know who was saved and who was damned, no one could trust anyone else. The Enlightenment’s promise was to end that condition: to establish that decisions about people’s lives could and should be explained and challenged. But as we’ve adopted algorithms that issue verdicts without reasons, we’ve fallen back into the habit of treating the desire to understand them as naive rather than as a basic right.)

The Algorithm Against Human Decision-Making

The consequences of this deference to AI become visible when we allow it to make decisions about people’s lives in ways that confound our idea of free will. O’Gieblyn asks, if a system can predict your behavior, in what sense was that behavior freely chosen? For example, when an algorithm predicts that someone is likely to commit a crime, and that prediction triggers surveillance and police contact that makes a criminal record more likely, the prediction helps produce the outcome it claims to foresee. A person who might have chosen otherwise has had their choice constrained by a system’s prior judgment about them. The question of free will isn’t whether the algorithm was statistically accurate. It’s whether anyone was free to prove it wrong.

(Shortform note: O’Gieblyn’s argument here isn’t really about whether free will exists—a question that neuroscientist Robert Sapolsky, in Determined, answers with a firm “no.” Sapolsky argues that every decision we make is the inevitable product of genetics, experience, and circumstance. But even in a fully deterministic universe, Sapolsky insists that the appropriate response when we witness harmful behavior isn’t to shrug at its inevitability but to change the conditions that produced it. That requires being able to ask why something happened. This answerability is what opaque algorithms foreclose: They abolish the social practice by which decisions affecting people’s lives can be questioned by those people.)

O’Gieblyn argues that the problem isn’t only that these systems can be wrong. It’s that their opacity removes the human face from decisions with human consequences. When an institution can attribute a choice to an algorithm, it presents itself as neutral and data-driven, even when the underlying data encodes decades of structural inequality. But this appearance of objectivity can become a shield against accountability only because we built machines in our image, then forgot we built them. These systems don’t transcend human bias. The bias just becomes impossible to see and challenge, perpetuated by a machine that has no understanding at all.

(Shortform note: O’Gieblyn’s argument implies that the solution to opacity is visibility: If we could just see inside the black box, we could challenge what’s in it. Hannah Fry, in Hello World, complicates this by examining predictive policing tools. She agrees that such tools risk entrenching bias, particularly when they’re trained on historical data that reflects decades of unequal treatment. But she also notes that human judges, making the same decisions without algorithmic assistance, are themselves strikingly inconsistent. The problem isn’t simply that the algorithm is opaque; it’s that transparency alone doesn’t guarantee accountability—an institution can make its criteria visible and still evade responsibility for the outcome.)

How to Reclaim Meaning in the Age of AI

Meaning is what we produce in the act of asking “why.” It’s not a conclusion that can be generated from data, and the task of defining what a good life requires, what justice looks like, or what we owe each other can’t be reduced to algorithmic outputs without something essential being lost. To outsource the question to AI isn’t to find meaning more efficiently, but to lose the capacity for it. What O’Gieblyn defends isn’t religion, or any particular metaphor, but the human act of making meaning. Her argument isn’t that the machines are wrong, but that being right is not enough. We are creatures for whom the world must mean something. Machines don’t share that need, and that’s why we can’t let them answer our questions for us.

(Shortform note: Research in psychology supports O’Gieblyn’s argument that the meaning of a decision emerges from our deliberation over a question. In The Righteous Mind, Jonathan Haidt explains that moral judgment is intuitive and embodied, and it precedes the conscious reasoning we do to justify the judgments we’ve made. These moral intuitions are shaped by relationships and community: We develop our moral sense through social experience, which means that what O’Gieblyn is defending isn’t just a preference for human deliberation over algorithmic efficiency. It’s a recognition that moral meaning is produced through a relational process that an algorithm doesn’t perform a faster version of. It performs no version of that process at all.)

The alternative O’Gieblyn offers comes from a novel by Fyodor Dostoevsky. In The Brothers Karamazov, Ivan Karamazov presents his brother with an argument: If God exists but permits the suffering of children, his moral reasoning must be so alien to human intuition that belief in him is untenable. Ivan doesn’t deny that such a God might exist. He accepts the argument, but refuses to consent to a universe governed on those terms. O’Gieblyn sees Ivan’s refusal as a model: You can insist that a reasoning process that can’t be challenged or explained isn’t one you’re obliged to accept—that “why” a decision was reached still matters, even when a system can produce the decision without anyone understanding how.

(Shortform note: Ursula K. Le Guin drew on this same passage of The Brothers Karamazov when she wrote “The Ones Who Walk Away from Omelas,” a story in which citizens of a utopian city discover that its prosperity depends on the perpetual suffering of a single child kept in darkness. Most citizens, upon learning this, find a way to live with it. Some simply leave, and Le Guin doesn’t tell us where they go. Her point is that the refusal itself—the unwillingness to accept a good outcome whose terms you cannot inspect or contest—is a form of moral integrity. Asking “why” is the mechanism by which people remain answerable to each other, and losing it to an algorithm or a sovereign God amounts to the same thing.)