Ray Kurzweil argues that the brain creates the mind by way of hierarchical pattern recognition. He identifies four key features that make the human pattern recognition system so powerful. Together, they explain everything from why blind people can process language in their visual cortex to how we develop sophisticated moral reasoning.
Keep reading to learn about these features and how they work together to do something truly remarkable.
Table of Contents
Pattern Recognition in Humans
In How to Create a Mind, Ray Kurzweil posits that the mind emerges from hierarchical pattern recognition in the neocortex. Kurzweil lays out four features that make the pattern recognition system in humans so effective: plasticity, integration with motivational systems, specialized structures for complex emotions, and continuous learning. Using these four features, the brain creates the full spectrum of human cognitive abilities through simple, repeated pattern recognition structures.
Feature #1: Plasticity
One of the most compelling pieces of evidence for Kurzweil’s theory comes from the brain’s plasticity—its ability to reorganize and adapt. According to Kurzweil, because all regions of the neocortex use the same pattern recognition algorithm, different areas can substitute for each other when necessary. This flexibility manifests in dramatic ways: People born blind can use their visual cortex for language processing. Stroke victims can sometimes recover lost functions by having other brain regions take over the work of damaged areas. Children who have an entire brain hemisphere removed can still develop normal intelligence, with the remaining hemisphere handling functions typically spread across both sides.
Kurzweil argues that the ability of one brain region to substitute for another would be impossible if different regions used fundamentally different processing methods. The fact that a brain area “designed” for vision can successfully handle language suggests that both vision and language rely on the same underlying pattern recognition principles.
Feature #2: Integration With Ancient Motivational Systems
Kurzweil explains that, while the neocortex handles sophisticated pattern recognition, it doesn’t operate in isolation. Instead, it works with much older brain structures that generate our basic drives and emotions. These ancient brain regions—including the amygdala (which triggers fear responses), the nucleus accumbens (which creates pleasure sensations), and other parts of the limbic system—create the motivations that kept our ancestors alive: seeking food, avoiding predators, finding mates, and protecting territory. But, according to Kurzweil, the neocortex doesn’t replace the drives generated by older brain regions; it simply redirects them.
The old brain generates basic motivations through pleasure and fear responses, while the neocortex develops strategies to fulfill those drives. For instance, your drive to avoid danger might manifest as working diligently to impress your boss (keeping your job safe). The hunting instinct could be redirected into writing a book or competing in sports (channeling the drive to pursue and capture into achievement). The partnership between the neocortex and older parts of the brain explains why our behavior has both rational and emotional components.
Feature #3: Specialized Structures for Complex Human Emotions
Kurzweil also points to specialized brain structures that enable uniquely human capabilities. He highlights spindle neurons—specialized brain cells with extensive connections spanning the entire brain—as crucial for processing complex emotions like love, moral judgment, and aesthetic appreciation. Humans have approximately 80,000 of these cells, while great apes have far fewer, and other mammals lack them entirely.
These neurons become active during intense emotional experiences, such as looking at a romantic partner or hearing your child cry. Their extensive connectivity allows higher-level emotions to integrate information from diverse brain regions, though they don’t engage in rational problem-solving—which explains why you can’t consciously control experiences like falling in love or your emotional responses to music. Human infants develop spindle neurons between four months and three years of age, coinciding with the emerging capacity for moral reasoning and emotional understanding. According to Kurzweil, this timing suggests that our most sophisticated emotional and moral capabilities depend on pattern recognition.
Feature #4: Continuous Learning Throughout Life
Kurzweil explains that, unlike other brain regions that are largely pre-programmed via genetics, the neocortex starts nearly empty and learns continuously throughout life. The neocortex begins learning during fetal development and continues building hierarchical patterns through constant interaction with the environment. When a baby sees circular shapes—wheels, balls, plates, faces—pattern recognizers gradually learn to identify “circularity” as a recurring feature. As the child encounters more complex patterns, higher-level recognizers learn to combine basic features into sophisticated concepts like fairness, beauty, or humor.
Crucially, Kurzweil contends that learning and recognition happen simultaneously. As soon as a pattern recognizer learns to identify a particular pattern, it immediately begins contributing to the recognition of that pattern in new situations. This allows the neocortex to continuously refine and update its understanding of the world based on new experiences.
| How Babies Learn to Recognize Faces Learning might be messier than Kurzweil’s neat progression suggests. Research on how infants develop face recognition shows that initially, newborns aren’t specifically attracted to faces but to any pattern that has more visual elements in the upper portion. So, babies first learn to prefer “top-heavy” visual patterns. Then, through repeated exposure to faces over several months, they learn what makes faces special and different from other top-heavy patterns. Only after this can they learn to recognize individual people, complicating Kurzweil’s idea that pattern recognizers immediately start learning the specific patterns they’re supposed to recognize as soon as they’re exposed to those patterns. The process of hierarchical learning also works less linearly than Kurzweil describes. While infants progress from basic to complex recognition, they lose abilities along the way through “perceptual narrowing.” Initially, newborns can process faces from any ethnic group equally well, but by three months, they become better at recognizing faces from their own ethnic group. This timeline also contradicts the idea of simultaneous learning and recognition: Learning to recognize faces takes many months, and even brain regions that researchers think might be specialized for face recognition still require extensive learning periods first. |
Exercise: Recognize Your Brain’s Pattern Recognition at Work
Kurzweil argues that all human thinking—from basic perception to complex creativity—emerges from hierarchical pattern recognition. By becoming aware of how your mind processes patterns, you can better understand both human intelligence and the potential for artificial minds.
- Think of a recent moment when you had a creative insight or “Aha!” moment. (For example, maybe you realized that a communication problem with a difficult coworker was similar to disagreements with your teenager at home, leading you to try a different approach at work.) Describe what happened and try to identify the different patterns your mind connected. What lower-level patterns (facts, experiences, concepts) combined to create your higher-level realization?
- Consider a skill you’ve mastered (driving, cooking, playing an instrument, and so on). How has your pattern recognition changed as you’ve become more expert? What patterns do you now recognize automatically that once required conscious effort?
- Think about the digital technologies you use regularly—search engines, navigation apps, recommendation systems, or voice assistants. How might these tools already be enhancing your pattern recognition abilities? What patterns do they help you identify that you might miss on your own?
Explore Pattern Recognition Further
In his book, Kurzweil not only explains how the human brain implements its pattern recognition system, but he also predicts that computer systems will eventually achieve human-level pattern recognition. Learn more in our guide to How to Create a Mind.
