In this episode of the Lex Fridman Podcast, Don Lincoln explores the history of unification in physics and the major unsolved mysteries that continue to puzzle scientists. Lincoln traces how physics has progressed from Newton's unification of terrestrial and celestial gravity through Maxwell's electromagnetic theory and Einstein's relativity to the modern Standard Model, which successfully unified three of the four fundamental forces but left gravity conspicuously separate.
The conversation addresses three profound mysteries confronting contemporary physics: dark matter, which constitutes most of the universe's mass yet remains invisible; dark energy, which drives the universe's accelerating expansion; and the matter-antimatter asymmetry that explains why our universe contains predominantly matter. Lincoln also discusses the role of particle accelerators in discovering new physics, the challenges of developing a theory of everything, and the competing approaches of string theory and loop quantum gravity in attempting to unify quantum mechanics with general relativity.

Sign up for Shortform to access the whole episode summary along with additional materials like counterarguments and context.
Physics has progressed through centuries of unifying seemingly disparate phenomena under common principles, from Newton's gravity to the modern Standard Model.
Before Newton, people believed terrestrial gravity—objects falling on Earth—and celestial motion were governed by separate laws. Isaac Newton's revolutionary insight was that the moon continuously "falls" toward Earth but misses due to its sideways velocity, thus orbiting. This realization united earthly and cosmic phenomena under one universal law of gravitation, showing that all matter follows the same principles.
In the early 1800s, electricity and magnetism appeared separate. James Clerk Maxwell's equations in the 1860s revealed they were intertwined aspects of electromagnetism. When physicists applied calculus to his equations, they discovered that oscillating electric and magnetic fields propagate as waves traveling at the speed of light—revealing light itself as an electromagnetic phenomenon. Electromagnetism now governs everything from atomic bonds to modern technology like the internet and broadcasting.
Albert Einstein challenged Newton's universal time, demonstrating that observers in motion experience time differently while the speed of light remains constant—a premise validated through particle physics experiments. This led to spacetime as a unified fabric. Einstein extended this insight by framing gravity not as a force but as mass curving spacetime itself. General relativity has been confirmed through numerous experiments, including the simultaneous detection of gravitational waves and light from merging neutron stars.
By the twentieth century, four fundamental forces were known: gravity, electromagnetism, the strong nuclear force, and the weak nuclear force. Sheldon Glashow, Abdus Salam, and Steven Weinberg showed that at high energies, electromagnetic and weak forces merge into the electroweak force. The puzzle of why weak force carriers have mass while photons don't was solved by the Higgs field—particles interacting with it gain mass. The 2012 discovery of the Higgs boson completed the Standard Model, but gravity remains separate, leaving the ultimate unified theory elusive.
Modern physics faces profound unsolved mysteries about the universe's composition and structure.
Dark matter constitutes five times more mass than ordinary matter yet remains invisible, revealing itself only through gravitational effects. Fritz Zwicky and later Vera Rubin found that galaxies spin too fast to be held together by visible matter alone. Three observations support dark matter: galaxies rotate too quickly, galaxy clusters move faster than visible mass allows, and gravitational lensing is stronger than expected. The Bullet Cluster provides compelling evidence—when two galaxy clusters collided, gravitational lensing showed most mass traveled with galaxies, not gas, suggesting gravitationally-interacting dark matter. The Dragonfly galaxies DF2 and DF4, which rotate normally without apparent dark matter, prove dark matter can be stripped from galaxies, confirming it as a distinct, removable substance.
Despite gravitational evidence, dark matter's nature remains unknown. The leading hypothesis is WIMPs (weakly interacting massive particles), searched for through direct detection, indirect detection via gamma rays, and collider experiments—all without definitive results. The possible mass range spans from far lighter than electrons to asteroid-sized objects, leaving dark matter one of physics' greatest unsolved challenges.
Dark energy, comprising 68% of the universe's energy, drives its accelerating expansion. Late 1990s supernova observations revealed the universe's expansion is speeding up, contradicting expectations of gravitational slowing. The prevailing model treats dark energy as constant energy density inherent to space itself—as the universe expands, total dark energy increases while matter density thins. Einstein originally introduced the cosmological constant for a static universe but abandoned it when Hubble discovered cosmic expansion; the 1998 acceleration discovery revived it as dark energy.
A major crisis arises because quantum field theory predicts vacuum energy 10^120 times larger than observed dark energy—physics' "worst prediction." Debate continues whether dark energy is a spacetime property, an unknown quantum field, or evidence that space itself is quantized. Though assumed constant, preliminary hints suggest dark energy density may change over time, potentially revealing new physics.
The Big Bang should have created equal amounts of matter and antimatter, yet the observable universe contains almost exclusively matter. For every billion antimatter particles, there were a billion and one matter particles; the pairs annihilated, leaving a tiny matter excess forming all stars and planets. The asymmetry mechanism remains unknown—either an initial universe condition or quantum process differences. Fermilab's leptogenesis hypothesis suggests neutrino oscillations differ between matter and antimatter, potentially explaining the imbalance, with current experiments measuring possible rate differences.
Particle accelerators create and analyze subatomic particles by converting collision energy into matter-antimatter pairs, following Einstein's E=mc². Don Lincoln describes how the Tevatron at Fermilab collided particles at 120 GeV, while the LHC operates at seven times higher energy with 100 times more collision events per second—making it roughly 700 times more productive. Higher energies create heavier particles, turning once-rare discoveries into routine observations.
The CMS detector at CERN weighs 14,000 tons and captures 40 million collision images per second. Trigger systems filter this down to 1,000 recorded events per second, identifying unusual signatures indicating potential new physics. Graduate students then analyze filtered data seeking rare theoretical signatures—finding a dozen viable candidates amid trillions of routine events can represent a Nobel Prize-worthy discovery.
The Higgs boson search exemplifies how accelerators validate theories. First predicted in 1964, both Fermilab and CERN searched for decades. Fermilab narrowed the possible mass to 120-145 GeV by closure, but the LHC's superior capabilities led to the July 4, 2012 discovery announcement. Years of further measurements confirmed the particle exhibited correct decay rates, zero spin, and validated the Standard Model's final piece.
The search for a theory of everything unifying all fundamental forces remains a major challenge, with gravity stubbornly resisting integration with quantum physics.
Grand Unified Theory aims to merge the electroweak and strong forces at energies 10^15 times higher than current accelerators, relying on indirect tests through rare particle decays. String theory proposes particles are tiny vibrating strings at the Planck length, with different vibrations yielding different particle types. Originally developed for the strong force, string theory gained prominence when it predicted massless spin-two particles corresponding to gravitons, offering potential gravity unification through extra compactified dimensions.
However, string theory faces a predictivity crisis with 10^500 possible solutions, making unique predictions difficult. Despite decades of development since the 1980s, it lacks confirmed experimental validation, leading many physicists to question the speculative approach.
Loop quantum gravity suggests space is discrete at the Planck scale rather than continuous, quantizing gravity without seeking force unification. Unlike string theory's comprehensive ambitions, LQG focuses exclusively on gravity's quantum nature. When gamma-ray bursts arrived simultaneously across frequencies, ruling out a key LQG prediction, theorists revised the theory—but it still lags behind in testable predictions at accessible energies.
A central barrier is the enormous energy gap: the Planck scale sits 10^15 times beyond today's accelerators. Don Lincoln uses an analogy—just as ancient humans in East Africa couldn't predict oceans or mountains from their surroundings, we may similarly misrepresent realities at untested energy extremes. Progress likely depends on discovering new physics at accessible scales, with dark matter and dark energy potentially offering crucial clues. Many pragmatic physicists now advocate exploring these near-term unknowns over theoretical extrapolations.
Ultimately, a theory of everything requires experimental confirmation to move from mathematical hypothesis to accepted science. History shows nature repeatedly surprises theorists at higher energies, underscoring the vital role of experiment. Falsifiability distinguishes science from philosophical speculation, presenting young researchers with a choice between speculative theoretical projects and experimentally tractable questions.
1-Page Summary
Physics has progressed through a centuries-long quest to show that the diverse phenomena in the universe are connected by unified principles. This history is marked by a succession of profound unifications, starting from gravity and culminating in the modern Standard Model of particle physics.
In the 1650s, people observed gravity as the force causing objects to fall on Earth, such as when someone trips. Separately, they observed the stars and planets moving across the night sky, a motion thought to be governed by different, “celestial” laws. Terrestrial gravity and celestial motion were believed to be unrelated phenomena.
Isaac Newton realized that these seemingly unrelated occurrences were aspects of a single phenomenon: gravity. He considered that the moon is "falling" toward Earth, but because of its sideways velocity, it continually misses, thus staying in orbit. Newton’s law of universal gravitation united the movement of heavenly bodies and everyday experiences of falling objects under one physical law.
By proposing that gravity governed both the heavens and the Earth, Newton showed that all matter—whether a falling apple or an orbiting planet—was ruled by the same principles. Gravity thereby connected human experience with the cosmic motions overhead.
In the early 1800s, electricity—with its sparks, shocks, and lightning—and magnetism, which involved the attraction between iron and magnets, appeared to be separate domains. Early scientists believed these forces had nothing in common.
Throughout the nineteenth century, experiments showed that electric currents could generate magnetic fields and vice versa. In the 1860s, James Clerk Maxwell synthesized these results into a set of mathematical equations—Maxwell’s equations—showing that electricity and magnetism are intertwined aspects of a single force: electromagnetism. The equations contain terms corresponding to electrical and magnetic phenomena, mathematically describing their mutual interplay.
By applying calculus to Maxwell’s equations, physicists discovered that oscillating electric and magnetic fields propagate as waves traveling at the speed of light. Thus, light itself emerged as an electromagnetic wave, uniting optics with electricity and magnetism.
Electromagnetism governs a vast range of phenomena, from household electricity and magnetism to the binding of atoms in chemistry. Its principles underpin much of today’s technology, such as the internet, radio, computers, and modern broadcasting. The understanding and control of electromagnetism transformed society, fueling a technological revolution.
Newtonian mechanics viewed time as universal, flowing at the same rate for everyone everywhere. Albert Einstein challenged this notion, demonstrating that different observers, moving at different velocities, can experience time differently.
Einstein based his special relativity on two premises: (1) the laws of nature are the same for all observers, and (2) everyone measures the speed of light to be the same, regardless of their motion. The second assumption, radical for its time, led directly to the strange and surprising consequences of special relativity.
The constancy of the speed of light has been experimentally confirmed, notably through particle physics experiments. When subatomic particles decay into photons—whether at rest or moving at near-light speed—the resulting light is always measured at the same universal speed. These precision experiments validate Einstein’s key assumption.
Einstein’s insights paved the way for a new conception: space and time are not separate, but unified as spacetime, which itself can bend and stretch. This foundational shift enabled later advances in understanding gravity.
Einstein realized that acceleration and gravity are equivalent in their effects. He extended the unification of special relativity by framing gravity not as a force but as the manifestation of mass curving spacetime.
In general relativity, spacetime is dynamic: it warps and bends in response to mass and energy. Massive bodies like Earth or the Sun create depressions in spacetime, and what we perceive as gravitational attraction is actually the motion of objects following curved paths through this warped geometry.
General relativity precisely describes these effects and has been validated by numerous experimental measurements—including the observation of gravitational waves from merging neutron stars. The simultaneous detection of light and gravitational waves fro ...
The History of Unification in Physics
Modern physics faces a set of profound, unsolved mysteries that shape our understanding of the universe. Central among these are the nature of dark matter, the enigma of dark energy, and the question of why the observable universe is dominated by matter rather than antimatter. Each mystery raises further questions about the very fabric of reality and exposes significant gaps in human knowledge.
Dark matter constitutes about five times more mass than ordinary matter in the universe, yet it remains invisible, undetectable by ordinary means, and only reveals itself through gravitational effects.
The story of dark matter begins with astronomical measurements that do not agree with predictions from Newtonian gravity or Einstein’s relativity. In the 1930s, Fritz Zwicky, and later in the 1970s, Vera Rubin investigated galaxy rotations. Rubin’s method used high school physics: calculating how fast stars should orbit based on observable matter. The result consistently showed that galaxies spin much too fast to be held together by visible matter alone. According to the laws of gravity, galaxies moving that quickly should fling themselves apart, but observationally, they remain intact. This discrepancy led to the proposal of dark matter—either the laws of gravity are incomplete, or there is much more mass present than can be seen.
Three main reasons support the need for a new component in the cosmic matter budget: galaxies spin too fast, galaxy clusters move more rapidly than the mass of visible matter would allow, and gravitational lensing (the bending of light by gravity) around massive structures is stronger than visible matter can explain. For instance, in clusters of galaxies, if dark matter were absent, hot gas clouds would have a specific gravitational signature. However, observations reveal distortions aligned with galaxies themselves, supporting the presence of additional mass.
The Bullet Cluster provides some of the most compelling evidence for dark matter. This cosmic collision of two galaxy clusters separates visible matter (mainly hot gas) from galaxies themselves. As they pass through each other, the gas clouds collide and stop, heating up in the process, while galaxies largely pass unaffected. Crucially, gravitational lensing shows that most of the cluster’s mass travels with the galaxies, not the gas, suggesting a form of matter interacts only gravitationally: dark matter. This observation counters modified gravity theories and favors dark matter’s actual existence.
Recent discoveries like the Dragonfly galaxies DF2 and DF4 further support dark matter’s reality. These galaxies rotate exactly as predicted by Newton’s laws, without the need to invoke extra gravity. Remarkably, they appear to be almost entirely free of dark matter. Their existence shows that dark matter can be stripped from galaxies, reinforcing the idea that dark matter is a distinct substance that can vary between galaxies. These cases undercut the hypothesis that the anomaly is solely due to modified gravity.
Despite abundant gravitational evidence, the nature of dark matter remains elusive. The leading hypothesis is that it consists of particles called WIMPs (weakly interacting massive particles). Scientists deploy three main search strategies:
Neutrinos, which are weakly interacting and have mass, do not fit the bill due to insufficient mass to account for dark matter’s effects.
Attempts to detect dark matter have systematically ruled out various candidates, including compact objects like black holes and rogue planets. The remaining possible mass range for dark matter is vast: from far lighter than electrons to as heavy as asteroids. Direct astronomical searches, such as microlensing—which seeks momentary brightening of distant stars by passing dark objects—set a lower sensitivity around a third of the Moon’s mass. For extremely light candidates, technological limits further constrain detection. Consequently, despite experiments growing millions of times more sensitive over recent decades, the true nature and mass of dark matter remain one of physics’ unsolved challenges.
Dark energy, accounting for roughly 68% of the energy in the universe, is the force driving its accelerating expansion, a result first revealed by the study of distant supernovae in the late 1990s.
Astronomers expected the universe’s expansion (from the Big Bang) to slow down over time due to gravitational attraction. However, supernova observations demonstrated that the expansion is not just continuing, but speeding up. This repulsive force defies gravitational expectations and is dubbed "dark energy."
The prevailing model assumes dark energy is the energy inherent to space itself—a constant density per unit volume. As the universe expands, more space means more total dark energy, whereas the density of ordinary and dark matter thins. This implies that as the universe grows, dark energy becomes ever more dominant.
Einstein originally introduced the cosmological constant to prevent his equations from predicting the universe would collapse, envisioning a static cosmos. When Hubble discovered the universe was expanding, Einstein dropped the constant. In 1998, evidence for accelerating cosmic expansion revived the cosmological constant as a central concept—now understood as dark energy.
A significant crisis in physics arises because quantum field theory predicts the vacuum energy density should be astronomically high—about 10¹²⁰ times larger than what is observed as dark energy. This vast mismatch, called the "worst prediction in physics," highlights a deep gap in understanding the relationship between quantum fields and gravity.
There is debate about whether dark energy is:
Current Major Mysteries in Physics
Particle accelerators are at the forefront of unraveling the universe’s deepest mysteries, enabling physicists to create, detect, and analyze subatomic particles. By colliding particles at immense energies, accelerators not only confirm long-standing theoretical predictions but also open doors to new discoveries.
Don Lincoln describes how accelerators work by smashing protons and antiprotons together at near light speed. According to Einstein’s equation (E=mc^2), the kinetic energy from these high-speed collisions is converted into mass, allowing the formation of both matter and antimatter particles based on the laws of physics.
When two particles hit each other head-on, their combined energy is concentrated into a tiny volume, creating new particles that always appear as a matter-antimatter pair to balance the “accounting” nature requires. For example, electrons and their antimatter counterparts, positrons, can be created if the collision energy meets the necessary threshold. Matter and antimatter can also annihilate, converting their mass back to energy.
The Tevatron at Fermilab operated by colliding protons and antiprotons at about 120 GeV. By contrast, the Large Hadron Collider (LHC) at CERN operates at approximately seven times higher energy and provides about 100 times more collision events per second. These advances mean the LHC probes deeper and creates particles the Tevatron could not.
More energy allows the production of heavier, less common particles. Higher collision rates exponentially increase the dataset, making particles like top quarks routine at the LHC, even though Fermilab needed up to a year to identify only a handful. In practical terms, the LHC is roughly 700 times more productive than the Tevatron, turning once-rare discoveries into common background as new searches continue.
Despite this efficiency, antimatter production is limited. While Fermilab was operational, about 100,000 protons needed to be smashed to produce a single antiproton. Over 12–24 hours, (10^{12}) antiprotons could be collected, but a gram of antimatter would require (10^{23}) antiprotons, so annual production was about one nanogram—the best in the world. At that rate, creating a macroscopic amount would take billions of years.
Huge detectors equipped with sophisticated electronics are required to observe, filter, and interpret the incredible number of events caused by beam collisions.
The CMS detector at CERN, one of the LHC’s two major detectors, is 70 feet long, 50 feet high, and weighs 14,000 tons. It operates at an extraordinary pace, effectively functioning as a high-speed camera taking 40 million snapshots per second to capture the traces left by the fleeting, often exotic particles birthed in collisions.
Given that most of these collisions simply replicate known physics and are “boring,” trigger systems are employed. Fast electronics first filter events down to about 100,000 per second, picking out those with telltale energy signatures. Processor farms further refine this to about 1,000 events per second that are recorded for analysis—only the most interesting, potentially novel interactions make the cut for further study.
The particle beams themselves are extremely thin—much thinner than spaghetti—and elongated. When two beams cross, they behave more like swarms of bees passing through each other, with only the occasional collision producing the fireworks detectors seek.
After recording, graduate students and physicists analyze the filtered data, looking for signatures of rare p ...
Particle Accelerators: Discovering Particles and Testing Theories
The search for a theory of everything (TOE)—a unified description of the fundamental forces of nature—remains one of physics’ greatest challenges. While advances have unified some forces, major obstacles—especially incorporating gravity with quantum physics—remain.
Physics identifies four fundamental subatomic forces: gravity, electromagnetism, the strong nuclear force, and the weak nuclear force. The electromagnetic and weak forces have been successfully unified into the electroweak force through electroweak symmetry breaking, representing a major milestone, but gravity remains fundamentally different and stubbornly resists unification.
Grand Unified Theory (GUT) aims to merge the electroweak force with the strong force into a single theory at extremely high energies—about 10^15 times greater than those available in current particle accelerators. This grand unification, if achieved, would be a significant step toward a universal framework. However, gravity’s integration into such a theory remains unresolved.
Because present technology cannot reach these extreme energies, physicists rely on indirect evidence, such as looking for rare particle decays or subtle deviations from standard model predictions at accessible energy scales. Despite this strategy, fast progress remains elusive, and direct confirmation is currently out of reach.
String theory proposes that all particles are tiny vibrating strings, whose different vibrational modes manifest as various particle types. These strings operate at the Planck length, far beyond reach of today’s experiments. While string theory originally targeted the strong force, it gained new relevance when it predicted massless spin-two particles—interpreted as gravitons—providing a potential mechanism to unify gravity with other forces.
Despite initial focus on the strong force (in competition with quantum chromodynamics, QCD), the recognition that string theory implied graviton-like particles elevated it to a candidate for unification, drawing intense excitement within the theoretical community.
String theory’s framework requires extra, compactified dimensions—beyond the familiar three spatial dimensions—which can help explain why gravity appears so weak compared to other forces.
However, string theory faces a predictivity crisis. The theory allows for a huge “landscape” of possible solutions (as many as 10^500 different universes), making it difficult to extract unique, testable predictions about our universe. Experimental measurements could, in principle, rule out most alternatives if suitable tests are devised, but this has not yet happened.
Despite decades of development and prominence since the 1980s, string theory remains a collection of approximate solutions to approximate equations, still lacking definitive experimental validation or unique, confirmed predictions. Many physicists now question how long to pursue such a speculative endeavor with no guarantee of fruition.
Loop quantum gravity (LQG) presents a contrasting approach to quantum gravity. Rather than seeking unification, it focuses on the quantization of space itself. Unlike Einstein’s general relativity, which treats space as a continuous fabric, LQG suggests space may be discrete at Planck-scale distances, similar to how matter is made of atoms.
Unlike string theory, LQG does not seek to explain the other three fundamental forces, focusing exclusively on gravity’s quantum nature. The comparison: string theory aspires to an all-encompassing TOE, while LQG is content with quantizing gravity alone.
Previously, LQG predicted that photons of different frequencies would travel at slightly different speeds—testable by the arrival times of gamma-ray bursts from far-off cosmic explosions. The observation that all wavelengths arrived simultaneously ruled out this prediction. In response, theorists revised LQG to remove this feature, keeping the theory alive but highlighting the need for continued adaptation as data improves.
Despite its conceptual clarity, LQG, like string theory, has failed so far to provide testable predictions at currently accessible energies. Its development is ongoing, but it remains disconnected from experimental confirmation.
A central barrier is the enormous energy gap: the Planck scale, relevant for quantum gravity, is about 10^15 times higher than energies attainable with today’s most powerful accelerators. Even the best experiments probe nowhere near the quantum gravity domain.
Theories of Everything and Challenges of Quantum Gravity
Download the Shortform Chrome extension for your browser
