{"id":113945,"date":"2023-09-28T10:24:00","date_gmt":"2023-09-28T14:24:00","guid":{"rendered":"https:\/\/www.shortform.com\/blog\/?p=113945"},"modified":"2023-09-28T15:54:15","modified_gmt":"2023-09-28T19:54:15","slug":"life-3-0-book","status":"publish","type":"post","link":"https:\/\/www.shortform.com\/blog\/life-3-0-book\/","title":{"rendered":"Life 3.0: Book Overview and Takeaways (Max Tegmark)"},"content":{"rendered":"\n

What’s Life 3.0<\/em> by Max Tegmark about? Will artificial intelligence become smarter than humans?<\/p>\n\n\n\n

Life on Earth has drastically transformed since it first began. As Max Tegmark says in his book Life 3.0<\/em>, humans have built a civilization so complex that it would be utterly incomprehensible to the lifeforms that came before us.<\/p>\n\n\n\n

Read below for a brief Life 3.0<\/em> book overview to understand why Tegmark thinks artificial intelligence is the next revolutionary change.<\/p>\n\n\n\n\n\n\n\n

Life 3.0<\/em> by Max Tegmark<\/strong><\/h2>\n\n\n\n

Judging by recent technological strides, author Max Tegmark believes that an equally revolutionary change is underway. If an amoeba is \u201cLife 1.0,\u201d and humans are \u201cLife 2.0,\u201d Tegmark contends that an artificial superintelligence<\/a> could become \u201cLife 3.0.\u201d<\/strong> A power like this could either save or destroy humanity, and Tegmark argues that it\u2019s our responsibility to do everything we can to ensure a positive outcome\u2014before it\u2019s too late.<\/p>\n\n\n\n

Tegmark is a physics professor at MIT and president of the Future of Life Institute<\/a>, a nonprofit dedicated to using technology to avert threats to humanity<\/a> on a global scale. He wrote the Life 3.0<\/em><\/a> book in 2017 to popularize urgent AI-related issues and increase the chance that humanity will successfully use AI to create a better future.<\/p>\n\n\n\n

The Situation: Artificial Superintelligence Might Appear Soon<\/strong><\/h3>\n\n\n\n

Tegmark defines intelligence as the capacity to successfully achieve complex goals. Thus, an \u201cartificial superintelligence\u201d is a computer sophisticated enough to understand and accomplish goals far more capably than today\u2019s humans.<\/strong> For example, a computer that could manage an entire factory at once\u2014designing, manufacturing, and shipping out new products all on its own\u2014would be an artificial superintelligence. By definition, a superintelligent computer would have the power to do things that humans currently can\u2019t; thus, it\u2019s likely that its invention would drastically change the world<\/a>. <\/p>\n\n\n\n

Tegmark asserts that if we ever invent artificial superintelligence, it will probably occur after we\u2019ve already created \u201cartificial general intelligence\u201d (AGI<\/a>). This term refers to an AI that can accomplish any<\/em> task with at least human-level proficiency\u2014including the task of designing more advanced AI<\/em>.<\/p>\n\n\n\n

Experts disagree regarding how likely it is that computers will reach human-level general intelligence. Some dismiss it as an impossibility, while others only disagree on when<\/em> it will probably occur. According to a survey Tegmark conducted at a 2015 conference, the average AI expert is 50% certain that we\u2019ll develop AGI by 2055.<\/p>\n\n\n\n

AGI is important because, in theory, a computer that can redesign itself to be more intelligent can use that new intelligence to redesign itself more quickly<\/em>. AI experts call this hypothetical accelerating cycle of self-improvement an intelligence explosion<\/em>. If an intelligence explosion were to happen, the most sophisticated computer on the planet could advance from mildly useful AGI to world-transforming superintelligence in a remarkably short time<\/strong>\u2014perhaps just a few days or hours.<\/strong><\/p>\n\n\n\n

Evidence That Artificial Superintelligence Is Possible<\/strong><\/h4>\n\n\n\n

The idea that we could build a computer that\u2019s smarter than us may seem far-fetched, but some evidence indicates that such technology is on its way, according to Tegmark.<\/p>\n\n\n\n

First, the artificial intelligence we\u2019ve created so far is functioning more and more like AGI. Researchers have developed a new way to design sophisticated AI called deep reinforcement learning<\/em>. Essentially, they\u2019ve created computers that can repeatedly modify themselves in an effort to accomplish a certain goal. This means that machines can now use the same process<\/em> to learn different<\/em> skills<\/strong>\u2014a necessary component of AGI. Currently, there are many human skills<\/a> that developers can\u2019t teach to computers using deep reinforcement learning, but that list is becoming shorter.<\/p>\n\n\n\n

Second, Tegmark asserts that given everything we know about the universe, there\u2019s no obvious reason to believe that artificial superintelligence is impossible.<\/strong> Although it may seem like our brains possess unique creative powers, they store and process information in much the same way that computers do. The information in our heads is a biological pattern rather than a digital one, but the information itself is the same no matter what material it\u2019s encoded with. In theory, computers can do everything our brains can do.<\/p>\n\n\n\n

Tegmark concedes that AGI and artificial superintelligence might still be a pipe dream, impossible to create for some reason we don\u2019t yet see. However, he contends that if there\u2019s even a small chance that an artificial superintelligence will exist in the near future, it\u2019s our responsibility to do anything in our power to ensure that it has a positive impact on humanity. This is because artificial superintelligence has the power to completely transform the world\u2014or end it\u2014as we\u2019ll see next.<\/p>\n\n\n\n

The Possibilities: How Could Artificial Superintelligence Change the World?<\/strong><\/h3>\n\n\n\n

So far, we\u2019ve explained that an artificial superintelligence is a technology that would greatly surpass human capabilities, and we\u2019ve argued why it\u2019s possible that artificial superintelligence might someday exist. Now, let\u2019s discuss what this means for us humans.<\/p>\n\n\n\n

We\u2019ll explain why a superintelligence\u2019s \u201cgoal\u201d is the primary factor that will determine how it will change the world. Then, we\u2019ll explore how much power such a superintelligence would have. Finally, we\u2019ll discuss what might happen to humanity after a powerful superintelligence enters the world, investigating three optimistic scenarios followed by three pessimistic ones.<\/p>\n\n\n\n

The Outcome Depends on the Superintelligence\u2019s Goal<\/strong><\/h4>\n\n\n\n

Tegmark asserts that if an artificial superintelligence comes into being, the fate of the human race depends on what that superintelligence sets as its goal.<\/strong> For instance, if a superintelligence pursues the goal of maximizing<\/a> human happiness, it could create a utopia for us. If, on the other hand, it sets the goal of maximizing its intelligence, it could kill humanity in its efforts to convert all matter in the universe into computer processors.<\/p>\n\n\n\n

It may sound like science fiction to say that an advanced computer program would \u201chave a goal,\u201d but this is less fantastical than it seems. An intelligent entity doesn\u2019t need to have feelings or consciousness to have a goal; for instance, we could say an escalator has the \u201cgoal\u201d of lifting people from one floor to another. In a sense, all machines have goals.<\/p>\n\n\n\n

One major problem is that the creators of an artificial superintelligence wouldn\u2019t necessarily have continuous control over its goal and actions,<\/strong> argues Tegmark. An artificial superintelligence, by definition, would be able to solve its goal more capably than humans can solve theirs. This means that if a human team\u2019s goal was to halt or change an artificial superintelligence\u2019s current goal, the AI could outmaneuver them and become uncontrollable.<\/p>\n\n\n\n

For example: Imagine you program an AI to improve its design and make itself more intelligent. Once it reaches a certain level of intelligence, it could predict that you would shut it off to avoid losing control over it as it grows. The AI would realize that this would prevent it from accomplishing its goal of further improving itself, so it would do whatever it could to avoid being shut off\u2014for instance, by pretending to be less intelligent than it really is. This AI wouldn\u2019t be malfunctioning or \u201cturning evil\u201d by escaping your control; on the contrary, it would be pursuing the goal you gave it to the best of its ability.<\/p>\n\n\n\n

The Possible Extent of AI Power<\/strong><\/h4>\n\n\n\n

Why would an artificial superintelligence\u2019s goal have such a dramatic impact on humanity? An artificial superintelligence would use all the power at its disposal to accomplish its goal. This is dangerous because such a superintelligence could theoretically gain an unimaginable amount of power<\/strong>\u2014enough to completely transform our society with a negligible amount of effort.<\/p>\n\n\n\n

According to Tegmark, although an artificial superintelligence is a digital program, it could easily exert power in the real world. For instance, it could make money selling digital goods such as software applications, then use those funds to bribe humans into unknowingly working for it (perhaps posing as a human hiring manager on digital job listing platforms). An AI controlling a Fortune 500-sized human task force could do almost anything\u2014including creating robots that the AI could control directly.<\/p>\n\n\n\n

Tegmark asserts that, in theory, an artificial superintelligence could eventually attain godlike power over the universe. By using its intelligence to create increasingly advanced technology<\/a>, an AI could eventually create machines able to rearrange the fundamental particles of matter\u2014turning anything into anything else\u2014as well as generate nearly unlimited energy to power those machines.<\/p>\n\n\n\n

Optimistic Possibilities for Humanity<\/strong><\/h4>\n\n\n\n

What might happen to humanity if an artificial superintelligence wields nearly unlimited power over the world in service of a single goal? Tegmark describes a number of possible outcomes, each of which results in a wildly different way of life for humans\u2014or the end of human life.<\/p>\n\n\n\n

Let\u2019s begin by discussing three scenarios in which the AI\u2019s goal, whatever it may be, allows humans to live relatively happy lives.<\/p>\n\n\n\n

Possibility #1: Friendly AI Takes Over<\/h5>\n\n\n\n

First, Tegmark imagines that an artificial superintelligence could overthrow existing human power structures and use its vast intelligence to create the best possible world for humanity. No one could challenge the AI\u2019s ultimate authority, but few people would want to,<\/strong> since they have everything they need to live a fulfilling life<\/a>.<\/p>\n\n\n\n

Tegmark clarifies that this isn\u2019t a world designed to maximize human pleasure<\/strong>, which would mean continuously injecting every human with some kind of pleasure-inducing chemical. Rather, this is a world in which humans are free to continuously choose the kind of life they want to live from a diverse set of options. For instance, one human could choose to live in a non-stop party, while another could decide to live in a Buddhist monastery where rowdy, impious behavior wouldn\u2019t be allowed. No matter who you are<\/a> or what you want, there would be a \u201cparadise\u201d available for you to live in, and you could move to a new one at any time.<\/p>\n\n\n\n

Possibility #2: Friendly AI Stays Hidden<\/h5>\n\n\n\n

Tegmark supposes another positive scenario that\u2019s a bit different: Instead of completely taking over the world, an artificial superintelligence does everything within its power to improve human lives while <\/strong>keeping its existence a secret<\/em><\/strong>.<\/strong><\/p>\n\n\n\n

This could happen if the artificial superintelligence\u2014or someone influencing its goals\u2014concluded that to be as happy and fulfilled as possible, humans need to feel in control of their destiny. Arguably, if you knew that an all-powerful computer could give you anything you wanted (as in the previous optimistic scenario), you might still feel like your life is meaningless and be less satisfied because you don\u2019t have control<\/em> over your life. In this case, the best thing a godlike AI could do for you is help without your knowledge.<\/p>\n\n\n\n

Possibility #3: AI Protects Humanity From AI <\/h5>\n\n\n\n

Third, Tegmark imagines a scenario in which humans create an artificial superintelligence with the sole purpose of preventing other superintelligences from coming into existence.<\/strong> This allows humans to continue developing more advanced technology without worrying about the potential dangers of another AI.<\/p>\n\n\n\n

According to Tegmark, the advanced technology humans could develop in a world free from superintelligence would eventually allow us to create a bountiful classless society. Robots are able to build anything humans might want, making scarcity a thing of the past. Since robots are constantly generating surplus wealth, the government can give everyone a universal basic income<\/a> (UBI) that\u2019s high enough to purchase anything they could possibly need. People are free to work for more money, but finding a productive job is near-impossible since everything people might buy is already given to them for free.<\/p>\n\n\n\n

Pessimistic Possibilities for Humanity<\/strong><\/h4>\n\n\n\n

Next, let\u2019s take a look at some of the existential dangers that an artificial superintelligence poses. Here are three scenarios in which the AI\u2019s goal ruins humans\u2019 chances to live a satisfying life.<\/p>\n\n\n\n

Possibility #1: AI Kills All Humans<\/h5>\n\n\n\n

Tegmark contends that an artificial superintelligence may end up killing all humans in service of some other goal.<\/strong> If it doesn\u2019t value human life, it could feasibly end humanity just for simplicity\u2019s sake\u2014to reduce the chance that we\u2019ll do something to interfere with its mission.<\/p>\n\n\n\n

If an artificial superintelligence decided to drive us extinct, Tegmark predicts that it would do so by some means we currently aren\u2019t aware of (or can\u2019t understand). Just as humans could easily choose to hunt an animal to extinction with weapons the animal wouldn\u2019t be able to understand, an artificial intelligence that\u2019s proportionally smarter than us could do the same.<\/p>\n\n\n\n

Possibility #2: AI Cages Humanity<\/h5>\n\n\n\n

Another possibility is that an artificial intelligence chooses to keep humans alive, but it doesn\u2019t put in the effort to create a utopia for us.<\/strong> Tegmark argues that an all-powerful superintelligence might decide to keep us alive out of casual curiosity. In this case, an indifferent superintelligence would likely create a relatively unfulfilling cage in which we\u2019re kept alive but feel trapped.<\/p>\n\n\n\n

Possibility #3: Humans Abuse AI<\/h5>\n\n\n\n

Finally, Tegmark imagines a future in which humans gain total control over an artificial superintelligence and use it for selfish ends.<\/strong> Theoretically, someone could use such a machine to become a dictator and oppress or abuse all of humanity.<\/p>\n\n\n\n

What Should We Do Now?<\/strong><\/h3>\n\n\n\n

We\u2019ve covered a range of possible outcomes of artificial superintelligence, from salvation to disaster. However, all these scenarios are merely theoretical\u2014let\u2019s now discuss some of the obstacles we can address today to help create a better future.<\/p>\n\n\n\n

We\u2019ll first briefly disregard the idea of superintelligence and discuss some of the less speculative AI-related issues society needs to overcome in the near future. Then, we\u2019ll conclude with some final thoughts on what we can do to improve the odds that the creation of superintelligence will have a positive outcome.<\/p>\n\n\n\n

Short-Term Concerns<\/strong><\/h4>\n\n\n\n

The rise of an artificial superintelligence isn\u2019t the only thing we have to worry about. According to Tegmark, it\u2019s likely that rapid AI advancements will create numerous challenges that we as a society need to manage. Let\u2019s discuss:<\/p>\n\n\n\n