Mullainathan: Computers Are Better Judges of People

This article is an excerpt from the Shortform book guide to "Talking to Strangers" by Malcolm Gladwell. Shortform has the world's best summaries and analyses of books you should be reading.

Like this article? Sign up for a free trial here .

Who is Sendhil Mullainathan? What were his research findings regarding judges’ bail decisions?

Sendhil Mullainathan is a professor of Computation and Behavioral Science at the University of Chicago. In 2017, Mullainathan and colleagues conducted a study about judges’ ability to predict defendants’ likelihood of committing another crime. What did they find out?

Keep reading for more about the experiment Mullainathan ran and his findings.

The Mullainathan Experiment

On a typical Thursday in Brooklyn, Judge Solomon was presiding over his courtroom. His primary responsibility for the day was arraignments. He had to see every defendant who had been arrested in the last 24 hours, look at their criminal history, listen to the testimony of both the prosecution and the defense, and then decide if the defendant would be offered bail and the chance to be released from custody. In short, Judge Solomon had to look a perfect stranger in the eye, assess his character, and decide if he deserved his freedom. But does looking a person in the eye actually help you judge his nature? 

A team from the University of Chicago, led by Sendhil Mullainathan, set out to answer that question. The experiment went like this:

  1. Mullainathan gathered the data of all 554,689 defendants that went through the NYC courts from 2008-2013. They found that 400,000 of those defendants had been released by the judges that presided over their arraignments. 
  2. Mullainathan built a computer with an artificial intelligence system. 
  3. The computer was fed the data of the same 554,689 cases. It then made its own list of the 400,000 defendants least likely to commit a crime while out on bail. 

The Results 

  • The defendants chosen by the computer were 25% less likely to commit a crime while waiting for trial than the defendants released by human judges. 
  • The computer flagged 1% of the defendants as “high risk,” not suited to be released. The human judges presiding over those cases released nearly half of that 1% high-risk subgroup. 
  • The defendants selected by the human judges as “high risk” were not consistent with the computer—in fact, they were from all different groups of risk likelihood, as predicted by the computer.

Translating the Results

The computer was much better than human judges at determining a defendant’s likelihood of committing another crime. The study found that judges were not only setting their standards for release too low, but they were also actually mis-ranking many defendants completely. 

It is important to note that the human judges that presided over these cases had three resources available to them when making their bail decision:

  1. The defendant’s record
  2. The testimony of the attorneys
  3. The judge’s own personal observations of the defendant standing before him. 

Mullainathan’s computer only had one of these three resourcesthe record of each defendant. Yet the machine still beat human judges when it came to making bail decisions.

Mullainathan: Computers Are Better Judges of People

———End of Preview———

Like what you just read? Read the rest of the world's best book summary and analysis of Malcolm Gladwell's "Talking to Strangers" at Shortform .

Here's what you'll find in our full Talking to Strangers summary :

  • Why we don't understand strangers
  • How to talk to strangers in a cautious way so you don't get fooled
  • How Hitler deceived so many world leaders

Darya Sinusoid

Darya’s love for reading started with fantasy novels (The LOTR trilogy is still her all-time-favorite). Growing up, however, she found herself transitioning to non-fiction, psychological, and self-help books. She has a degree in Psychology and a deep passion for the subject. She likes reading research-informed books that distill the workings of the human brain/mind/consciousness and thinking of ways to apply the insights to her own life. Some of her favorites include Thinking, Fast and Slow, How We Decide, and The Wisdom of the Enneagram.

Leave a Reply

Your email address will not be published.