{"id":117928,"date":"2023-11-17T13:55:00","date_gmt":"2023-11-17T17:55:00","guid":{"rendered":"https:\/\/www.shortform.com\/blog\/?p=117928"},"modified":"2023-11-22T10:59:48","modified_gmt":"2023-11-22T14:59:48","slug":"lies-in-science","status":"publish","type":"post","link":"https:\/\/www.shortform.com\/blog\/lies-in-science\/","title":{"rendered":"Lies in Science: How a Focus on P-Values Leads to Bullshit"},"content":{"rendered":"\n<p>Is the institution of science immune from misinformation? How can there be lies in science when practitioners are committed to the scientific method?<\/p>\n\n\n\n<p>In <em>Calling Bullshit<\/em>, Carl T. Bergstrom and Jevin D. West argue that science\u2019s focus on statistical significance gives rise to bullshit for two reasons: we can easily misinterpret what statistical significance means, and we\u2019re exposed to statistically significant findings only because of <a href=\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research-2\/\">publication bias<\/a>.<\/p>\n\n\n\n<p>Let&#8217;s take a close look at both of these problematic dynamics in science.<\/p>\n\n\n\n<!--more-->\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-lies-in-science\">Lies in Science<\/h2>\n\n\n\n<p>We don&#8217;t like to think that lies in science exist. But, Bergstrom and West discuss how this can happen when scientists mishandle statistical significance. They explain that a <em>statistically significant finding<\/em> is one with a certain <em>p-value<\/em>\u2014a statistical measure of how likely it is that a study\u2019s result happened by pure chance.<\/p>\n\n\n\n<p>For example, imagine you wanted to see if there was a relationship between smoking cigarettes daily and getting lung cancer. You could perform a statistical analysis comparing the rates of people with lung cancer who did, and did not, smoke cigarettes daily. If you found a positive correlation between smoking and cancer and the resulting p-value of that correlation was less than 0.05, scientists would normally consider that a <em>statistically significant result<\/em>\u2014one that is unlikely to occur from chance alone. If your analysis yielded a p-value of 0.01, that would mean there would be a 1% chance of it occurring if there <em>weren\u2019t<\/em> a correlation between smoking and cancer.&nbsp;<\/p>\n\n\n\n<p>(Shortform note: Without going too deep into the underlying mathematics, p-values are normally calculated via <a href=\"https:\/\/www.investopedia.com\/terms\/p\/p-value.asp#toc-example-of-p-value\" target=\"_blank\" rel=\"noreferrer noopener\">integral calculus on a probability distribution of all possible values<\/a>, such that the p-value is identical to the percentage of the probability distribution\u2019s area that is equal to, or more significant than, the value that you\u2019re testing. For example, if your study between smoking and cancer established a positive correlation of 0.8, and only, say, 1% of correlations on a random distribution are 0.8 or greater, then your p-value would be equal to 0.01.)<\/p>\n\n\n\n<p>However, Bergstrom and West point out that many people misinterpret the p-value, taking it to be the likelihood that there\u2019s no correlation between the variables tested, which leads to bullshit when they overstate the results of statistical analyses. For example, just by sheer chance, it\u2019s possible that if we flipped two coins 100 times, they would land on the same side 60 times, <a href=\"https:\/\/www.fourmilab.ch\/rpkp\/experiments\/statistics.html#:~:text=The%20probability%20of%2060%20correct,better%2C%20purely%20due%20to%20chance.\" target=\"_blank\" rel=\"noreferrer noopener\">yielding a p-value of around 0.03<\/a> (in other words, there\u2019s about a 3% chance of getting this result by pure luck). But we would be mistaken to conclude that the likelihood the two coins are connected is 0.97 because we know that barring any funny business, two simultaneous coin flips are independent events. So, we would instead be justified in concluding that the low p-value was a statistical anomaly.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>The Consequences of Misrepresented P-Values<\/strong><br><br>The misinterpretation of p-values can have dire consequences in the courtroom, as seen in the 1998 trial of Sally Clark, <a href=\"https:\/\/forensicstats.org\/blog\/2018\/02\/16\/misuse-statistics-courtroom-sally-clark-case\/\" target=\"_blank\" rel=\"noreferrer noopener\">a mother accused of double homicide<\/a> after her first child died with no apparent cause at 11 weeks of age and her second died without cause at eight weeks. The prosecution argued that, statistically, the prior probability of two infants dying an unexplained death was one in 73 million and thus concluded that Clark had likely murdered her children.&nbsp;<br><br>However, they failed to consider that the prior probability of a double homicide of two infants was even <em>lower <\/em>than one in 73 million, leading statisticians to later point out that it was actually more likely that the infants had suffered unexplained deaths. Although Clark was initially convicted of double homicide, she was exonerated in 2003.<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>Further, Bergstrom and West contend that <em>publication bias <\/em>can promote bullshit by creating a <a href=\"https:\/\/www.shortform.com\/blog\/distorted-perceptions\/\">distorted view<\/a> of scientific studies. Publication bias refers to scientific journals\u2019s tendency to only publish statistically significant results since such results are considered more interesting than non-significant results. In practice, this means published scientific studies often report statistically significant results even when these results don\u2019t necessarily indicate a meaningful connection.&nbsp;<\/p>\n\n\n\n<p>For example, even though there isn\u2019t a connection between astrological signs and political views, if 100 studies attempted to test this relationship, we should expect about five to have a p-value below 0.05. Because these five studies would likely get published while the other 95 wouldn\u2019t, scientific journals would inadvertently promote the bullshit view that there\u2019s a connection between astrology and politics because of publication bias.&nbsp;<\/p>\n\n\n\n<p>(Shortform note: Experts point out that, although publication bias is partially due to journals preferring to publish statistically significant results, it\u2019s also partially due to <a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC5696751\/\" target=\"_blank\" rel=\"noreferrer noopener\">authors often refusing to submit statistically insignificant results in the first place<\/a>. For many authors, this decision is practical: Because experiments with statistically insignificant results are much more common than those with statistically significant results, submitting insignificant results could overwhelm journals with submissions.)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Is the institution of science immune from misinformation? How can there be lies in science when practitioners are committed to the scientific method? In Calling Bullshit, Carl T. Bergstrom and Jevin D. West argue that science\u2019s focus on statistical significance gives rise to bullshit for two reasons: we can easily misinterpret what statistical significance means, and we\u2019re exposed to statistically significant findings only because of publication bias. Let&#8217;s take a close look at both of these problematic dynamics in science.<\/p>\n","protected":false},"author":9,"featured_media":42228,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[160,25],"tags":[1331],"class_list":["post-117928","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-science","category-statistics","tag-calling-bullshit","","tg-column-two"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v24.3 (Yoast SEO v24.3) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Lies in Science: How a Focus on P-Values Leads to Bullshit - Shortform Books<\/title>\n<meta name=\"description\" content=\"The authors of Calling Bullshit say that mishandling of statistical significance gives rise to lies in science for two reasons. Learn more.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.shortform.com\/blog\/lies-in-science\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Lies in Science: How a Focus on P-Values Leads to Bullshit\" \/>\n<meta property=\"og:description\" content=\"The authors of Calling Bullshit say that mishandling of statistical significance gives rise to lies in science for two reasons. Learn more.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.shortform.com\/blog\/lies-in-science\/\" \/>\n<meta property=\"og:site_name\" content=\"Shortform Books\" \/>\n<meta property=\"article:published_time\" content=\"2023-11-17T17:55:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-22T14:59:48+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/s3.amazonaws.com\/wordpress.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/evaluating-science.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"750\" \/>\n\t<meta property=\"og:image:height\" content=\"353\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Elizabeth Whitworth\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Elizabeth Whitworth\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.shortform.com\/blog\/lies-in-science\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/lies-in-science\/\"},\"author\":{\"name\":\"Elizabeth Whitworth\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/d2928cf6c11a69ced1491d6a5b74fb13\"},\"headline\":\"Lies in Science: How a Focus on P-Values Leads to Bullshit\",\"datePublished\":\"2023-11-17T17:55:00+00:00\",\"dateModified\":\"2023-11-22T14:59:48+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/lies-in-science\/\"},\"wordCount\":817,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/lies-in-science\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/evaluating-science.jpg\",\"keywords\":[\"Calling Bullshit\"],\"articleSection\":[\"Science\",\"Statistics\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.shortform.com\/blog\/lies-in-science\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.shortform.com\/blog\/lies-in-science\/\",\"url\":\"https:\/\/www.shortform.com\/blog\/lies-in-science\/\",\"name\":\"Lies in Science: How a Focus on P-Values Leads to Bullshit - Shortform Books\",\"isPartOf\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/lies-in-science\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/lies-in-science\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/evaluating-science.jpg\",\"datePublished\":\"2023-11-17T17:55:00+00:00\",\"dateModified\":\"2023-11-22T14:59:48+00:00\",\"description\":\"The authors of Calling Bullshit say that mishandling of statistical significance gives rise to lies in science for two reasons. Learn more.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/lies-in-science\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.shortform.com\/blog\/lies-in-science\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.shortform.com\/blog\/lies-in-science\/#primaryimage\",\"url\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/evaluating-science.jpg\",\"contentUrl\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/evaluating-science.jpg\",\"width\":750,\"height\":353},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.shortform.com\/blog\/lies-in-science\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.shortform.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Lies in Science: How a Focus on P-Values Leads to Bullshit\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#website\",\"url\":\"https:\/\/www.shortform.com\/blog\/\",\"name\":\"Shortform Books\",\"description\":\"The World&#039;s Best Book Summaries\",\"publisher\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.shortform.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#organization\",\"name\":\"Shortform Books\",\"url\":\"https:\/\/www.shortform.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2019\/06\/logo-equilateral-with-text-no-bg.png\",\"contentUrl\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2019\/06\/logo-equilateral-with-text-no-bg.png\",\"width\":500,\"height\":74,\"caption\":\"Shortform Books\"},\"image\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/d2928cf6c11a69ced1491d6a5b74fb13\",\"name\":\"Elizabeth Whitworth\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/1fff9d65a52ac4340660218e7b63ee5e365cf08e7aa7adff79a0142cd4b96f84?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/1fff9d65a52ac4340660218e7b63ee5e365cf08e7aa7adff79a0142cd4b96f84?s=96&d=mm&r=g\",\"caption\":\"Elizabeth Whitworth\"},\"description\":\"Elizabeth has a lifelong love of books. She devours nonfiction, especially in the areas of history, theology, and philosophy. A switch to audiobooks has kindled her enjoyment of well-narrated fiction, particularly Victorian and early 20th-century works. She appreciates idea-driven books\u2014and a classic murder mystery now and then. Elizabeth has a Substack and is writing a book about what the Bible says about death and hell.\",\"sameAs\":[\"rina@shortform.com\"],\"award\":[\"Contributions to joint task force efforts (FBI)\",\"Contributions to Special Operations Division (DOJ & DEA)\",\"Efforts to fight the war on drugs (NSA)\",\"Contributions to Operation Storm Front (US Customs Service)\"],\"knowsAbout\":[\"History\",\"Theology\",\"Government\"],\"jobTitle\":\"Senior SEO Writer\",\"worksFor\":\"Shortform\",\"url\":\"https:\/\/www.shortform.com\/blog\/author\/elizabeth\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Lies in Science: How a Focus on P-Values Leads to Bullshit - Shortform Books","description":"The authors of Calling Bullshit say that mishandling of statistical significance gives rise to lies in science for two reasons. Learn more.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.shortform.com\/blog\/lies-in-science\/","og_locale":"en_US","og_type":"article","og_title":"Lies in Science: How a Focus on P-Values Leads to Bullshit","og_description":"The authors of Calling Bullshit say that mishandling of statistical significance gives rise to lies in science for two reasons. Learn more.","og_url":"https:\/\/www.shortform.com\/blog\/lies-in-science\/","og_site_name":"Shortform Books","article_published_time":"2023-11-17T17:55:00+00:00","article_modified_time":"2023-11-22T14:59:48+00:00","og_image":[{"width":750,"height":353,"url":"https:\/\/s3.amazonaws.com\/wordpress.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/evaluating-science.jpg","type":"image\/jpeg"}],"author":"Elizabeth Whitworth","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Elizabeth Whitworth","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.shortform.com\/blog\/lies-in-science\/#article","isPartOf":{"@id":"https:\/\/www.shortform.com\/blog\/lies-in-science\/"},"author":{"name":"Elizabeth Whitworth","@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/d2928cf6c11a69ced1491d6a5b74fb13"},"headline":"Lies in Science: How a Focus on P-Values Leads to Bullshit","datePublished":"2023-11-17T17:55:00+00:00","dateModified":"2023-11-22T14:59:48+00:00","mainEntityOfPage":{"@id":"https:\/\/www.shortform.com\/blog\/lies-in-science\/"},"wordCount":817,"commentCount":0,"publisher":{"@id":"https:\/\/www.shortform.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.shortform.com\/blog\/lies-in-science\/#primaryimage"},"thumbnailUrl":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/evaluating-science.jpg","keywords":["Calling Bullshit"],"articleSection":["Science","Statistics"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.shortform.com\/blog\/lies-in-science\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.shortform.com\/blog\/lies-in-science\/","url":"https:\/\/www.shortform.com\/blog\/lies-in-science\/","name":"Lies in Science: How a Focus on P-Values Leads to Bullshit - Shortform Books","isPartOf":{"@id":"https:\/\/www.shortform.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.shortform.com\/blog\/lies-in-science\/#primaryimage"},"image":{"@id":"https:\/\/www.shortform.com\/blog\/lies-in-science\/#primaryimage"},"thumbnailUrl":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/evaluating-science.jpg","datePublished":"2023-11-17T17:55:00+00:00","dateModified":"2023-11-22T14:59:48+00:00","description":"The authors of Calling Bullshit say that mishandling of statistical significance gives rise to lies in science for two reasons. Learn more.","breadcrumb":{"@id":"https:\/\/www.shortform.com\/blog\/lies-in-science\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.shortform.com\/blog\/lies-in-science\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.shortform.com\/blog\/lies-in-science\/#primaryimage","url":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/evaluating-science.jpg","contentUrl":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/evaluating-science.jpg","width":750,"height":353},{"@type":"BreadcrumbList","@id":"https:\/\/www.shortform.com\/blog\/lies-in-science\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.shortform.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Lies in Science: How a Focus on P-Values Leads to Bullshit"}]},{"@type":"WebSite","@id":"https:\/\/www.shortform.com\/blog\/#website","url":"https:\/\/www.shortform.com\/blog\/","name":"Shortform Books","description":"The World&#039;s Best Book Summaries","publisher":{"@id":"https:\/\/www.shortform.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.shortform.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.shortform.com\/blog\/#organization","name":"Shortform Books","url":"https:\/\/www.shortform.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2019\/06\/logo-equilateral-with-text-no-bg.png","contentUrl":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2019\/06\/logo-equilateral-with-text-no-bg.png","width":500,"height":74,"caption":"Shortform Books"},"image":{"@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/d2928cf6c11a69ced1491d6a5b74fb13","name":"Elizabeth Whitworth","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/1fff9d65a52ac4340660218e7b63ee5e365cf08e7aa7adff79a0142cd4b96f84?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1fff9d65a52ac4340660218e7b63ee5e365cf08e7aa7adff79a0142cd4b96f84?s=96&d=mm&r=g","caption":"Elizabeth Whitworth"},"description":"Elizabeth has a lifelong love of books. She devours nonfiction, especially in the areas of history, theology, and philosophy. A switch to audiobooks has kindled her enjoyment of well-narrated fiction, particularly Victorian and early 20th-century works. She appreciates idea-driven books\u2014and a classic murder mystery now and then. Elizabeth has a Substack and is writing a book about what the Bible says about death and hell.","sameAs":["rina@shortform.com"],"award":["Contributions to joint task force efforts (FBI)","Contributions to Special Operations Division (DOJ & DEA)","Efforts to fight the war on drugs (NSA)","Contributions to Operation Storm Front (US Customs Service)"],"knowsAbout":["History","Theology","Government"],"jobTitle":"Senior SEO Writer","worksFor":"Shortform","url":"https:\/\/www.shortform.com\/blog\/author\/elizabeth\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/evaluating-science.jpg","_links":{"self":[{"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/posts\/117928","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/comments?post=117928"}],"version-history":[{"count":8,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/posts\/117928\/revisions"}],"predecessor-version":[{"id":117979,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/posts\/117928\/revisions\/117979"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/media\/42228"}],"wp:attachment":[{"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/media?parent=117928"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/categories?post=117928"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/tags?post=117928"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}