{"id":73153,"date":"2022-07-25T11:34:00","date_gmt":"2022-07-25T15:34:00","guid":{"rendered":"https:\/\/www.shortform.com\/blog\/?p=73153"},"modified":"2022-08-01T12:07:52","modified_gmt":"2022-08-01T16:07:52","slug":"publication-bias-in-research","status":"publish","type":"post","link":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/","title":{"rendered":"Publication Bias in Research: Negative Findings"},"content":{"rendered":"\n

What is publication bias in research<\/a>? Why do researchers choose not to report negative findings? <\/p>\n\n\n\n

Publication bias occurs when the outcome of a research project influences the decision to publish it. Researchers and publishers may be more inclined to share positive research findings because they make for more attention-grabbing headlines. <\/p>\n\n\n\n

Here’s how publication bias can lead to inflated confidence in research findings. <\/p>\n\n\n\n\n\n\n\n

Publication Bias<\/strong><\/h2>\n\n\n\n

Publication bias in research<\/a> is the reason so many studies never make it to journals. This is in part, as Wheelan explains, because \u201cnegative findings\u201d don’t make for attention-grabbing headlines. For example, people might not go out of their way to read a paper entitled \u201cWearing Skinny Jeans Has No Impact On Your Health.\u201d <\/p>\n\n\n\n

People are more interested in attention-grabbing headlines, such as a hypothetical: \u201cAre Your Skinny Jeans Killing You? Research Finds Link Between Skinny Jeans and Risk of Heart Attack!\u201d <\/p>\n\n\n\n

Wheelan explains that publication bias can lead to misconceptions and inflated confidence in research findings because people never get to see corresponding studies that might negate or temper published research results. For example, suppose a hypothetical study found a small positive correlation between owning a dog and lower rates of a certain type of cancer. In that case, people might rush to adopt a dog without ever knowing that five other studies found no such link.<\/p>\n\n\n\n

To combat publication bias, Wheelan explains that medical journals may enforce a policy that all studies on a particular research question be reported, not just the positive ones.<\/p>\n\n\n\n

Positive Headlines Grab Public Attention<\/strong><\/h3>\n\n\n\n

Even when negative research findings do find their way to publication, they can be overshadowed by positive findings even if they present more reliable data.

For example, the CDC notes<\/a> that the agency either funded or conducted nine studies<\/a> between 1999 and 2010 that showed \u201cno link\u201d between childhood vaccinations and autism. Despite the public availability of these research results, the public\u2019s focus remains on the single \u201cpositive finding\u201d between research and autism published in 1998, even though this study has been thoroughly discredited.<\/p>\n","protected":false},"excerpt":{"rendered":"

What is publication bias in research? Why do researchers choose not to report negative findings? Publication bias occurs when the outcome of a research project influences the decision to publish it. Researchers and publishers may be more inclined to share positive research findings because they make for more attention-grabbing headlines. Here’s how publication bias can lead to inflated confidence in research findings.<\/p>\n","protected":false},"author":7,"featured_media":54391,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[160,25],"tags":[681],"class_list":["post-73153","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-science","category-statistics","tag-naked-statistics","","tg-column-two"],"yoast_head":"\nPublication Bias in Research: Negative Findings - Shortform Books<\/title>\n<meta name=\"description\" content=\"Publication bias is the reason why a large portion of research is never published. Negative findings don't make for very exciting headlines.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Publication Bias in Research: Negative Findings\" \/>\n<meta property=\"og:description\" content=\"Publication bias is the reason why a large portion of research is never published. Negative findings don't make for very exciting headlines.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/\" \/>\n<meta property=\"og:site_name\" content=\"Shortform Books\" \/>\n<meta property=\"article:published_time\" content=\"2022-07-25T15:34:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-08-01T16:07:52+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/s3.amazonaws.com\/wordpress.shortform.com\/blog\/wp-content\/uploads\/2021\/11\/bias-2.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2400\" \/>\n\t<meta property=\"og:image:height\" content=\"1600\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Darya Sinusoid\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Darya Sinusoid\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/\"},\"author\":{\"name\":\"Darya Sinusoid\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/0421cce75bc249b11e2517b3a91f9c46\"},\"headline\":\"Publication Bias in Research: Negative Findings\",\"datePublished\":\"2022-07-25T15:34:00+00:00\",\"dateModified\":\"2022-08-01T16:07:52+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/\"},\"wordCount\":347,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/11\/bias-2.jpg\",\"keywords\":[\"Naked Statistics\"],\"articleSection\":[\"Science\",\"Statistics\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/\",\"url\":\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/\",\"name\":\"Publication Bias in Research: Negative Findings - Shortform Books\",\"isPartOf\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/11\/bias-2.jpg\",\"datePublished\":\"2022-07-25T15:34:00+00:00\",\"dateModified\":\"2022-08-01T16:07:52+00:00\",\"description\":\"Publication bias is the reason why a large portion of research is never published. Negative findings don't make for very exciting headlines.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#primaryimage\",\"url\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/11\/bias-2.jpg\",\"contentUrl\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/11\/bias-2.jpg\",\"width\":2400,\"height\":1600,\"caption\":\"The 25 Cognitive Biases: The Lollapalooza Effect\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.shortform.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Publication Bias in Research: Negative Findings\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#website\",\"url\":\"https:\/\/www.shortform.com\/blog\/\",\"name\":\"Shortform Books\",\"description\":\"The World's Best Book Summaries\",\"publisher\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.shortform.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#organization\",\"name\":\"Shortform Books\",\"url\":\"https:\/\/www.shortform.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2019\/06\/logo-equilateral-with-text-no-bg.png\",\"contentUrl\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2019\/06\/logo-equilateral-with-text-no-bg.png\",\"width\":500,\"height\":74,\"caption\":\"Shortform Books\"},\"image\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/0421cce75bc249b11e2517b3a91f9c46\",\"name\":\"Darya Sinusoid\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/Untitled-design-1.png\",\"contentUrl\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/Untitled-design-1.png\",\"caption\":\"Darya Sinusoid\"},\"description\":\"Darya\u2019s love for reading started with fantasy novels (The LOTR trilogy is still her all-time-favorite). Growing up, however, she found herself transitioning to non-fiction, psychological, and self-help books. She has a degree in Psychology and a deep passion for the subject. She likes reading research-informed books that distill the workings of the human brain\/mind\/consciousness and thinking of ways to apply the insights to her own life. Some of her favorites include Thinking, Fast and Slow, How We Decide, and The Wisdom of the Enneagram.\",\"url\":\"https:\/\/www.shortform.com\/blog\/author\/darya\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Publication Bias in Research: Negative Findings - Shortform Books","description":"Publication bias is the reason why a large portion of research is never published. Negative findings don't make for very exciting headlines.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/","og_locale":"en_US","og_type":"article","og_title":"Publication Bias in Research: Negative Findings","og_description":"Publication bias is the reason why a large portion of research is never published. Negative findings don't make for very exciting headlines.","og_url":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/","og_site_name":"Shortform Books","article_published_time":"2022-07-25T15:34:00+00:00","article_modified_time":"2022-08-01T16:07:52+00:00","og_image":[{"width":2400,"height":1600,"url":"https:\/\/s3.amazonaws.com\/wordpress.shortform.com\/blog\/wp-content\/uploads\/2021\/11\/bias-2.jpg","type":"image\/jpeg"}],"author":"Darya Sinusoid","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Darya Sinusoid","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#article","isPartOf":{"@id":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/"},"author":{"name":"Darya Sinusoid","@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/0421cce75bc249b11e2517b3a91f9c46"},"headline":"Publication Bias in Research: Negative Findings","datePublished":"2022-07-25T15:34:00+00:00","dateModified":"2022-08-01T16:07:52+00:00","mainEntityOfPage":{"@id":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/"},"wordCount":347,"commentCount":0,"publisher":{"@id":"https:\/\/www.shortform.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#primaryimage"},"thumbnailUrl":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/11\/bias-2.jpg","keywords":["Naked Statistics"],"articleSection":["Science","Statistics"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/","url":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/","name":"Publication Bias in Research: Negative Findings - Shortform Books","isPartOf":{"@id":"https:\/\/www.shortform.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#primaryimage"},"image":{"@id":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#primaryimage"},"thumbnailUrl":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/11\/bias-2.jpg","datePublished":"2022-07-25T15:34:00+00:00","dateModified":"2022-08-01T16:07:52+00:00","description":"Publication bias is the reason why a large portion of research is never published. Negative findings don't make for very exciting headlines.","breadcrumb":{"@id":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#primaryimage","url":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/11\/bias-2.jpg","contentUrl":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/11\/bias-2.jpg","width":2400,"height":1600,"caption":"The 25 Cognitive Biases: The Lollapalooza Effect"},{"@type":"BreadcrumbList","@id":"https:\/\/www.shortform.com\/blog\/publication-bias-in-research\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.shortform.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Publication Bias in Research: Negative Findings"}]},{"@type":"WebSite","@id":"https:\/\/www.shortform.com\/blog\/#website","url":"https:\/\/www.shortform.com\/blog\/","name":"Shortform Books","description":"The World's Best Book Summaries","publisher":{"@id":"https:\/\/www.shortform.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.shortform.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.shortform.com\/blog\/#organization","name":"Shortform Books","url":"https:\/\/www.shortform.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2019\/06\/logo-equilateral-with-text-no-bg.png","contentUrl":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2019\/06\/logo-equilateral-with-text-no-bg.png","width":500,"height":74,"caption":"Shortform Books"},"image":{"@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/0421cce75bc249b11e2517b3a91f9c46","name":"Darya Sinusoid","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/Untitled-design-1.png","contentUrl":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/Untitled-design-1.png","caption":"Darya Sinusoid"},"description":"Darya\u2019s love for reading started with fantasy novels (The LOTR trilogy is still her all-time-favorite). Growing up, however, she found herself transitioning to non-fiction, psychological, and self-help books. She has a degree in Psychology and a deep passion for the subject. She likes reading research-informed books that distill the workings of the human brain\/mind\/consciousness and thinking of ways to apply the insights to her own life. Some of her favorites include Thinking, Fast and Slow, How We Decide, and The Wisdom of the Enneagram.","url":"https:\/\/www.shortform.com\/blog\/author\/darya\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/11\/bias-2.jpg","_links":{"self":[{"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/posts\/73153","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/comments?post=73153"}],"version-history":[{"count":7,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/posts\/73153\/revisions"}],"predecessor-version":[{"id":74062,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/posts\/73153\/revisions\/74062"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/media\/54391"}],"wp:attachment":[{"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/media?parent=73153"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/categories?post=73153"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/tags?post=73153"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}