{"id":42195,"date":"2021-07-06T11:54:00","date_gmt":"2021-07-06T15:54:00","guid":{"rendered":"https:\/\/www.shortform.com\/blog\/?p=42195"},"modified":"2021-07-19T15:17:19","modified_gmt":"2021-07-19T19:17:19","slug":"peer-review-in-science","status":"publish","type":"post","link":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/","title":{"rendered":"Peer Review in Science: The 3 Steps to Consensus"},"content":{"rendered":"\n<p>How does peer review in science work? How does the scientific community reach a consensus?<\/p>\n\n\n\n<p>Peer review in science is based on principles established during the <a href=\"https:\/\/www.shortform.com\/blog\/causes-of-the-scientific-revolution\/\">Scientific Revolution<\/a>. The process, comprising of three steps, is the test that a scientific claim must pass in order to be considered legitimate.<\/p>\n\n\n\n<p>Read more to learn about peer review in science.<\/p>\n\n\n\n<!--more-->\n\n\n\n<h2 class=\"wp-block-heading\">The Peer Review Process<\/h2>\n\n\n\n<p>What does peer review in science look like? The basic system has been in place since the 1600s. When scholars first became interested in learning new information (in medieval times, learning was about studying ancient texts and preserving what was already known), they realized that there had to be some sort of way to check new ideas for validity, or people could just make things up and be taken seriously. To prevent this, <strong>they built a system in which claims had to be backed up by evidence, and both the claim and evidence needed to pass the judgment of other scientists to be considered legitimate.<\/strong> If a claim failed the process, it was just a claim, not science.<\/p>\n\n\n\n<p>Today, the process is called peer review, and <strong>no science is considered legitimate until it passes peer review.<\/strong> Typically, the process works like this:<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Peer Review in Science: Step #1<\/h3>\n\n\n\n<p>A scientist comes up with an idea, collects evidence to support it, writes a paper, and then submits it to a scientific journal for publication.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Peer Review in Science: Step #2<\/h3>\n\n\n\n<p>The journal sends the paper to three other scientists to review. The reviewers aren\u2019t paid\u2014since everyone\u2019s work has to be peer-reviewed to be considered science, someone else will return the favor later.<\/p>\n\n\n\n<p>Reviewers must be subject matter experts and mustn\u2019t have a <a href=\"https:\/\/www.shortform.com\/blog\/the-people-closest-to-you\/\">close relationship<\/a> with the paper\u2019s author. They look for bad science and mistakes such as:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Made up, tweaked, or manipulated data<\/li><li>Cherry-picked data\u2014choosing to use only certain (favorable) data and leaving other numbers out<\/li><li>Claims that aren\u2019t testable<\/li><li>Small sample sizes (Shortform note: If a sample is too small, results might be due to chance)<\/li><li>Unclear analysis (the reviewer can\u2019t understand how the author got the data or made calculations with it)<\/li><li>Conclusions that don\u2019t match what the results found<\/li><li>Conclusions drawn from too little or inconsistent data<\/li><li>Reputation of the author (if the author has a history of bad methods or unreasonable claims, reviewers will consider all of the above with more scrutiny)<\/li><\/ul>\n\n\n\n<p>If the reviewers provide conflicting comments, the journal might send the paper to more scientists or the editor might provide notes.&nbsp;<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Peer Review in Science: Step #3<\/h3>\n\n\n\n<p>The journal sends the reviewers\u2019 notes back to the paper\u2019s author to address. The author may write multiple drafts as she implements and receives new feedback. If the author ultimately fails to revise well enough, the journal won\u2019t publish the paper. The author has to start over or try a different (less prestigious) journal.<\/p>\n\n\n\n<p>Papers that are presented at conferences don\u2019t have to go through the same process and aren\u2019t considered serious (they aren\u2019t taken into consideration for tenure).<\/p>\n\n\n\n<p>Peer review in science is an indispensable part of the scientific endeavor.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>How does peer review in science work? How does the scientific community reach a consensus? Peer review in science is based on principles established during the Scientific Revolution. The process, comprising of three steps, is the test that a scientific claim must pass in order to be considered legitimate. Read more to learn about peer review in science.<\/p>\n","protected":false},"author":9,"featured_media":42200,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[34,15,160],"tags":[427],"class_list":["post-42195","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-communication","category-education","category-science","tag-merchants-of-doubt","","tg-column-two"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v24.3 (Yoast SEO v24.3) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Peer Review in Science: The 3 Steps to Consensus - Shortform Books<\/title>\n<meta name=\"description\" content=\"Peer review in science is the test that a claim must pass to be considered legitimate science. Here are the three steps of the process.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Peer Review in Science: The 3 Steps to Consensus\" \/>\n<meta property=\"og:description\" content=\"Peer review in science is the test that a claim must pass to be considered legitimate science. Here are the three steps of the process.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/\" \/>\n<meta property=\"og:site_name\" content=\"Shortform Books\" \/>\n<meta property=\"article:published_time\" content=\"2021-07-06T15:54:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-07-19T19:17:19+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/s3.amazonaws.com\/wordpress.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/peer-review-in-science.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"750\" \/>\n\t<meta property=\"og:image:height\" content=\"358\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Elizabeth Whitworth\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Elizabeth Whitworth\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/\"},\"author\":{\"name\":\"Elizabeth Whitworth\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/d2928cf6c11a69ced1491d6a5b74fb13\"},\"headline\":\"Peer Review in Science: The 3 Steps to Consensus\",\"datePublished\":\"2021-07-06T15:54:00+00:00\",\"dateModified\":\"2021-07-19T19:17:19+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/\"},\"wordCount\":535,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/peer-review-in-science.jpg\",\"keywords\":[\"Merchants of Doubt\"],\"articleSection\":[\"Communication\",\"Education\",\"Science\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/\",\"url\":\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/\",\"name\":\"Peer Review in Science: The 3 Steps to Consensus - Shortform Books\",\"isPartOf\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/peer-review-in-science.jpg\",\"datePublished\":\"2021-07-06T15:54:00+00:00\",\"dateModified\":\"2021-07-19T19:17:19+00:00\",\"description\":\"Peer review in science is the test that a claim must pass to be considered legitimate science. Here are the three steps of the process.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#primaryimage\",\"url\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/peer-review-in-science.jpg\",\"contentUrl\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/peer-review-in-science.jpg\",\"width\":750,\"height\":358},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.shortform.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Peer Review in Science: The 3 Steps to Consensus\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#website\",\"url\":\"https:\/\/www.shortform.com\/blog\/\",\"name\":\"Shortform Books\",\"description\":\"The World&#039;s Best Book Summaries\",\"publisher\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.shortform.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#organization\",\"name\":\"Shortform Books\",\"url\":\"https:\/\/www.shortform.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2019\/06\/logo-equilateral-with-text-no-bg.png\",\"contentUrl\":\"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2019\/06\/logo-equilateral-with-text-no-bg.png\",\"width\":500,\"height\":74,\"caption\":\"Shortform Books\"},\"image\":{\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/d2928cf6c11a69ced1491d6a5b74fb13\",\"name\":\"Elizabeth Whitworth\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/1fff9d65a52ac4340660218e7b63ee5e365cf08e7aa7adff79a0142cd4b96f84?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/1fff9d65a52ac4340660218e7b63ee5e365cf08e7aa7adff79a0142cd4b96f84?s=96&d=mm&r=g\",\"caption\":\"Elizabeth Whitworth\"},\"description\":\"Elizabeth has a lifelong love of books. She devours nonfiction, especially in the areas of history, theology, and philosophy. A switch to audiobooks has kindled her enjoyment of well-narrated fiction, particularly Victorian and early 20th-century works. She appreciates idea-driven books\u2014and a classic murder mystery now and then. Elizabeth has a Substack and is writing a book about what the Bible says about death and hell.\",\"sameAs\":[\"rina@shortform.com\"],\"award\":[\"Contributions to joint task force efforts (FBI)\",\"Contributions to Special Operations Division (DOJ & DEA)\",\"Efforts to fight the war on drugs (NSA)\",\"Contributions to Operation Storm Front (US Customs Service)\"],\"knowsAbout\":[\"History\",\"Theology\",\"Government\"],\"jobTitle\":\"Senior SEO Writer\",\"worksFor\":\"Shortform\",\"url\":\"https:\/\/www.shortform.com\/blog\/author\/elizabeth\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Peer Review in Science: The 3 Steps to Consensus - Shortform Books","description":"Peer review in science is the test that a claim must pass to be considered legitimate science. Here are the three steps of the process.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/","og_locale":"en_US","og_type":"article","og_title":"Peer Review in Science: The 3 Steps to Consensus","og_description":"Peer review in science is the test that a claim must pass to be considered legitimate science. Here are the three steps of the process.","og_url":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/","og_site_name":"Shortform Books","article_published_time":"2021-07-06T15:54:00+00:00","article_modified_time":"2021-07-19T19:17:19+00:00","og_image":[{"width":750,"height":358,"url":"https:\/\/s3.amazonaws.com\/wordpress.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/peer-review-in-science.jpg","type":"image\/jpeg"}],"author":"Elizabeth Whitworth","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Elizabeth Whitworth","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#article","isPartOf":{"@id":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/"},"author":{"name":"Elizabeth Whitworth","@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/d2928cf6c11a69ced1491d6a5b74fb13"},"headline":"Peer Review in Science: The 3 Steps to Consensus","datePublished":"2021-07-06T15:54:00+00:00","dateModified":"2021-07-19T19:17:19+00:00","mainEntityOfPage":{"@id":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/"},"wordCount":535,"commentCount":0,"publisher":{"@id":"https:\/\/www.shortform.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#primaryimage"},"thumbnailUrl":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/peer-review-in-science.jpg","keywords":["Merchants of Doubt"],"articleSection":["Communication","Education","Science"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/","url":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/","name":"Peer Review in Science: The 3 Steps to Consensus - Shortform Books","isPartOf":{"@id":"https:\/\/www.shortform.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#primaryimage"},"image":{"@id":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#primaryimage"},"thumbnailUrl":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/peer-review-in-science.jpg","datePublished":"2021-07-06T15:54:00+00:00","dateModified":"2021-07-19T19:17:19+00:00","description":"Peer review in science is the test that a claim must pass to be considered legitimate science. Here are the three steps of the process.","breadcrumb":{"@id":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.shortform.com\/blog\/peer-review-in-science\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#primaryimage","url":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/peer-review-in-science.jpg","contentUrl":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/peer-review-in-science.jpg","width":750,"height":358},{"@type":"BreadcrumbList","@id":"https:\/\/www.shortform.com\/blog\/peer-review-in-science\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.shortform.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Peer Review in Science: The 3 Steps to Consensus"}]},{"@type":"WebSite","@id":"https:\/\/www.shortform.com\/blog\/#website","url":"https:\/\/www.shortform.com\/blog\/","name":"Shortform Books","description":"The World&#039;s Best Book Summaries","publisher":{"@id":"https:\/\/www.shortform.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.shortform.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.shortform.com\/blog\/#organization","name":"Shortform Books","url":"https:\/\/www.shortform.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2019\/06\/logo-equilateral-with-text-no-bg.png","contentUrl":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2019\/06\/logo-equilateral-with-text-no-bg.png","width":500,"height":74,"caption":"Shortform Books"},"image":{"@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/d2928cf6c11a69ced1491d6a5b74fb13","name":"Elizabeth Whitworth","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.shortform.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/1fff9d65a52ac4340660218e7b63ee5e365cf08e7aa7adff79a0142cd4b96f84?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1fff9d65a52ac4340660218e7b63ee5e365cf08e7aa7adff79a0142cd4b96f84?s=96&d=mm&r=g","caption":"Elizabeth Whitworth"},"description":"Elizabeth has a lifelong love of books. She devours nonfiction, especially in the areas of history, theology, and philosophy. A switch to audiobooks has kindled her enjoyment of well-narrated fiction, particularly Victorian and early 20th-century works. She appreciates idea-driven books\u2014and a classic murder mystery now and then. Elizabeth has a Substack and is writing a book about what the Bible says about death and hell.","sameAs":["rina@shortform.com"],"award":["Contributions to joint task force efforts (FBI)","Contributions to Special Operations Division (DOJ & DEA)","Efforts to fight the war on drugs (NSA)","Contributions to Operation Storm Front (US Customs Service)"],"knowsAbout":["History","Theology","Government"],"jobTitle":"Senior SEO Writer","worksFor":"Shortform","url":"https:\/\/www.shortform.com\/blog\/author\/elizabeth\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/www.shortform.com\/blog\/wp-content\/uploads\/2021\/07\/peer-review-in-science.jpg","_links":{"self":[{"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/posts\/42195","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/comments?post=42195"}],"version-history":[{"count":6,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/posts\/42195\/revisions"}],"predecessor-version":[{"id":42737,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/posts\/42195\/revisions\/42737"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/media\/42200"}],"wp:attachment":[{"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/media?parent=42195"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/categories?post=42195"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.shortform.com\/blog\/wp-json\/wp\/v2\/tags?post=42195"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}