{"id":5845,"date":"2010-12-29T09:58:54","date_gmt":"2010-12-29T14:58:54","guid":{"rendered":"http:\/\/www.realclimate.org\/?p=5845"},"modified":"2010-12-29T10:25:52","modified_gmt":"2010-12-29T15:25:52","slug":"science-is-self-correcting-lessons-from-the-arsenic-controversy","status":"publish","type":"post","link":"https:\/\/www.realclimate.org\/index.php\/archives\/2010\/12\/science-is-self-correcting-lessons-from-the-arsenic-controversy\/","title":{"rendered":"Science is self-correcting: Lessons from the arsenic controversy"},"content":{"rendered":"<div class=\"kcite-section\" kcite-section-id=\"5845\">\n<p>Recent attention to <A HREF=\"http:\/\/astrobiology.nasa.gov\/articles\/thriving-on-arsenic\/\">NASA\u2019s announcement of \u2018arsenic-based life\u2019<\/A> has provided a very public window into how science and scientists operate. Debate surrounds the announcement of any controversial scientific finding. In the case of arseno-DNA,  the discussion that is playing out on the <A HREF=\"http:\/\/blogs.discovermagazine.com\/loom\/2010\/12\/08\/of-arsenic-and-aliens-what-the-critics-said\/\">blogs<\/A> is very similar to the process that usually plays out in conferences and seminars. This discussion is a core process by which science works.<br \/>\n<!--more--><\/p>\n<p>The arseno-DNA episode has displayed this process in full public view. If anything, this incident has demonstrated the credibility of scientists, and should promote public confidence in the scientific establishment.<\/p>\n<p>The story begins with a long-standing scientific consensus backed by an enormous amount of data: DNA is made with a phosphate backbone.  Alternative backbones, such as arsenate, have long been <A HREF=\"http:\/\/www.sciencemag.org\/content\/235\/4793\/1173.short\">considered unlikely<\/A> for theoretical reasons.<\/p>\n<p>Nonetheless, despite this consensus, reputable scientists have <A HREF=\"http:\/\/books.nap.edu\/catalog.php?record_id=11919\">promoted the study of alternatives<\/A> challenging the prevailing view. And NASA has willingly funded these studies.<\/p>\n<p><I>Lesson one<\/I>: Major funding agencies willingly back studies challenging scientific consensus.<\/p>\n<p>The <a href=\"http:\/\/www.ironlisa.com\/\">research team<\/a>, Felisa Wolfe-Simon and colleagues, behind this study collected data and concluded that they had sufficient evidence to demonstrate incorporation of arsenate into bacterial DNA. Although the data were preliminary in nature, <A HREF=\"http:\/\/www.sciencemag.org\/content\/early\/2010\/12\/01\/science.1197258\"><I>Science<\/I><\/A> accepted the manuscript (<a href=\"http:\/\/www.ironlisa.com\/WolfeSimon_etal_Science2010.pdf\">pdf<\/a>).  With a high profile, potentially groundbreaking paper about to be published, NASA announced <A HREF=\"http:\/\/blogs.nasa.gov\/cm\/blog\/NES_Teachers_Corner\/posts\/post_1291219843209.html\">a press conference<\/A> to publicize the findings.<\/p>\n<p><I>Lesson two<\/I>: Most everyone would be thrilled to overturn the consensus. Doing so successfully can be a career-making result. Journals such as <I>Science<\/I> and <I>Nature<\/I> are more than willing to publish results that overturn scientific consensus, even if data are preliminary \u2013 and funding agencies are willing to promote these results.<\/p>\n<p>Within days of the arsenic paper\u2019s publication, strong criticism of the study began to appear on <A HREF=\"http:\/\/rrresearch.blogspot.com\/2010\/12\/arsenic-associated-bacteria-nasas.html\">scientific<\/A> <A HREF=\"http:\/\/scienceblogs.com\/webeasties\/2010\/12\/guest_post_arsenate-based_dna.php\">blogs<\/A>. These blogs attracted the attention of the mainstream scientific press. Soon thereafter, media reported the wide skepticism within the scientific community &#8211; with some scientists going so far as to say that the paper <A HREF=\"http:\/\/www.slate.com\/id\/2276919\/\">should not have been published<\/A>.<\/p>\n<p>These scientific criticisms opened the door to those wishing to discredit science and the peer-review process, with the contrarian blogs suggesting that this study demonstrates that peer-review is \u201c<A HREF=\"http:\/\/wattsupwiththat.com\/2010\/12\/07\/arsenic-and-post-haste-another-example-of-the-broken-peer-review-process\/\" rel=\"nofollow\">broken<\/A>\u201d.  A comment on Watts\u2019 blog summarizes their thinking:<\/p>\n<blockquote><p>\nIt\u2019s amazing how fast the scientific community came out to attack NASA for what they claim is plainly flawed science. Then again, NASA isn\u2019t funding any of the attackers.<\/p>\n<p>In the Climategate mess however, we still have heard very little from an awful lot of so-called scientists who should have been saying a lot more about flawed science but are too afraid to lose their grant money.\n<\/p><\/blockquote>\n<p>This raises an interesting question: just who is critiquing the NASA study? It turns out that many of the critics are <em>also<\/em> NASA-funded. In fact, many prominent critics of this study are funded by the NASA Astrobiology Institute &#8211; the very same program that funded the arsenic study.<\/p>\n<p>Carl Zimmer gives us <A HREF=\"http:\/\/blogs.discovermagazine.com\/loom\/2010\/12\/08\/of-arsenic-and-aliens-what-the-critics-said\/\">several examples<\/A>:<\/p>\n<ul>\n<li><A HREF=\"http:\/\/astrobiology.nasa.gov\/directory\/profile\/497\/norman\/pace\/\">Norm Pace<\/A> offers the critique: &#8220;Low levels of phosphate in growth media, naive investigators and bad reviewers are the stories here\u201d.<\/li>\n<li><A HREF=\"http:\/\/astrobiology.nasa.gov\/directory\/profile\/486\/shelley\/copley\/\">Shelley Copley<\/A> suggested, \u201cthis paper should not have been published\u201d <\/li>\n<li><A HREF=\"http:\/\/astrobiology.nasa.gov\/directory\/profile\/53\/roger\/summons\/\">Roger Summons<\/A> remarked that a critical experiment was left undone, and backed the <A HREF=\"http:\/\/scienceblogs.com\/webeasties\/2010\/12\/guest_post_arsenate-based_dna.php\">critical blog analysis<\/A> of his NASA-funded <A HREF=\"http:\/\/astrobiology.nasa.gov\/directory\/profile\/2378\/alex\/bradley\/\">former student. <\/A><\/li>\n<li><A HREF=\"http:\/\/astrobiology.nasa.gov\/directory\/profile\/4448\/michael\/russell\/\">Michael Russell<\/A> agreed with blogosphere critics, and offered his own critique of the study based on cosmic ratios of phosphorus to arsenic. Russell is a member of the Astrobiology Institute, as well as an <A HREF=\"http:\/\/science.jpl.nasa.gov\/people\/Russell\/\">employee<\/A> of NASA\u2019s Jet Propulsion Laboratory.<\/li>\n<li><A HREF=\"http:\/\/astrobiology.nasa.gov\/directory\/profile\/2276\/forest\/rohwer\/\">Forest Rohwer<\/A> observed, \u201cthe experimental evidence in the paper is pretty weak.\u201d<\/li>\n<li><A HREF=\"http:\/\/astrobiology.nasa.gov\/directory\/profile\/115\/george\/cody\/\">George Cody<\/A> says he \u201ccannot accept this claim until such an experiment [mass spectrometry] (easily done) is performed.\u201d<\/li>\n<li><A HREF=\"http:\/\/astrobiology.nasa.gov\/directory\/profile\/406\/steven\/benner\/\">Steven Benner<\/A> was an early skeptic. To NASA\u2019s credit, they invited him to present his criticisms at the press conference. He <A HREF=\"http:\/\/www.livescience.com\/strangenews\/arsenic-bacteria-nasa-life-form-debate-101207.html\">has said<\/A> \u201cwe are not expecting this result to survive\u201d.<\/li>\n<\/ul>\n<p>Each of these scientists is affiliated with <a href=\"http:\/\/astrobiology.nasa.gov\/\">NASA Astrobiology<\/a>.<\/p>\n<p><I>Lesson three<\/I>: Scientists offer opinions based on their scientific knowledge and a critical interpretation of data. Scientists willingly critique what they think might be flawed or unsubstantiated science, because their credibility &#8211; not their funding &#8211; is on the line.<\/p>\n<p>Regardless of whether or not \u2018arseno-DNA\u2019 survives the test of time and further study, scientists have shown that they will rigorously criticize science perceived as flawed, with no fear of reprisal from funding agencies.<\/p>\n<p>This is the key lesson to take from this incident, and it applies to all scientific disciplines: peer-review continues <em>after<\/em> publication.  Challenges to consensus are seriously entertained \u2013 and are accepted when supported by rigorous data. Poorly substantiated studies may inspire further study, but will be scientifically criticized without concern for funding opportunities. Scientists are not \u201cafraid to lose their grant money\u201d.<\/p>\n<p>Finally, there is the issue of how scientists who publish papers that generate credible blog reactions should in turn react. In times past, it was simple to wait for properly crafted letters and comments to be sent in to the journal. This gave fixed targets to deal with and allowed for considered reflection and response;  discussions would perhaps be published 6 months to year later. But today, serious criticisms can arrive immediately (as seen above). <em>Nature<\/em> (perhaps with a little schadenfreude) had <a href=\"http:\/\/www.nature.com\/nature\/journal\/v468\/n7326\/full\/468867a.html\">an op-ed<\/a> suggesting that the authors on this (<em>Science<\/em>) paper should be more strongly engaged in the reaction, while <em>Science<\/em> had a <a href=\"http:\/\/www.sciencemag.org\/content\/330\/6012\/1734.summary\">plea from the lead author<\/a> for a little patience, since they were clearly a little overwhelmed. <\/p>\n<p>In our view, this needs to be thought about clearly on a case by case basis. Some criticisms (that for instance accuse the authors of deliberate fraud or misconduct based on a dislike of the conclusions) are not worth rapidly responding to, but it is worth trying to head off any misinterpretations that might be emerging. Short form papers (even with copious supplementary information) do not provide full context for the results in themselves, and so putting together a response to frequently asked questions is certainly useful (as <a href=\"http:\/\/ironlisa.com\/gfaj\/GFAJquestions_Response_16Dec2010.pdf\">Dr. Wolfe-Simon and colleagues<\/a> have). This doesn&#8217;t replace the need for technical commentary to pass via the peer-review process though. In the end, that is what people will refer back to.<\/p>\n<!-- kcite active, but no citations found -->\n<\/div> <!-- kcite-section 5845 -->","protected":false},"excerpt":{"rendered":"<p>Arsenic in DNA, the nature of the scientific debate, how science is self-correcting. <\/p>\n","protected":false},"author":12,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[38],"tags":[],"class_list":{"0":"post-5845","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-scientific-practice","7":"entry"},"aioseo_notices":[],"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/5845","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/comments?post=5845"}],"version-history":[{"count":13,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/5845\/revisions"}],"predecessor-version":[{"id":5871,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/5845\/revisions\/5871"}],"wp:attachment":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/media?parent=5845"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/categories?post=5845"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/tags?post=5845"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}