{"id":23308,"date":"2020-12-15T20:54:53","date_gmt":"2020-12-16T01:54:53","guid":{"rendered":"http:\/\/www.realclimate.org\/?p=23308"},"modified":"2020-12-17T07:12:03","modified_gmt":"2020-12-17T12:12:03","slug":"an-ever-more-perfect-dataset","status":"publish","type":"post","link":"https:\/\/www.realclimate.org\/index.php\/archives\/2020\/12\/an-ever-more-perfect-dataset\/","title":{"rendered":"An ever more perfect dataset?"},"content":{"rendered":"
\n\n

Do you remember when global warming was small enough for people to care about the details of how climate scientists put together records of global temperature history? Seems like a long time ago… <\/p>\n\n\n\n

Nonetheless, it’s worth a quick post to discuss the latest updates in HadCRUT (the data product put together by the UK’s Hadley Centre and the Climatic Research Unit at the University of East Anglia). They have recently released HadCRUT5<\/a> (Morice et al., 2020<\/a><\/span>), which marks a big increase in the amount of source data used (similarly now to the upgrades from GHCN3 to GHCN4<\/a> used by NASA GISS and NOAA NCEI, and comparable to the data sources used by Berkeley Earth<\/a>). Additionally, they have improved their analysis of the sea surface temperature anomalies (a perennial issue<\/a>) which leads to an increase in the recent trends. Finally, they have started to produce an infilled data set which uses an extrapolation to fill in data-poor areas (like the Arctic – first analysed by us in 2008<\/a>…) that were left blank in HadCRUT4 (so similar to GISTEMP, Berkeley Earth and the work by Cowtan and Way). Because the Arctic is warming faster than the global mean, the new procedure corrects a bias that existing in the previous global means (by about 0.16\u00baC in 2018 using a 1951-1980 baseline). Combined, the new changes give a result that is much closer to the other products: <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Differences persist around 1940, or in earlier decades, mostly due to the treatment of ocean temperatures in HadSST4 vs. ERSST5. <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

In conclusion, this update further solidifies the robustness of the surface temperature record, though there are still questions to be addressed, and there remain mountains of old paper records<\/a> to be digitized. <\/p>\n\n\n\n

The implications of these updates for anything important (such as the climate sensitivity or the carbon budget) will however be minor because all sensible analyses would have been using a range of surface temperature products already. <\/p>\n\n\n\n

With 2020 drawing to a close, the next annual update and intense comparison of all these records, including the various satellite-derived global products (UAH, RSS, AIRS) will occur in January. Hopefully, HadCRUT5 will be extended beyond 2018 by then. <\/p>\n\n\n\n

In writing this post, I noticed that we had written up a detailed post<\/a> on the last HadCRUT update (in 2012). Oddly enough the issues raised were more or less the same, and the most important conclusion remains true today: <\/p>\n\n\n\n

First and foremost is the realisation that data synthesis is a continuous process. Single measurements are generally a one-time deal. Something is measured, and the measurement is recorded. However, comparing multiple measurements requires more work \u2013 were the measuring devices calibrated to the same standard? Were there biases in the devices? Did the result get recorded correctly? Over what time and space scales were the measurements representative? These questions are continually being revisited \u2013 as new data come in, as old data is digitized, as new issues are explored, and as old issues are reconsidered. Thus for any data synthesis \u2013 whether it is for the global mean temperature anomaly, ocean heat content or a paleo-reconstruction \u2013 revisions over time are both inevitable and necessary. <\/p><\/blockquote>\n\n\n\n

<\/p>\n

References<\/h2>\n
    \n
  1. <\/a>\n, 2021. https:\/\/www.metoffice.gov.uk\/hadobs\/hadcrut5\/HadCRUT5_accepted.pdf<\/a>\n\n\n<\/li>\n<\/ol>\n\n<\/div> ","protected":false},"excerpt":{"rendered":"

    Do you remember when global warming was small enough for people to care about the details of how climate scientists put together records of global temperature history? Seems like a long time ago… Nonetheless, it’s worth a quick post to discuss the latest updates in HadCRUT (the data product put together by the UK’s Hadley […]<\/p>\n","protected":false},"author":2,"featured_media":23309,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[41,1,9],"tags":[],"class_list":{"0":"post-23308","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-climate-impacts","8":"category-climate-science","9":"category-instrumental-record","10":"entry"},"aioseo_notices":[],"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/23308","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/comments?post=23308"}],"version-history":[{"count":3,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/23308\/revisions"}],"predecessor-version":[{"id":23314,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/23308\/revisions\/23314"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/media\/23309"}],"wp:attachment":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/media?parent=23308"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/categories?post=23308"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/tags?post=23308"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}