{"id":10475,"date":"2012-02-08T21:26:05","date_gmt":"2012-02-09T02:26:05","guid":{"rendered":"http:\/\/www.realclimate.org\/?p=10475"},"modified":"2025-01-24T17:46:29","modified_gmt":"2025-01-24T22:46:29","slug":"2011-updates-to-model-data-comparisons","status":"publish","type":"post","link":"https:\/\/www.realclimate.org\/index.php\/archives\/2012\/02\/2011-updates-to-model-data-comparisons\/","title":{"rendered":"2011 Updates to model-data comparisons"},"content":{"rendered":"<div class=\"kcite-section\" kcite-section-id=\"10475\">\n<p>And so it goes &#8211; another year, another annual data point. As has become a habit (<a href=\"http:\/\/www.realclimate.org\/index.php\/archives\/2009\/12\/updates-to-model-data-comparisons\/\">2009<\/a>, <a href=\"http:\/\/www.realclimate.org\/index.php\/archives\/2011\/01\/2010-updates-to-model-data-comparisons\/\" title=\"2010 updates to model-data comparisons\">2010<\/a>), here is a brief overview and update of some of the most relevant model\/data comparisons. We include the standard comparisons of surface temperatures, sea ice and ocean heat content to the AR4 and 1988 Hansen et al simulations.<br \/>\n<!--more--> <\/p>\n<p>First, a graph showing the annual mean anomalies from the <a href=\"http:\/\/climexp.knmi.nl\/selectfield_co2.cgi?id=someone@somewhere\">IPCC AR4 models<\/a> plotted against the surface temperature records from the <a href=\"http:\/\/www.cru.uea.ac.uk\/cru\/data\/temperature\/hadcrut3vgl.txt\">HadCRUT3v<\/a>, <a href=\"ftp:\/\/ftp.ncdc.noaa.gov\/pub\/data\/anomalies\/annual.land_ocean.90S.90N.df_1901-2000mean.dat\">NCDC<\/a> and <a href=\"http:\/\/data.giss.nasa.gov\/gistemp\/tabledata\/GLB.Ts+dSST.txt\">GISTEMP<\/a> products (it really doesn&#8217;t matter which). Everything has been baselined to 1980-1999 (as in the 2007 IPCC report) and the envelope in grey encloses 95% of the model runs.<\/p>\n<p><img decoding=\"async\" data-src=\"\/images\/model11.jpg\" width=90% src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" style=\"--smush-placeholder-width: 2254px; --smush-placeholder-aspect-ratio: 2254\/1883;\" \/><\/p>\n<p>The La Ni\u00f1a event that emerged in 2011 definitely cooled the year a global sense relative to 2010, although there were extensive regional warm extremes. Differences between the observational records are mostly related to interpolations in the Arctic (but we will check back once the new HadCRUT4 data are released). Checking up on our predictions from last year, I forecast that 2011 would be cooler than 2010 (because of the emerging La Ni\u00f1a), but would still rank in the top 10. This was true looking at GISTEMP (2011 was #9), but not quite in HadCRUT3v (#12) or NCDC (#11). However, this was the warmest year that <a href=\"http:\/\/www.cpc.ncep.noaa.gov\/products\/analysis_monitoring\/ensostuff\/ensoyears.shtml\">started off (DJF)<\/a> with a La Ni\u00f1a (previous La Ni\u00f1a years by this index were 2008, 2001, 2000 and 1999 using a 5 month minimum for a specific event) in the GISTEMP record, and the second warmest (after 2001) in the HadCRUT3v and NCDC indices. Given current indications of only mild La Ni\u00f1a conditions, 2012 will likely be a warmer year than 2011, so again another top 10 year, but not a record breaker &#8211; that will have to wait until the next El Ni\u00f1o.<\/p>\n<p>People sometimes claim that &#8220;no models&#8221; can match the short term trends seen in the data. This is not true. For instance, the range of trends in the models for 1998-2011 are [-0.07,0.49] \u00baC\/dec, with MRI-CGCM (run5) the laggard in the pack, running colder than observations.  <\/p>\n<p>In interpreting this information, please note the following (repeated from previous years):<\/p>\n<ul>\n<li> Short term (15 years or less) trends in global temperature are not usefully predictable as a function of current forcings. This means you can&#8217;t use such short periods to &#8216;prove&#8217; that global warming has or hasn&#8217;t stopped, or that we are really cooling despite this being the warmest decade in centuries.<\/li>\n<li> The AR4 model simulations were an &#8216;ensemble of opportunity&#8217; and vary substantially among themselves with the forcings imposed, the magnitude of the internal variability and of course, the sensitivity. Thus while they do span a large range of possible situations, the average of these simulations is not &#8216;truth&#8217;.<\/li>\n<li> The model simulations use observed forcings up until 2000 (or 2003 in a couple of cases) and use a business-as-usual scenario subsequently (A1B). The models are not tuned to temperature trends pre-2000.<\/li>\n<li> Differences between the temperature anomaly products is related to: different selections of input data, different methods for assessing urban heating effects, and (most important) different methodologies for estimating temperatures in data-poor regions like the Arctic. GISTEMP assumes that the Arctic is warming as fast as the stations around the Arctic, while HadCRUT3v and NCDC assume the Arctic is warming as fast as the global mean. The former assumption is more in line with the sea ice results and independent measures from buoys and the reanalysis products. <\/li>\n<li> Model-data comparisons are best when the metric being compared is calculated the same way in both the models and data. In the comparisons here, that isn&#8217;t quite true (mainly related to spatial coverage), and so this adds a little extra structural uncertainty to any conclusions one might draw.<\/li>\n<\/ul>\n<p><span id=\"cite_ITEM-10475-0\" name=\"citation\"><a href=\"#ITEM-10475-0\">Foster and Rahmstorf (2011)<\/a><\/span> showed nicely that if you account for some of the obvious factors affecting the global mean temperature (such as El Ni\u00f1os\/La Ni\u00f1as, volcanoes etc.) there is a strong and continuing trend upwards. An update to that analysis using the latest data is available <a href=\"http:\/\/tamino.wordpress.com\/2012\/01\/21\/2011-temperature-roundup\/\">here<\/a> &#8211; and shows the same continuing trend:<\/p>\n<p><img decoding=\"async\" data-src=\"http:\/\/tamino.files.wordpress.com\/2012\/01\/adjusted.jpg?w=500&#038;h=325\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" \/><\/p>\n<p>There will soon be a few variations on these results. Notably, we are still awaiting the update of the HadCRUT (HadCRUT4) product to incorporate the <a href=\"http:\/\/www.realclimate.org\/index.php\/archives\/2011\/07\/revisiting-historical-ocean-surface-temperatures\/\" title=\"Revisiting historical ocean surface temperatures\">new HadSST3 dataset<\/a> and the upcoming CRUTEM4 data which incorporates more high latitude data <span id=\"cite_ITEM-10475-1\" name=\"citation\"><a href=\"#ITEM-10475-1\">(Jones et al, 2012)<\/a><\/span>. These two changes will impact the 1940s-1950s temperatures, the earliest parts of the record, the last decade, and will likely affect the annual rankings (and yes, I know that this is not particularly significant, but people seem to care). <\/p>\n<p><strong> Ocean Heat Content<\/strong><\/p>\n<p>Figure 2 is the comparison of the ocean heat content (OHC) changes in the models compared to the latest <a href=\"http:\/\/www.nodc.noaa.gov\/OC5\/3M_HEAT_CONTENT\/\">data from NODC<\/a>. As before, I don&#8217;t have the post-2003 AR4 model output, so I have extrapolated the ensemble mean to 2012 (understanding that this is not ideal). New this year, are the OHC changes down to 2000m, as well as the usual top-700m record, which NODC has started to produce. For better comparisons, I have plotted the ocean model results from 0-750m and for the whole ocean. All curves are baselined to the period 1975-1989.<\/p>\n<p>I&#8217;ve left off the data from the <a href=\"http:\/\/www.realclimate.org\/index.php\/archives\/2010\/05\/ocean-heat-content-increases-update\">Lyman et al (2010) paper<\/a> for clarity, but note that there is some structural uncertainty in the OHC observations. Similarly, different models have different changes, and the other GISS model from AR4 (GISS-EH) had slightly less heat uptake than the model shown here. <\/p>\n<p><img decoding=\"async\" data-src=\"\/images\/ohc11.jpg\" width=90% src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" style=\"--smush-placeholder-width: 1117px; --smush-placeholder-aspect-ratio: 1117\/934;\" \/><br \/>\n<small><i>Update (May 2012): The figure has been corrected for an error in the model data scaling. The original image can still be seen <a href=\"\/images\/ohc11_incorrect.jpg\">here<\/a>.<\/i><\/small><\/p>\n<p>As can be seen the long term trends in the models match those in the data, but the short-term fluctuations are both noisy and imprecise <ins datetime=\"2012-05-22T11:34:50+00:00\">[Update: with the correction in the graph, this is less accurate a description. The extrapolations of the ensemble give OHC changes to 2011 that range from slightly greater than the observations, to quite a bit larger]<\/ins>. As an aside, there are a <a href=\"http:\/\/wattsupwiththat.com\/2012\/01\/26\/october-to-december-2011-nodc-ocean-heat-content-anomalies-0-700meters-update-and-comments\/\" rel=\"nofollow\">number of comparisons<\/a> floating around using only the post 2003 data to compare to the models. These are often baselined in such a way as to exaggerate the model data discrepancy (basically by picking a near-maximum and then drawing the linear trend in the models from that peak). This falls into the common trap of assuming that short term trends are predictive of long-term trends &#8211; they just aren&#8217;t (There is a nice explanation of the error <a href=\"http:\/\/tamino.wordpress.com\/2012\/01\/27\/fake-predictions-for-fake-skeptics\">here<\/a>).<\/p>\n<p><strong>Summer sea ice changes<\/strong> <\/p>\n<p>Sea ice changes this year were dramatic, with the Arctic September minimum reaching record (or near record) values (depending on the data product). Updating the <a href=\"http:\/\/www.cee.mtu.edu\/~reh\/papers\/pubs\/non_Honrath\/stroeve07_2007GL029703.pdf\">Stroeve et al, 2007<\/a> analysis (courtesy of Marika Holland) using the <a href=\"ftp:\/\/sidads.colorado.edu\/DATASETS\/NOAA\/G02135\/Sep\/N_09_area.txt\">NSIDC data<\/a> we can see that the Arctic continues to melt faster than any of the AR4\/CMIP3 models predicted.<\/p>\n<p><center><br \/>\n<img decoding=\"async\" data-src=\"\/images\/seaice11.jpg\" width=90% src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" style=\"--smush-placeholder-width: 1250px; --smush-placeholder-aspect-ratio: 1250\/967;\" \/><br \/>\n<\/center><\/p>\n<p>This may not be true for the CMIP5 simulations &#8211; but we&#8217;ll have a specific post on that another time. <\/p>\n<p><strong> Hansen et al, 1988 <\/strong><\/p>\n<p>Finally, we update the <a href=\"http:\/\/www.realclimate.org\/index.php\/archives\/2007\/05\/hansens-1988-projections\/\">Hansen et al (1988)<\/a> comparisons. Note that the old GISS model had a climate sensitivity that was a little higher (4.2\u00baC for a doubling of CO<sub>2<\/sub>) than the best estimate (~3\u00baC) and as stated in previous years, the actual forcings that occurred are not exactly the same as the different scenarios used. We noted in 2007, that Scenario B was running a little high compared with the forcings growth (by about 10%) using estimated forcings up to 2003 (Scenario A was significantly higher, and Scenario C was lower). <\/p>\n<p><img decoding=\"async\" data-src=\"\/images\/hansen11.jpg\" width=90% src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" style=\"--smush-placeholder-width: 2263px; --smush-placeholder-aspect-ratio: 2263\/1846;\" \/><\/p>\n<p>The trends for the period 1984 to 2011 (the 1984 date chosen because that is when these projections started), <a href=\"http:\/\/www.realclimate.org\/data\/scen_ABC_temp.data\">scenario B<\/a> has a trend of 0.28+\/-0.05\u00baC\/dec (95% uncertainties, no correction for auto-correlation). For the GISTEMP and HadCRUT3, the trends are 0.18+\/-0.05 and 0.17+\/-0.04\u00baC\/dec. For reference, the trends in the AR4 models for the same period have a range 0.21+\/-0.16 \u00baC\/dec (95%).<\/p>\n<p>As we stated before, the Hansen et al &#8216;B&#8217; projection is running warm compared to the real world (exactly how much warmer is unclear). As discussed in <span id=\"cite_ITEM-10475-2\" name=\"citation\"><a href=\"#ITEM-10475-2\">Hargreaves (2010)<\/a><\/span>, while this simulation was not perfect, it has shown skill in that it has out-performed any reasonable naive hypothesis that people put forward in 1988 (the most obvious being a forecast of no-change). However, the use of this comparison to refine estimates of climate sensitivity should be done cautiously, as the result is strongly dependent on the magnitude of the assumed forcing, which is itself uncertain. Recently there have been some updates to those forcings, and so my previous attempts need to be re-examined in the light of that data and the uncertainties (particular in the aerosol component). However, this is a complicated issue, and requires more space than I really have here to discuss, so look for this in an upcoming post.<\/p>\n<p>Overall, given the latest set of data points, we can conclude (once again) that global warming continues.<\/p>\n<h2>References<\/h2>\n    <ol>\n    <li><a name='ITEM-10475-0'><\/a>\nG. Foster, and S. Rahmstorf, \"Global temperature evolution 1979\u20132010\", <i>Environmental Research Letters<\/i>, vol. 6, pp. 044022, 2011. <a href=\"http:\/\/dx.doi.org\/10.1088\/1748-9326\/6\/4\/044022\">http:\/\/dx.doi.org\/10.1088\/1748-9326\/6\/4\/044022<\/a>\n\n\n<\/li>\n<li><a name='ITEM-10475-1'><\/a>\nP.D. Jones, D.H. Lister, T.J. Osborn, C. Harpham, M. Salmon, and C.P. Morice, \"Hemispheric and large\u2010scale land\u2010surface air temperature variations: An extensive revision and an update to 2010\", <i>Journal of Geophysical Research: Atmospheres<\/i>, vol. 117, 2012. <a href=\"http:\/\/dx.doi.org\/10.1029\/2011JD017139\">http:\/\/dx.doi.org\/10.1029\/2011JD017139<\/a>\n\n\n<\/li>\n<li><a name='ITEM-10475-2'><\/a>\nJ.C. Hargreaves, \"Skill and uncertainty in climate models\", <i>WIREs Climate Change<\/i>, vol. 1, pp. 556-564, 2010. <a href=\"http:\/\/dx.doi.org\/10.1002\/wcc.58\">http:\/\/dx.doi.org\/10.1002\/wcc.58<\/a>\n\n\n<\/li>\n<\/ol>\n\n<\/div> <!-- kcite-section 10475 -->","protected":false},"excerpt":{"rendered":"<p>And so it goes &#8211; another year, another annual data point. As has become a habit (2009, 2010), here is a brief overview and update of some of the most relevant model\/data comparisons. We include the standard comparisons of surface temperatures, sea ice and ocean heat content to the AR4 and 1988 Hansen et al [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":10801,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[5,1,27,3,9,161],"tags":[],"class_list":{"0":"post-10475","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-climate-modelling","8":"category-climate-science","9":"category-el-nino","10":"category-greenhouse-gases","11":"category-instrumental-record","12":"category-model-comp","13":"entry"},"aioseo_notices":[],"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/10475","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/comments?post=10475"}],"version-history":[{"count":25,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/10475\/revisions"}],"predecessor-version":[{"id":25817,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/10475\/revisions\/25817"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/media\/10801"}],"wp:attachment":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/media?parent=10475"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/categories?post=10475"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/tags?post=10475"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}