{"id":564,"date":"2008-05-11T21:23:30","date_gmt":"2008-05-12T02:23:30","guid":{"rendered":"http:\/\/www.realclimate.org\/index.php\/archives\/2008\/05\/what-the-ipcc-models-really-say\/"},"modified":"2025-01-26T13:46:24","modified_gmt":"2025-01-26T18:46:24","slug":"what-the-ipcc-models-really-say","status":"publish","type":"post","link":"https:\/\/www.realclimate.org\/index.php\/archives\/2008\/05\/what-the-ipcc-models-really-say\/","title":{"rendered":"What the IPCC models really say <lang_sp>Lo que dicen realmente los modelos del IPCC<\/lang_sp><lang_it>Cosa dicono realmente i modelli dell\u2018IPCC<\/lang_it>"},"content":{"rendered":"<div class=\"kcite-section\" kcite-section-id=\"564\">\n<p>Over the last couple of months there has been much blog-viating about what the models used in the <a href=\"http:\/\/ipcc-wg1.ucar.edu\/wg1\/wg1-report.html\">IPCC 4th Assessment Report<\/a> (AR4) do and do not predict about natural variability in the presence of a long-term greenhouse gas related trend. Unfortunately, much of the discussion has been based on graphics, energy-balance models and descriptions of what the forced component is, rather than the full ensemble from the coupled models. That has lead to some rather excitable but ill-informed buzz about very short time scale tendencies. We have already <a href=\"http:\/\/www.realclimate.org\/index.php\/archives\/2008\/01\/uncertainty-noise-and-the-art-of-model-data-comparison\/\">discussed<\/a> how short term analysis of the data can be misleading, and we have previously commented on the use of the uncertainty in the ensemble mean being confused with the envelope of possible trajectories (<a href=\"http:\/\/www.realclimate.org\/index.php\/archives\/2007\/12\/tropical-troposphere-trends\/\">here<\/a>). The actual <a href=\"http:\/\/www-pcmdi.llnl.gov\/ipcc\/about_ipcc.php\">model outputs<\/a> have been <a href=\"http:\/\/www.realclimate.org\/index.php\/archives\/2008\/02\/ipcc-archive\/\">available<\/a> for a long time, and it is somewhat surprising that no-one has looked specifically at it given the attention the subject has garnered. So in this post we will examine directly what the individual model simulations actually show.<\/p>\n<p><lang_sp>Una traducci\u00f3n est\u00e1 disponible <a href=\"http:\/\/www.globalizate.org\/realclimate180508.html\">aqu\u00ed<\/a><\/lang_sp><br \/>\n<lang_it>Una traduzione in italiano \u00e8 disponibile <a href=\"http:\/\/www.climalteranti.it\/?page_id=44#modelliipcc\">qui<\/a><\/lang_it><br \/>\n<!--more--><br \/>\nFirst,  what does the spread of simulations look like? The following figure plots the global mean temperature  anomaly for 55 individual realizations of the 20th Century and their continuation for the 21st Century following the SRES A1B scenario. For our purposes this scenario is close enough to the actual forcings over recent years for it to be a valid approximation to the simulations up to the present and probable future. The equal weighted ensemble mean is plotted on top. This isn&#8217;t quite what IPCC plots (since they average over single model ensembles before averaging across models) but in this case the difference is minor. <\/p>\n<p><img decoding=\"async\" data-src=\"\/images\/runs.jpg\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" style=\"--smush-placeholder-width: 556px; --smush-placeholder-aspect-ratio: 556\/452;\" \/><\/p>\n<p>It should be clear from the above the plot that the long term trend (the global warming signal) is robust, but it is equally obvious that the short term behaviour of any individual realisation is not. This is the impact of the uncorrelated stochastic variability (weather!) in the models that is associated with interannual and interdecadal modes in the models &#8211; these can be associated with tropical Pacific variability or fluctuations in the ocean circulation for instance. Different models have different magnitudes of this variability that spans what can be inferred from the observations and in a more sophisticated analysis you would want to adjust for that. For this post however, it suffices to just use them &#8216;as is&#8217;. <\/p>\n<p>We can characterise the variability very easily by looking at the range of regressions (linear least squares) over various time segments and plotting the distribution. This figure shows the results for the period 2000 to 2007 and for 1995 to 2014 (inclusive) along with a Gaussian fit to the distributions. These two periods were chosen since they correspond with some previous analyses. The mean trend (and mode) in both cases is around 0.2\u00baC\/decade (as has been widely discussed) and there is no significant difference between the trends over the two periods. There is of course a big difference in the standard deviation &#8211; which depends strongly on the length of the segment. <\/p>\n<p><img decoding=\"async\" data-src=\"\/images\/trends_dist.jpg\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" style=\"--smush-placeholder-width: 542px; --smush-placeholder-aspect-ratio: 542\/473;\" \/><\/p>\n<p>Over the short 8 year period, the regressions range from -0.23\u00baC\/dec to 0.61\u00baC\/dec. Note that this is over a period with no volcanoes, and so the variation is predominantly internal (some models have solar cycle variability included which will make a small difference).  The model with the largest trend has a range of -0.21 to 0.61\u00baC\/dec in 4 different realisations, confirming the role of internal variability. 9 simulations out of 55 have negative trends over the period. <\/p>\n<p>Over the longer period, the distribution becomes tighter, and the range is reduced to -0.04 to 0.42\u00baC\/dec. Note that even for a 20 year period, there is one realisation that has a negative trend. For that model, the 5 different realisations give a range of trends of -0.04 to 0.19\u00baC\/dec.<\/p>\n<p>Therefore: <\/p>\n<ul>\n<li><a href=\"http:\/\/climatesci.org\/2008\/05\/01\/comments-on-the-new-york-times-article-decade-break-in-global-warming-may-01-2008\/\">Claims<\/a> that GCMs project monotonic rises in temperature with increasing greenhouse gases are not valid. Natural variability does not disappear because there is a long term trend. The ensemble mean <em>is<\/em> monotonically increasing in the absence of large volcanoes, but this is the forced component of climate change, not a single realisation or anything that could happen in the real world.<\/li>\n<li>Claims that a negative observed trend over the last 8 years would be inconsistent with the models cannot be supported. Similar claims that the IPCC projection of about 0.2\u00baC\/dec over the next few decades would be falsified with such an observation are equally bogus.<\/li>\n<li>Over a twenty year period, you would be on stronger ground in arguing that a negative trend would be outside the 95% confidence limits of the expected trend (the one model run in the above ensemble suggests that would only happen ~2% of the time). <\/li>\n<\/ul>\n<p>A related question that comes up is how often we should expect a global mean temperature record to be broken. This too is a function of the natural variability (the smaller it is, the sooner you expect a new record). We can examine the individual model runs to look at the distribution. There is one wrinkle here though which relates to the uncertainty in the observations. For instance, while the <a href=\"http:\/\/data.giss.nasa.gov\/gistemp\">GISTEMP<\/a> series has 2005 being slightly warmer than 1998, that is not the case in the HadCRU data. So what we are really interested in is the waiting time to the next unambiguous record i.e. a record that is at least 0.1\u00baC warmer than the previous one (so that it would be clear in all observational datasets). That is obviously going to take a longer time.<\/p>\n<p>This figure shows the cumulative distribution of waiting times for new records in the models starting from 1990 and going to 2030. The curves should be read as the percentage of new records that you would see if you waited X years. The two curves are for a new record of any size (black) and for an unambiguous record (&gt; 0.1\u00baC above the previous, red). The main result is that 95% of the time, a new record will be seen within 8 years, but that for an unambiguous record, you need to wait for 18 years to have a similar confidence.  As I mentioned above, this result is dependent on the magnitude of natural variability which varies over the different models. Thus the real world expectation would not be exactly what is seen here, but this is probably reasonably indicative.  <\/p>\n<p><img decoding=\"async\" data-src=\"\/images\/records.jpg\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" class=\"lazyload\" style=\"--smush-placeholder-width: 557px; --smush-placeholder-aspect-ratio: 557\/457;\" \/><\/p>\n<p>We can also look at how the <a href=\"http:\/\/www.realclimate.org\/index.php\/archives\/2008\/05\/global-cooling-wanna-bet\/\">Keenlyside et al<\/a> results compare to the natural variability in the standard (un-initiallised) simulations. In their experiments, the decadal mean of the period 2001-2010 and 2006-2015 are cooler than 1995-2004 (using the closest approximation to their results with only annual data). In the IPCC runs, this only happens in one simulation, and then only for the first decadal mean, not the second. This implies that there may be more going on than just the tapping into the internal variability in their model. We can specifically look at the same model in the un-initiallised runs. There, the differences between first decadal means spans the range 0.09 to 0.19\u00baC &#8211; significantly above zero. For the second period, the range is 0.16 to 0.32 \u00baC. One could speculate that there is actually a cooling that is implicit to their initialisation process itself. It would be instructive to try some similar &#8216;perfect model&#8217; experiments (where you try and replicate another model run rather than the real world) to investigate this further though.<\/p>\n<p>Finally, I would just like to emphasize that for many of these examples, claims have circulated about the spectrum of the IPCC model responses without anyone actually looking at what those responses are. Given that the archive of these models exists and is publicly available, there is no longer any excuse for this. Therefore, if you want to make a claim about the IPCC model results, download them first! <\/p>\n<p><small> Much thanks to Sonya Miller for producing these means from the IPCC archive.<\/small><\/p>\n<hrule \/>\n<small><strong>Update:<\/strong> Since some people have asked, the test for consistency (at 95% confidence) between the ranges seen in the models in figure 2 and real world trends is that the difference in means must be less than the twice the pooled standard deviation (and since the pooled s.d. is always larger than the s.d. in the models alone, it is trivially true that if the observed mean trend is within the 95% range of the models, it is consistent). See <a href=\"http:\/\/www.gfdl.noaa.gov\/reference\/bibliography\/2005\/jrl0501.pdf\">Lanzante 2005<\/a> for more info. All observational global SAT trends pass that test.  Under no reasonable circumstances is an 8 year trend of -10 deg C\/decade (that is 48 s.d. away from the mean) or even -1 deg C\/decade going to be consistent with the models. For 7 year trends (beginning of 2001 to end of 2007), the model spread is approximately N(0.2,0.24) in deg C\/dec &#8211; a little wider than the 8 year trends seen in the figure and there are 10 model simulations with negative trends.<\/small><\/p>\n<!-- kcite active, but no citations found -->\n<\/div> <!-- kcite-section 564 -->","protected":false},"excerpt":{"rendered":"<p>Over the last couple of months there has been much blog-viating about what the models used in the IPCC 4th Assessment Report (AR4) do and do not predict about natural variability in the presence of a long-term greenhouse gas related trend. Unfortunately, much of the discussion has been based on graphics, energy-balance models and descriptions [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[5,1,23,161],"tags":[],"class_list":{"0":"post-564","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-climate-modelling","7":"category-climate-science","8":"category-ipcc","9":"category-model-comp","10":"entry"},"aioseo_notices":[],"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/564","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/comments?post=564"}],"version-history":[{"count":1,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/564\/revisions"}],"predecessor-version":[{"id":25888,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/564\/revisions\/25888"}],"wp:attachment":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/media?parent=564"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/categories?post=564"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/tags?post=564"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}