{"id":19012,"date":"2016-02-09T21:32:43","date_gmt":"2016-02-10T02:32:43","guid":{"rendered":"http:\/\/www.realclimate.org\/?p=19012"},"modified":"2016-03-14T13:48:48","modified_gmt":"2016-03-14T18:48:48","slug":"marvel-et-al-2015-part-iii-response-to-nic-lewis","status":"publish","type":"post","link":"https:\/\/www.realclimate.org\/index.php\/archives\/2016\/02\/marvel-et-al-2015-part-iii-response-to-nic-lewis\/","title":{"rendered":"Marvel et al (2015) Part III: Response to Nic Lewis"},"content":{"rendered":"
\n

The first post<\/a> in this series gave the basic summary of Marvel et al (2015)<\/a><\/span> (henceforth MEA15) and why I think it is an important paper. The second discussed<\/a> some of the risible immediate media coverage. But there has also been an ‘appraisal’ of the paper by Nic Lewis that has appeared in no fewer than three other climate blogs (you can guess which). This is a response to the more interesting of his points.<\/p>\n

<\/p>\n

As is usual when people try too hard to delegitimise an approach or a paper, the criticisms tend to be a rag-bag of conceptual points, trivialities and, often, confused mis-readings – so it proves in this case. Nonetheless, no paper is ever totally complete, and there are often additional sensitivity tests that could have been added and further clarifications on the methodology would be useful. Indeed, sometimes there are even choices that in retrospect would have been chosen differently and, yay, even errors. Understanding what impact that might have on the paper’s conclusions are interesting things to explore in a blog since they rarely reach a level that would necessitate another paper.<\/p>\n

Lewis enumerates 6 supposedly fundamental problems<\/a> in the paper. To paraphrase, they are as follows:<\/p>\n

    \n
  1. MEA15 is working with the wrong definition of climate sensitivity.<\/li>\n
  2. All previous papers using the historical records to constrain ECS are only constraining ‘effective’ climate sensitivity which is smaller than ECS. <\/li>\n
  3. MEA15 used the wrong iRF and ERF values for F2xCO2<\/sub>. <\/li>\n
  4. MEA15 shouldn’t have used ocean heat content data (or should have done so differently). <\/li>\n
  5. The regressions in MEA15 in the iRF case should have been forced to go through zero. <\/li>\n
  6. The linearity of the different forcings is only approximate. <\/li>\n<\/ol>\n

    Point 1 is a misunderstanding of the concept of climate sensitivity and in any case would apply to every single paper being discussed including Lewis and Curry and Otto et al. It has nothing to do with whether those papers give reliable results. Point 2 begs the question entirely (why do analyses of transient simulations under-estimate ECS?). Point 3 is worth discussing in more detail and we do so below. Point 4 (on the OHC) misunderstands that MEA15 were trying to assess whether real world analyses give the right result. Using TOA radiative imbalances instead of ocean heat uptake (which cannot be directly observed with sufficient precision) would be pointless. But there are different ways to treat the OHC and we return to that below. Point 5 is easily tested and found not to matter in the slightest (as could easily be inferred from the graphs). Point 6 is freely admitted to, indeed, we already wrote a paper on that exact issue (Marvel et al, 2015a)<\/a><\/span>. It makes no difference to our conclusion since the breakdown into single forcings is in order to explain the fact that the historical all-forcing runs have a lower slope than the GHG or CO2<\/sub> responses, and for that, the accuracy of the linearity assumption is totally adequate.<\/p>\n

    In making his points, Lewis makes a number of errors that all go the way of making his points superficially more plausible. He conflates different model versions (fully interactive simulations in Shindell et al (the p3 runs in CMIP5), with the non-interactive runs used in MEA15 (p1 runs)), and different forcing definitions (Fi and Fa). His calculations didn’t use the decadal mean forcings\/responses that were used in MEA15 and thus he ‘found’ a -0.29 W\/m2<\/sup> ‘error’ in our graphs. [Despite having been told of this error weeks ago, no acknowledgement of this mistake has been made on any of the original posts].<\/p>\n

    I should be clear that we are not claiming infallibility and with ever-closer readings of the paper we have found a few errors and typos ourselves which we will have corrected in the final printed version of the paper. For instance…<\/p>\n

    The F2xCO2<\/sub> value<\/strong><\/p>\n

    In MEA15 we used a nominal F2xCO2<\/sub> in equation 2 of 4.1 W\/m2<\/sup> to scale the slopes seen in Fig. 1 to a TCR and ECS for 2xCO2. This is strictly the stratospherically adjusted forcing (Schmidt et al, 2014)<\/a><\/span> and was thus incorrectly described and incorrectly referenced in the paper [we have notified the Nature Climate Change<\/em> editors of this and it will be corrected]. In our internal tests the difference the exact value made was small and we used a single value in the iRF and ERF cases. In retrospect, this was an inconsistent choice. A better choice would have been to use, separately, the iRF and ERF values in the two cases, namely 4.5 W\/m2<\/sup> and 4.3 W\/m2<\/sup>. As can be seen in the update to our online material<\/a> the redone Figs 1 and 2, with these choices still show the same results:<\/p>\n


    \n
    \n
    \n<\/center><\/p>\n

    The bottom line conclusions are unchanged: taking account of the efficacies makes the resulting estimates for sensitivity larger. The likely ranges for the corrected analyses are slightly affected however. <\/p>\n

    Sensitivity studies<\/strong><\/p>\n

    There are a couple of questions that have been raised that do bear further exploration. Would it make a difference if you used stratospherically adjusted forcings (Fa<\/sub>\/RF in the IPCC AR5)? What if you account for the additional energy storage (apart from the ocean) in the system? These are relatively easy to do (though we did need to calculate the Fa<\/sub> terms<\/a>). <\/p>\n

    The bottom line is that using adjusted forcings or assuming that ocean heat uptake is only 94% of the energy imbalance makes no qualitative difference<\/a> at all. <\/p>\n

    Additional criticisms<\/strong><\/p>\n

    Lewis in subsequent comments has claimed without evidence that land use was not properly included<\/a> in our historical runs [Update: This was indeed true for one of the forcing calculations]<\/ins>, and that there must be an error<\/a> in the model radiative transfer. He has also suggested that it is statistically permissible to eliminate outliers in the ensembles because he doesn’t like the result (it is not). These are mostly<\/ins> simply post hoc justifications for not wanting to accept the results.<\/p>\n

    Summary<\/strong><\/p>\n

    When there are results that have implications for a broad swath of other papers, it’s only right that the results are examined closely. Lewis’ appraisal has indeed turned up one error<\/del> two errors<\/ins>, and suggested further sensitivity experiments, which have both ended up strengthening the robustness of the basic result. The conclusion remains that sensitivity calculations which assume the efficacies of each forcing must be exactly 1, with no uncertainty, are simply no longer credible. <\/p>\n

    As we stated in the paper, this is a result from a single model and given that all models are flawed, it really needs to be reproduced by some other groups. What prevents that is the lack of thorough calculations of the net and individual forcings in the other climate models. Hopefully some of this discussion might prompt this effort elsewhere.<\/p>\n

    We wrote the paper to be ecumenical with respect to the estimates of 20th Century forcings – hence we just took 3 previously published sets of estimates at face value and applied the efficacies calculated in two (now three) different ways to their calculations. If one was to redo those papers, you would choose the efficacies most relevant to their calculations (i.e. the ERF derived values for Otto et al<\/a><\/span>) along with their adjustment for the ocean heat uptake (in our sensitivity test), and conclude that instead of an ECS of 2.0\u00baC [likely range 1.4-3.2], you’d get 3.0\u00baC [likely range 1.8-6.2]. A result far more consistent with other lines of evidence.<\/p>\n

    References<\/h2>\n
      \n
    1. <\/a>\nK. Marvel, G.A. Schmidt, R.L. Miller, and L.S. Nazarenko, \"Implications for climate sensitivity from the response to individual forcings\", Nature Climate Change<\/i>, vol. 6, pp. 386-389, 2015. http:\/\/dx.doi.org\/10.1038\/nclimate2888<\/a>\n\n\n<\/li>\n
    2. <\/a>\nK. Marvel, G.A. Schmidt, D. Shindell, C. Bonfils, A.N. LeGrande, L. Nazarenko, and K. Tsigaridis, \"Do responses to different anthropogenic forcings add linearly in climate models?\", Environmental Research Letters<\/i>, vol. 10, pp. 104010, 2015. http:\/\/dx.doi.org\/10.1088\/1748-9326\/10\/10\/104010<\/a>\n\n\n<\/li>\n
    3. <\/a>\nG.A. Schmidt, M. Kelley, L. Nazarenko, R. Ruedy, G.L. Russell, I. Aleinov, M. Bauer, S.E. Bauer, M.K. Bhat, R. Bleck, V. Canuto, Y. Chen, Y. Cheng, T.L. Clune, A. Del Genio, R. de Fainchtein, G. Faluvegi, J.E. Hansen, R.J. Healy, N.Y. Kiang, D. Koch, A.A. Lacis, A.N. LeGrande, J. Lerner, K.K. Lo, E.E. Matthews, S. Menon, R.L. Miller, V. Oinas, A.O. Oloso, J.P. Perlwitz, M.J. Puma, W.M. Putman, D. Rind, A. Romanou, M. Sato, D.T. Shindell, S. Sun, R.A. Syed, N. Tausnev, K. Tsigaridis, N. Unger, A. Voulgarakis, M. Yao, and J. Zhang, \"Configuration and assessment of the GISS ModelE2 contributions to the CMIP5 archive\", Journal of Advances in Modeling Earth Systems<\/i>, vol. 6, pp. 141-184, 2014. http:\/\/dx.doi.org\/10.1002\/2013MS000265<\/a>\n\n\n<\/li>\n
    4. <\/a>\nA. Otto, F.E.L. Otto, O. Boucher, J. Church, G. Hegerl, P.M. Forster, N.P. Gillett, J. Gregory, G.C. Johnson, R. Knutti, N. Lewis, U. Lohmann, J. Marotzke, G. Myhre, D. Shindell, B. Stevens, and M.R. Allen, \"Energy budget constraints on climate response\", Nature Geoscience<\/i>, vol. 6, pp. 415-416, 2013. http:\/\/dx.doi.org\/10.1038\/ngeo1836<\/a>\n\n\n<\/li>\n<\/ol>\n\n<\/div> ","protected":false},"excerpt":{"rendered":"

      The first post in this series gave the basic summary of (henceforth MEA15) and why I think it is an important paper. The second discussed some of the risible immediate media coverage. But there has also been an ‘appraisal’ of the paper by Nic Lewis that has appeared in no fewer than three other climate […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[17,5,1,3,9],"tags":[],"class_list":{"0":"post-19012","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-aerosols","7":"category-climate-modelling","8":"category-climate-science","9":"category-greenhouse-gases","10":"category-instrumental-record","11":"entry"},"aioseo_notices":[],"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/19012","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/comments?post=19012"}],"version-history":[{"count":12,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/19012\/revisions"}],"predecessor-version":[{"id":19275,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/19012\/revisions\/19275"}],"wp:attachment":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/media?parent=19012"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/categories?post=19012"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/tags?post=19012"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}