{"id":24710,"date":"2023-02-08T11:53:46","date_gmt":"2023-02-08T16:53:46","guid":{"rendered":"https:\/\/www.realclimate.org\/?p=24710"},"modified":"2023-02-11T14:22:57","modified_gmt":"2023-02-11T19:22:57","slug":"the-established-ground-and-new-ideas","status":"publish","type":"post","link":"https:\/\/www.realclimate.org\/index.php\/archives\/2023\/02\/the-established-ground-and-new-ideas\/","title":{"rendered":"The established ground and new ideas"},"content":{"rendered":"<div class=\"kcite-section\" kcite-section-id=\"24710\">\n\n<p>Science is naturally conservative and the scepticism to new ideas ensures high scientific quality. We have more confidence when different scholars arrive at the same conclusion independently of each other. But scientific research also brings about discoveries and innovations, and it typically takes time for such new understanding to receive acknowledgement and acceptance. In the meanwhile, it\u2019s uncertain whether they really represent progress or if they are misconceived ideas. Sometimes we can shed more light on new ideas through scientific discussions.<\/p>\n\n\n\n<!--more-->\n\n\n\n<p>I recently experienced the contrast between old knowledge and new ideas when my research group used a well-established mathematical concept in a new way. In this case, the mathematical concept is related to so-called <a href=\"https:\/\/en.wikipedia.org\/wiki\/Eigenfunction\"><em>eigenfunctions<\/em><\/a>, but in climate research known as <em>empirical orthogonal functions<\/em> (<a href=\"https:\/\/en.wikipedia.org\/wiki\/Empirical_orthogonal_functions\">EOFs<\/a>) and discussed earlier in a post here (\u2018<a href=\"https:\/\/www.realclimate.org\/index.php\/archives\/2020\/03\/why-not-use-a-clever-mathematical-trick\/\">Why not use a clever mathematical trick?<\/a>\u2019). I decided to elaborate on this idea through a <a href=\"https:\/\/egusphere.copernicus.org\/preprints\/2023\/egusphere-2022-1385\/\">discussion paper in EGUsphere<\/a> with an open review. It will hopefully lead to some scientific discussions that may tell me whether our new ideas represent a progress in terms of evaluating climate models.<\/p>\n\n\n\n<p>A motivation for this discussion paper was that it came as a surprise to me that it\u2019s rare that EOFs are applied to joint datasets, known as \u2018<em>common EOFs<\/em>\u2019. For instance, common EOFs are absent in the community-based <a href=\"https:\/\/www.esmvaltool.org\/\">ESMEvalTool<\/a> <span id=\"cite_ITEM-24710-0\" name=\"citation\"><a href=\"#ITEM-24710-0\">(Eyring et al., 2020)<\/a><\/span> despite their merits, something we discuss in our recent <a href=\"https:\/\/egusphere.copernicus.org\/preprints\/2023\/egusphere-2022-1385\/\">discussion paper<\/a> <span id=\"cite_ITEM-24710-1\" name=\"citation\"><a href=\"#ITEM-24710-1\">(Benestad et al., 2023)<\/a><\/span>.\u00a0Furthermore, text searches with \u201ccommon EOFs\u201d, \u201ccommon principal component\u201d and \u201ccommon empirical orthogonal functions\u201d through the <a href=\"https:\/\/report.ipcc.ch\/ar6\/wg1\/IPCC_AR6_WGI_FullReport.pdf\">full Working Group 1 report from the IPCC assessment report 6<\/a> (2409 pages) only gave one hit:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>Predictor patterns that are common to observations and climate model data can be defined by common empirical orthogonal functions (Benestad, 2011).<\/p>\n<\/blockquote>\n\n\n\n<p>On Google Scholar, the same search gave 116, 1680, 64 hits, and in this case, the higher number of hits for \u201ccommon principal component\u201d involved many more disciplines than climate research.&nbsp;<\/p>\n\n\n\n<p>So why bother with common EOFs? Bernhard Flury wrote a book in 1986 with the title \u2018Common principal components and related multivariate models\u2019 <a href=\"https:\/\/dl.acm.org\/doi\/book\/10.5555\/74760\" title=\"(Flury, 1986),\">(Flury, 1986)<\/a>, and a few other studies picked up the idea, such as a<a href=\"https:\/\/www.osti.gov\/biblio\/140929\"> report from 1993<\/a> and in <a href=\"https:\/\/doi.org\/10.1175\/1520-0442(1998)011<0816:UCPCFC&gt;2.0.CO;2\" title=\"Sengupta and Boyle (1998)\">Sengupta and Boyle (1998)<\/a>. I think common EOFs are a clever concept and have used them as a framework for empirical-statistical downscaling since 2001 <span id=\"cite_ITEM-24710-2\" name=\"citation\"><a href=\"#ITEM-24710-2\">(Benestad, 2001)<\/a><\/span>. In 2017, a group of colleagues and I wrote a perspective on the use of statistical methods in climate research where we also discussed common EOFs <span id=\"cite_ITEM-24710-3\" name=\"citation\"><a href=\"#ITEM-24710-3\">(Benestad et al., 2017)<\/a><\/span>.<\/p>\n\n\n\n<p>In the latest discussion paper, we highlighted several ways of using them to deal with large multi-model ensembles and huge data volumes, popularly known as \u201cBig data\u201d. They make use of the redundancy of information embedded within the data and boil it down to the most salient aspects. Also, common EOFs make it possible to take advantage of some attractive mathematical properties such as <a href=\"https:\/\/en.wikipedia.org\/wiki\/Orthogonality#:~:text=Orthogonality%20is%20a%20system%20design,other%20components%20of%20the%20system.\">orthogonality<\/a>. It is somewhat similar with Fourier series which too provide orthogonal components in addition to the ease to estimate any derivative and makes it simple to estimate the length of e.g. solar cycles <span id=\"cite_ITEM-24710-4\" name=\"citation\"><a href=\"#ITEM-24710-4\">(Benestad, 2005)<\/a><\/span>.<\/p>\n\n\n\n<p>So far, I haven\u2019t seen any arguments against the use of common EOFs. So why have common EOFs not been used more?<\/p>\n<h2>References<\/h2>\n    <ol>\n    <li><a name='ITEM-24710-0'><\/a>\nV. Eyring, L. Bock, A. Lauer, M. Righi, M. Schlund, B. Andela, E. Arnone, O. Bellprat, B. Br\u00f6tz, L. Caron, N. Carvalhais, I. Cionni, N. Cortesi, B. Crezee, E.L. Davin, P. Davini, K. Debeire, L. de Mora, C. Deser, D. Docquier, P. Earnshaw, C. Ehbrecht, B.K. Gier, N. Gonzalez-Reviriego, P. Goodman, S. Hagemann, S. Hardiman, B. Hassler, A. Hunter, C. Kadow, S. Kindermann, S. Koirala, N. Koldunov, Q. Lejeune, V. Lembo, T. Lovato, V. Lucarini, F. Massonnet, B. M\u00fcller, A. Pandde, N. P\u00e9rez-Zan\u00f3n, A. Phillips, V. Predoi, J. Russell, A. Sellar, F. Serva, T. Stacke, R. Swaminathan, V. Torralba, J. Vegas-Regidor, J. von Hardenberg, K. Weigel, and K. Zimmermann, \"Earth System Model Evaluation Tool (ESMValTool) v2.0 \u2013 an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP\", <i>Geoscientific Model Development<\/i>, vol. 13, pp. 3383-3438, 2020. <a href=\"http:\/\/dx.doi.org\/10.5194\/gmd-13-3383-2020\">http:\/\/dx.doi.org\/10.5194\/gmd-13-3383-2020<\/a>\n\n\n<\/li>\n<li><a name='ITEM-24710-1'><\/a>\nR.E. Benestad, A. Mezghani, J. Lutz, A. Dobler, K.M. Parding, and O.A. Landgren, \"Various ways of using Empirical Orthogonal Functions for Climate Model evaluation\", 2023. <a href=\"http:\/\/dx.doi.org\/10.5194\/egusphere-2022-1385\">http:\/\/dx.doi.org\/10.5194\/egusphere-2022-1385<\/a>\n\n\n<\/li>\n<li><a name='ITEM-24710-2'><\/a>\nR.E. Benestad, \"A comparison between two empirical downscaling strategies\", <i>International Journal of Climatology<\/i>, vol. 21, pp. 1645-1668, 2001. <a href=\"http:\/\/dx.doi.org\/10.1002\/joc.703\">http:\/\/dx.doi.org\/10.1002\/joc.703<\/a>\n\n\n<\/li>\n<li><a name='ITEM-24710-3'><\/a>\nR. Benestad, J. Sillmann, T.L. Thorarinsdottir, P. Guttorp, M.D.S. Mesquita, M.R. Tye, P. Uotila, C.F. Maule, P. Thejll, M. Drews, and K.M. Parding, \"New vigour involving statisticians to overcome ensemble fatigue\", <i>Nature Climate Change<\/i>, vol. 7, pp. 697-703, 2017. <a href=\"http:\/\/dx.doi.org\/10.1038\/NCLIMATE3393\">http:\/\/dx.doi.org\/10.1038\/NCLIMATE3393<\/a>\n\n\n<\/li>\n<li><a name='ITEM-24710-4'><\/a>\nR.E. Benestad, \"A review of the solar cycle length estimates\", <i>Geophysical Research Letters<\/i>, vol. 32, 2005. <a href=\"http:\/\/dx.doi.org\/10.1029\/2005GL023621\">http:\/\/dx.doi.org\/10.1029\/2005GL023621<\/a>\n\n\n<\/li>\n<\/ol>\n\n<\/div> <!-- kcite-section 24710 -->","protected":false},"excerpt":{"rendered":"<p>Science is naturally conservative and the scepticism to new ideas ensures high scientific quality. We have more confidence when different scholars arrive at the same conclusion independently of each other. But scientific research also brings about discoveries and innovations, and it typically takes time for such new understanding to receive acknowledgement and acceptance. In the [&hellip;]<\/p>\n","protected":false},"author":11,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[1,38,45],"tags":[],"class_list":{"0":"post-24710","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-climate-science","7":"category-scientific-practice","8":"category-statistics","9":"entry"},"aioseo_notices":[],"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/24710","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/comments?post=24710"}],"version-history":[{"count":25,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/24710\/revisions"}],"predecessor-version":[{"id":24737,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/posts\/24710\/revisions\/24737"}],"wp:attachment":[{"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/media?parent=24710"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/categories?post=24710"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.realclimate.org\/index.php\/wp-json\/wp\/v2\/tags?post=24710"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}