• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer

RealClimate

Climate science from climate scientists...

  • Start here
  • Model-Observation Comparisons
  • Miscellaneous Climate Graphics
  • Surface temperature graphics
You are here: Home / Archives for Climate Science / Climate modelling

Climate modelling

How not to science

5 Mar 2023 by Gavin

A trip down memory lane and a lesson on scientific integrity.

I had reason to be reviewing the history of MSU satellite retrievals for atmospheric temperatures recently. It’s a fascinating story of technology, creativity, hubris, error, imagination, rivalry, politics, and (for some) a search for scientific consilience – worthy of movie script perhaps? – but I want to highlight a minor little thing. Something so small that I’d never noticed it before, and I don’t recall anyone else pointing it out, but it is something I find very telling.

The story starts in the early 90’s, but what caught my eye was a single line in an op-ed (sub. req.) written two decades later:

… in 1994 we published an article in the journal Nature showing that the actual global temperature trend was “one-quarter of the magnitude of climate model results.”McNider and Christy, Feb 19th 2014, Wall Street Journal

Most of the op-ed is a rather tired rehash of faux outrage based on a comment made by John Kerry (the then Secretary of State) and we can skip right past that. It’s only other claim of note is a early outing of John Christy’s misleading graphs comparing the CMIP5 models to the satellite data but we’ll get back to that later.

First though, let’s dig into that line. The 1994 article is a short correspondence piece in Nature, where Christy and McNider analyzed MSU2R lower troposphere dataset and using ENSO and stratospheric volcanic effects to derive an ‘underlying’ global warming trend of 0.09 K/decade. This was to be compared with “warming rates of 0.3 to 0.4 K/decade” from models which was referenced to Manabe et al. (1991) and Boer et al. (1992). Hence the “one quarter” claim.

But lets dig deeper into each of those elements in turn. First, 1994 was pretty early on in terms of MSU science. The raw trend in the (then Version C) MSU2R record from 1979-1993 was -0.04 K/decade. [Remember ‘satellite cooling’?]. This was before Wentz and Schabel (1998) pointed out that orbital decay in the NOAA satellites was imparting a strong cooling bias (about 0.12 K/decade) on the MSU2R (TLT) record. Secondly, the two cited modeling papers don’t actually give an estimated warming trends for the 1980s and early 90s. The first is a transient model run using a canonical 1% increasing CO<sub>2</sub> – a standard experiment, but not one intended to match the real world growth of CO2 concentrations. The second model study is a simple equilibrium 2xCO2 run with the Canadian climate model, and does not report relevant transient warming rates at all. This odd referencing was pointed out in correspondence with Spencer and Christy by Hansen et al. (1995) who also noted that underlying model SAT trends for the relevant period were expected to be more like 0.1-0.15 K/decade. So the claim that the MSU temperatures were warming at “one quarter” the rate of the models wasn’t even valid in 1994. They might have more credibly claimed “two thirds” the rate, but the uncertainties are such that no such claim would have been robust (for instance, just the uncertainties on the linear regression alone are ~ +/-0.14 K/dec).

This image has an empty alt attribute; its file name is mcnider55-253x600.png
Replication of the Christy and McNider calculation and figure from 1994 but using the UAH v5.5 data.

But it gets worse. In 2014, McNider and Christy were well aware of the orbital decay correction (1998), and they were even aware of the diurnal drift correction that was needed because of a sign error introduced while trying to fix the orbital decay issue (discovered in 2005). The version of the MSU2R product at the beginning of 2014 was version 5.5, and that had a raw trend of -0.01 K/decade 1979-1993 (+/- 0.18 K/dec 95% CI, natch). Using an analogous methodology to that used in 1994 (see figure to the right), the underlying linear trend after accounting for ENSO and volcanic aerosols was…. 0.15 K/dec! Almost identical to the expected trend from models!

So not only was their original claim incorrect at the time, but had they repeated the analysis in 2014, their own updated data and method would have shown that there was no discrepancy at all.

Now in 2014, there was a longer record and more suitable models to compare to. Models had been run with appropriate volcanic forcings and in large enough ensembles that there was a quantified spread of expected trends. Comparisons could now be done in a more sophisticated away, that compared like with like and took account of many different elements of uncertainty (forcings, weather, structural effects in models and observations etc.). But McNider and Christy chose not to do that.

Instead, they chose to hide the structural uncertainty in the MSU retrievals (the TMT trends for 1979-2013 in UAH v5.5 and RSS v3.3 were 0.04 and 0.08 +/- 0.05 K/dec respectively – a factor of two different!), and ignore the spread in the CMIP5 models TMT trends [0.08,0.36] and graph it in a way as to maximise the visual disparity in a frankly misleading way. Additionally, they decided to highlight the slower warming TMT records instead of the TLT record they had discussed in 1994. For contrast, the UAH v5.5 TLT trends for 1979-2013 were 0.14± 0.05 K/dec.

But all these choices were made in the service of rhetoric, not science, to suggest that models are, and had always been, wrong, and that the UAH MSU data had always been right. A claim moreover that is totally backwards.

Richard Feynman often spoke about a certain kind of self-critical integrity as being necessary to do credible science. That kind of integrity was in very short supply in this op-ed.

References

  1. J.R. Christy, and R.T. McNider, "Satellite greenhouse signal", Nature, vol. 367, pp. 325-325, 1994. http://dx.doi.org/10.1038/367325a0
  2. F.J. Wentz, and M. Schabel, "Effects of orbital decay on satellite-derived lower-tropospheric temperature trends", Nature, vol. 394, pp. 661-664, 1998. http://dx.doi.org/10.1038/29267
  3. J. Hansen, H. Wilson, M. Sato, R. Ruedy, K. Shah, and E. Hansen, "Satellite and surface temperature data at odds?", Climatic Change, vol. 30, pp. 103-117, 1995. http://dx.doi.org/10.1007/BF01093228

Filed Under: Climate modelling, Climate Science, Featured Story, Instrumental Record, Scientific practice Tagged With: John Christy, MSU, Satellite temperature

2022 updates to model-observation comparisons

3 Feb 2023 by Gavin

Our annual post related to the comparisons between long standing records and climate models.

As frequent readers will know, we maintain a page of comparisons between climate model projections and the relevant observational records, and since they are mostly for the global mean numbers, these get updated once the temperature products get updated for the prior full year. This has now been completed for 2022.

[Read more…] about 2022 updates to model-observation comparisons

Filed Under: Climate modelling, Climate Science, Featured Story, Instrumental Record, Model-Obs Comparisons Tagged With: CMIP, SAT, TMT

Scafetta comes back for more

10 Oct 2022 by Gavin

A new paper from Scafetta and it’s almost as bad as the last one.

Back in March, we outlined how a model-observations comparison paper in GRL by Nicola Scafetta (Scafetta, 2022a) got wrong basically everything that one could get wrong (the uncertainty in the observations, the internal variability in the models, the statistical basis for comparisons – the lot!). Now he’s back with a new paper in a different journal (Scafetta, 2022b) that could be seen as trying to patch the holes in the first one, but while he makes some progress, he now adds some new errors while attempting CPR on his original conclusions.

[Read more…] about Scafetta comes back for more

References

  1. N. Scafetta, "Advanced Testing of Low, Medium, and High ECS CMIP6 GCM Simulations Versus ERA5‐T2m", Geophysical Research Letters, vol. 49, 2022. http://dx.doi.org/10.1029/2022GL097716
  2. N. Scafetta, "CMIP6 GCM ensemble members versus global surface temperatures", Climate Dynamics, vol. 60, pp. 3091-3120, 2022. http://dx.doi.org/10.1007/s00382-022-06493-w

Filed Under: Climate modelling, Climate Science, El Nino, Featured Story, Instrumental Record, Scientific practice, statistics Tagged With: CMIP6, misinformation, Scafetta

New misguided interpretations of the greenhouse effect from William Kininmonth

1 Oct 2022 by rasmus

I have a feeling that we are seeing the start of a new wave of climate change denial and misrepresentation of science. At the same time, CEOs of gas and oil companies express optimism for further exploitation of fossil energy in the wake of Russia’s invasion of Ukraine, at least here in Norway.

Another clue is William Kininmonth’s ‘rethink’ on the greenhouse effect for The Global Warming Policy Foundation. He made some rather strange claims, such as that the Intergovernmental Panel on Climate  Change (IPCC) allegedly should have forgotten that the earth is a sphere because “most absorption of solar radiation takes place over the tropics, while there is excess emission of longwave radiation to space over higher latitudes”. 

[Read more…] about New misguided interpretations of the greenhouse effect from William Kininmonth

Filed Under: Climate modelling, Climate Science, Communicating Climate, Greenhouse gases, IPCC, Scientific practice, skeptics Tagged With: climate change, co2, greenhouse warming

Watching the detections

25 Sep 2022 by Gavin

The detection and the attribution of climate change are based on fundamentally different frameworks and shouldn’t be conflated.

We read about and use the phrase ‘detection and attribution’ of climate change so often that it seems like it’s just one word ‘detectionandattribution’ and that might lead some to think that it is just one concept. But it’s not.

[Read more…] about Watching the detections

Filed Under: Climate impacts, Climate modelling, Climate Science, climate services, Featured Story, heatwaves, Instrumental Record, IPCC, statistics Tagged With: attribution, detection, extreme events

Overselling k-scale? Hmm

29 Jun 2022 by group

Some of the authors of a recent commentary on k-scale modeling respond to RealClimate.

[Read more…] about Overselling k-scale? Hmm

Filed Under: Climate impacts, Climate modelling, Climate Science, Featured Story, Oceans, Scientific practice Tagged With: k-scale

Mmm-k scale climate models

25 Jun 2022 by Gavin

Ocean eddy visualization (Karsten Schnieder)

What’s good (and what’s not quite ready) about plans for ‘k-scale’ climate modeling?

[Read more…] about Mmm-k scale climate models

Filed Under: Climate modelling, Climate Science, climate services, El Nino, Featured Story, Greenhouse gases Tagged With: CMIP6, digital twins, k-scale

Digital Twinge

28 Apr 2022 by Gavin

A couple of weeks ago the EU announced that they were funding a project called DestinE (Destination Earth) to build ‘digital twins’ of the Earth System to support policy making and rapid reaction to weather and climate events.

While the term ‘digitial twin’ has a long history in the engineering world, it’s only recently been applied to Earth System Modeling, and is intended (I surmise, as does Bryan Lawrence) to denote something more than the modeling of either weather or climate that we’ve been doing for years. But what exactly? And is it an achievable goal or just a rebranding effort of things that are happening anyway?

[Read more…] about Digital Twinge

Filed Under: Climate impacts, Climate modelling, Climate Science, climate services, Featured Story, Instrumental Record Tagged With: cloud computing, DestinE, digital twin

Issues and Errors in a new Scafetta paper

30 Mar 2022 by Gavin

Earlier this week, a new paper appeared in GRL by Nicola Scafetta (Scafetta, 2022) which purported to conclude that the CMIP6 models with medium or high climate sensitivity (higher than 3ºC) were not consistent with recent historical temperature changes. Since there have been a number of papers already on this topic, notably Tokarska et al (2020), which did not come to such a conclusion, it is worthwhile to investigate where Scafetta’s result comes from. Unfortunately, it appears to emerge from a mis-appreciation of what is in the CMIP6 archive, an inappropriate statistical test, and a total neglect of observational uncertainty and internal variability.

[Read more…] about Issues and Errors in a new Scafetta paper

References

  1. N. Scafetta, "Advanced Testing of Low, Medium, and High ECS CMIP6 GCM Simulations Versus ERA5‐T2m", Geophysical Research Letters, vol. 49, 2022. http://dx.doi.org/10.1029/2022GL097716
  2. K.B. Tokarska, M.B. Stolpe, S. Sippel, E.M. Fischer, C.J. Smith, F. Lehner, and R. Knutti, "Past warming trend constrains future warming in CMIP6 models", Science Advances, vol. 6, 2020. http://dx.doi.org/10.1126/sciadv.aaz9549

Filed Under: Climate modelling, Climate Science, Featured Story, Instrumental Record, Model-Obs Comparisons, Scientific practice Tagged With: CMIP6, Scafetta

The Future of Climate Modeling?

26 Mar 2022 by Gavin

There was an interesting workshop last week focused on the Future of Climate Modelling. It was run by the World Climate Research Program (WCRP) Core Project on Earth System Modelling and Observations (ESMO) which is part of a bewildering alphabet soup of various advisory committees that exist for mostly unclear historical reasons. This one actually does something useful – namely it helps organize the CMIP activities that many modeling groups contribute to (which inform the assessment reports like IPCC and various national Climate Assessments). They had a wide variety of people and perspectives to discuss the changing landscape of climate modeling and what people want from these models. You won’t agree with everything, but it was informative.

[Read more…] about The Future of Climate Modeling?

Filed Under: Climate modelling, Climate Science, Featured Story, Scientific practice Tagged With: CMIP, WCRP

  • « Go to Previous Page
  • Page 1
  • Page 2
  • Page 3
  • Page 4
  • Page 5
  • Page 6
  • Interim pages omitted …
  • Page 24
  • Go to Next Page »

Primary Sidebar

Search

Search for:

Email Notification

get new posts sent to you automatically (free)
Loading

Recent Posts

  • Unforced variations: Oct 2025
  • “But you said the ice was going to disappear in 10 years!”
  • Time and Tide Gauges wait for no Voortman
  • Lil’ NAS Express
  • DOE CWG Report “Moot”?
  • Climate Scientists response to DOE report

Our Books

Book covers
This list of books since 2005 (in reverse chronological order) that we have been involved in, accompanied by the publisher’s official description, and some comments of independent reviewers of the work.
All Books >>

Recent Comments

  • Tomáš Kalisz on “But you said the ice was going to disappear in 10 years!”
  • nigelj on Unforced variations: Oct 2025
  • Tomáš Kalisz on Unforced variations: Oct 2025
  • Russell Seitz on “But you said the ice was going to disappear in 10 years!”
  • Kevin McKinney on “But you said the ice was going to disappear in 10 years!”
  • Kevin McKinney on Unforced variations: Oct 2025
  • Kevin McKinney on “But you said the ice was going to disappear in 10 years!”
  • MA Rodger on Unforced variations: Oct 2025
  • MA Rodger on Unforced variations: Oct 2025
  • MA Rodger on Unforced variations: Oct 2025
  • Barton Paul Levenson on Unforced variations: Oct 2025
  • Barton Paul Levenson on “But you said the ice was going to disappear in 10 years!”
  • Silvia Leahu-Aluas on Unforced variations: Oct 2025
  • Pete best on “But you said the ice was going to disappear in 10 years!”
  • Susan Anderson on “But you said the ice was going to disappear in 10 years!”
  • Mo Yunus on Unforced variations: Oct 2025
  • Geoff Miell on Unforced variations: Oct 2025
  • Russell Seitz on “But you said the ice was going to disappear in 10 years!”
  • Mo Yunus on “But you said the ice was going to disappear in 10 years!”
  • Mo Yunus on “But you said the ice was going to disappear in 10 years!”
  • Mo Yunus on “But you said the ice was going to disappear in 10 years!”
  • Piotr on Unforced variations: Oct 2025
  • Atomsk's Sanakan on Unforced variations: Oct 2025
  • Tomáš Kalisz on Unforced variations: Oct 2025
  • Kevin McKinney on “But you said the ice was going to disappear in 10 years!”
  • Kevin McKinney on “But you said the ice was going to disappear in 10 years!”
  • Kevin McKinney on “But you said the ice was going to disappear in 10 years!”
  • John Pollack on “But you said the ice was going to disappear in 10 years!”
  • Mal Adapted [also spelled "no mo' dodos"] on “But you said the ice was going to disappear in 10 years!”
  • Tomáš Kalisz on “But you said the ice was going to disappear in 10 years!”

Footer

ABOUT

  • About
  • Translations
  • Privacy Policy
  • Contact Page
  • Login

DATA AND GRAPHICS

  • Data Sources
  • Model-Observation Comparisons
  • Surface temperature graphics
  • Miscellaneous Climate Graphics

INDEX

  • Acronym index
  • Index
  • Archives
  • Contributors

Realclimate Stats

1,383 posts

11 pages

247,226 comments

Copyright © 2025 · RealClimate is a commentary site on climate science by working climate scientists for the interested public and journalists.