• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer

RealClimate

Climate science from climate scientists...

  • Start here
  • Model-Observation Comparisons
  • Miscellaneous Climate Graphics
  • Surface temperature graphics
You are here: Home / Archives for Climate Science / Instrumental Record

Instrumental Record

Rossby waves and surface weather extremes

10 Jul 2014 by Stefan

A new study by Screen and Simmonds demonstrates the statistical connection between high-amplitude planetary waves in the atmosphere and extreme weather events on the ground.

Guest post by Dim Coumou

There has been an ongoing debate, both in and outside the scientific community, whether rapid climate change in the Arctic might affect circulation patterns in the mid-latitudes, and thereby possibly the frequency or intensity of extreme weather events. The Arctic has been warming much faster than the rest of the globe (about twice the rate), associated with a rapid decline in sea-ice extent. If parts of the world warm faster than others then of course gradients in the horizontal temperature distribution will change – in this case the equator-to-pole gradient – which then could affect large scale wind patterns.

Several dynamical mechanisms for this have been proposed recently. Francis and Vavrus (GRL 2012) argued that a reduction of the north-south temperature gradient would cause weaker zonal winds (winds blowing west to east) and therefore a slower eastward propagation of Rossby waves. A change in Rossby wave propagation has not yet been detected (Barnes 2013) but this does not mean that it will not change in the future. Slowly-traveling waves (or quasi-stationary waves) would lead to more persistent and therefore more extreme weather. Petoukhov et al (2013) actually showed that several recent high-impact extremes, both heat waves and flooding events, were associated with high-amplitude quasi-stationary waves. [Read more…] about Rossby waves and surface weather extremes

References

  1. J.A. Francis, and S.J. Vavrus, "Evidence linking Arctic amplification to extreme weather in mid‐latitudes", Geophysical Research Letters, vol. 39, 2012. http://dx.doi.org/10.1029/2012GL051000
  2. E.A. Barnes, "Revisiting the evidence linking Arctic amplification to extreme weather in midlatitudes", Geophysical Research Letters, vol. 40, pp. 4734-4739, 2013. http://dx.doi.org/10.1002/grl.50880
  3. V. Petoukhov, S. Rahmstorf, S. Petri, and H.J. Schellnhuber, "Quasiresonant amplification of planetary waves and recent Northern Hemisphere weather extremes", Proceedings of the National Academy of Sciences, vol. 110, pp. 5336-5341, 2013. http://dx.doi.org/10.1073/pnas.1222000110

Filed Under: Arctic and Antarctic, Climate Science, Instrumental Record, statistics

Release of the International Surface Temperature Initiative’s (ISTI’s) Global Land Surface Databank, an expanded set of fundamental surface temperature records

6 Jul 2014 by rasmus

Guest post by Jared Rennie, Cooperative Institute for Climate and Satellites, North Carolina on behalf of the databank working group of the International Surface Temperature Initiative

In the 21st Century, when multi-billion dollar decisions are being made to mitigate and adapt to climate change, society rightly expects openness and transparency in climate science to enable a greater understanding of how climate has changed and how it will continue to change. Arguably the very foundation of our understanding is the observational record. Today a new set of fundamental holdings of land surface air temperature records stretching back deep into the 19th Century has been released as a result of several years of effort by a multinational group of scientists.

The International Surface Temperature Initiative (ISTI) was launched by an international and multi-disciplinary group of scientists in 2010 to improve understanding of the Earth’s climate from the global to local scale. The Databank Working Group, under the leadership of NOAA’s National Climatic Data Center (NCDC), has produced an innovative data holding that largely leverages off existing data sources, but also incorporates many previously unavailable sources of surface air temperature. This data holding provides users a way to better track the origin of the data from its collection through its integration. By providing the data in various stages that lead to the integrated product, by including data origin tracking flags with information on each observation, and by providing the software used to process all observations, the processes involved in creating the observed fundamental climate record are completely open and transparent to the extent humanly possible.

Databank Architecture

figure1

The databank includes six data Stages, starting from the original observation to the final quality controlled and bias corrected product (Figure 1). The databank begins at Stage Zero holdings, which contain scanned images of digital observations in their original form. These images are hosted on the databank server when third party hosting is not possible. Stage One contains digitized data, in its native format, provided by the contributor. No effort is required on their part to convert the data into any other format. This reduces the possibility that errors could occur during translation. We collated over 50 sources ranging from single station records to holdings of several tens of thousands of stations.

Once data are submitted as Stage One, all data are converted into a common Stage Two format. In addition, data provenance flags are added to every observation to provide a history of that particular observation. Stage Two files are maintained in ASCII format, and the code to convert all the sources is provided. After collection and conversion to a common format, the data are then merged into a single, comprehensive Stage Three dataset. The algorithm that performs the merging is described below. Development of the merged dataset is followed by quality control and homogeneity adjustments (Stage Four and Five, respectively). These last two stages are not the responsibility of Databank Working Group, see the discussion of broader context below.

Merge Algorithm Description

The following is an overview of the process in which individual Stage Two sources are combined to form a comprehensive Stage Three dataset. A more detailed description can be found in a manuscript accepted and published by Geoscience Data Journal (Rennie et al., 2014).

The algorithm attempts to mimic the decisions an expert analyst would make manually. Given the fractured nature of historical data stewardship many sources will inevitably contain records for the same station and it is necessary to create a process for identifying and removing duplicate stations, merging some sources to produce a longer station record, and in other cases determining when a station should be brought in as a new distinct record.

The merge process is accomplished in an iterative fashion, starting from the highest priority data source (target) and running progressively through the other sources (candidates). A source hierarchy has been established which prioritizes datasets that have better data provenance, extensive metadata, and long, consistent periods of record. In addition it prioritizes holdings derived from daily data to allow consistency between daily holdings and monthly holdings. Every candidate station read in is compared to all target stations, and one of three possible decisions is made. First, when a station match is found, the candidate station is merged with the target station. Second, if the candidate station is determined to be unique it is added to the target dataset as a new station. Third, the available information is insufficient, conflicting, or ambiguous, and the candidate station is withheld.

Stations are first compared through their metadata to identify matching stations. Four tests are applied: geographic distance, height distance, station name similarity, and when the data record began. Non-missing metrics are then combined to create a metadata metric and it is determined whether to move on to data comparisons, or to withhold the candidate station. If a data comparison is deemed necessary, overlapping data between the target and candidate station is tested for goodness-of-fit using the Index of Agreement (IA). At least five years of overlap are required for a comparison to be made. A lookup table is used to provide two data metrics, the probability of station match (H1) and the probability of station uniqueness (H2). These are then combined with the metadata metric to create posterior metrics of station match and uniqueness. These are used to determine if the station is merged, added as unique, or withheld.

Stage Three Dataset Description

figure2

The integrated data holding recommended and endorsed by ISTI contains over 32,000 global stations (Figure 2), over four times as many stations as GHCN-M version 3. Although station coverage varies spatially and temporally, there are adequate stations with decadal and century periods of record at local, regional, and global scales. Since 1850, there consistently are more stations in the recommended merge than GHCN-M (Figure 3). In GHCN-M version 3, there was a significant drop in stations in 1990 reflecting the dependency on the decadal World Weather Records collection as a source, which is ameliorated by many of the new sources which can be updated much more rapidly and will enable better real-time monitoring.

figure3

Many thresholds are used in the merge and can be set by the user before running the merge program. Changing these thresholds can significantly alter the overall result of the program. Changes will also occur when the source priority hierarchy is altered. In order to characterize the uncertainty associated with the merge parameters, seven different variants of the Stage Three product were developed alongside the recommended merge. This uncertainty reflects the importance of data rescue. While a major effort has been undertaken through this initiative, more can be done to include areas that are lacking on both spatial and temporal scales, or lacking maximum and minimum temperature data.

Data Access

Version 1.0.0 of the Global Land Surface Databank has been released and data are provided from a primary ftp site hosted by the Global Observing Systems Information Center (GOSIC) and World Data Center A at NOAA NCDC. The Stage Three dataset has multiple formats, including a format approved by ISTI, a format similar to GHCN-M, and netCDF files adhering to the Climate and Forecast (CF) convention. The data holding is version controlled and will be updated frequently in response to newly discovered data sources and user comments.

All processing code is provided, for openness and transparency. Users are encouraged to experiment with the techniques used in these algorithms. The programs are designed to be modular, so that individuals have the option to develop and implement other methods that may be more robust than described here. We will remain open to releases of new versions should such techniques be constructed and verified.

ISTI’s online directory provides further details on the merging process and other aspects associated with the full development of the databank as well as all of the data and processing code.

We are always looking to increase the completeness and provenance of the holdings. Data submissions are always welcome and strongly encouraged. If you have a lead on a new data source, please contact data.submission@surfacetemperatures.org with any information which may be useful.

The broader context

It is important to stress that the databank is a release of fundamental data holdings – holdings which contain myriad non-climatic artefacts arising from instrument changes, siting changes, time of observation changes etc. To gain maximum value from these improved holdings it is imperative that as a global community we now analyze them in multiple distinct ways to ascertain better estimates of the true evolution of surface temperatures locally, regionally, and globally. Interested analysts are strongly encouraged to develop innovative approaches to the problem.

To help ascertain what works and what doesn’t the benchmarking working group are developing and will soon release a set of analogs to the databank. These will share the space and time sampling of the holdings but contain a set of known (to the originators) data issues that require removing. When analysts apply their methods to the analogs we can infer something meaningful about their methods. Further details are available in a discussion paper under peer review [Willett et al., submitted].

More Information

www.surfacetemperatures.org
ftp://ftp.ncdc.noaa.gov/pub/data/globaldatabank

References
Rennie, J.J. and coauthors, 2014, The International Surface Temperature Initiative Global Land Surface Databank: Monthly Temperature Data Version 1 Release Description and Methods. Accepted, Geoscience Data Journal.

Willett, K. M. et al., submitted, Concepts for benchmarking of homogenisation algorithm performance on the global scale. http://www.geosci-instrum-method-data-syst-discuss.net/4/235/2014/gid-4-235-2014.html

Filed Under: Climate Science, Instrumental Record

Faking it

30 Apr 2014 by Gavin

Every so often contrarians post old newspaper quotes with the implication that nothing being talked about now is unprecedented or even unusual. And frankly, there are lots of old articles that get things wrong, are sensationalist or made predictions without a solid basis. And those are just the articles about the economy.

However, there are plenty of science articles that are just interesting, reporting events and explorations in the Arctic and elsewhere that give a fascinating view into how early scientists were coming to an understanding about climate change and processes. In particular, in the Atlantic sector of the Arctic the summer of 1922 was (for the time) quite warm, and there were a number of reports that discussed some unprecedented (again, for the time) observations of open water. The most detailed report was in the Monthly Weather Review:
[Read more…] about Faking it

Filed Under: Arctic and Antarctic, Climate Science, Instrumental Record

Nenana Ice Classic: Update

25 Apr 2014 by Gavin

Somewhat randomly, my thoughts turned to the Nenana Ice Classic this evening, only to find that the ice break up had only just occurred (3:48 pm Alaskan Standard Time, April 25). This is quite early (the 7th earliest date, regardless of details associated with the vernal equinox or leap year issues), though perhaps unsurprising after the warm Alaskan winter this year (8th warmest on record). This is in strong contrast to the very late break up last year.



Break up dates accounting for leap years and variations in the vernal equinox.

As mentioned in my recent post, the Nenana break up date is a good indicator of Alaskan regional temperatures and despite last year’s late anomaly, the trends are very much towards a earlier spring. This is also true for trends in temperatures and ice break up mostly everywhere else too, despite individual years (like 2013/2014) being anomalously cold (for instance in the Great Lakes region). As we’ve often stressed, it is the trends that are important for judging climate change, not the individual years. Nonetheless, odds on dates as early as this years have more than doubled over the last century.

Filed Under: Climate impacts, Climate Science, Instrumental Record

Shindell: On constraining the Transient Climate Response

8 Apr 2014 by group

Guest commentary from Drew Shindell

There has been a lot of discussion of my recent paper in Nature Climate Change (Shindell, 2014). That study addressed a puzzle, namely that recent studies using the observed changes in Earth’s surface temperature suggested climate sensitivity is likely towards the lower end of the estimated range. However, studies evaluating model performance on key observed processes and paleoclimate evidence suggest that the higher end of sensitivity is more likely, partially conflicting with the studies based on the recent transient observed warming. The new study shows that climate sensitivity to historical changes in the abundance of aerosol particles in the atmosphere is larger than the sensitivity to CO2, primarily because the aerosols are largely located near industrialized areas in the Northern Hemisphere middle and high latitudes where they trigger more rapid land responses and strong snow & ice feedbacks. Therefore studies based on observed warming have underestimated climate sensitivity as they did not account for the greater response to aerosol forcing, and multiple lines of evidence are now consistent in showing that climate sensitivity is in fact very unlikely to be at the low end of the range in recent estimates.
[Read more…] about Shindell: On constraining the Transient Climate Response

References

  1. D.T. Shindell, "Inhomogeneous forcing and transient climate sensitivity", Nature Climate Change, vol. 4, pp. 274-277, 2014. http://dx.doi.org/10.1038/nclimate2136

Filed Under: Climate modelling, Climate Science, Instrumental Record

Can we make better graphs of global temperature history?

13 Mar 2014 by Gavin

I’m writing this post to see if our audience can help out with a challenge: Can we collectively produce some coherent, properly referenced, open-source, scalable graphics of global temperature history that will be accessible and clear enough that we can effectively out-compete the myriad inaccurate and misleading pictures that continually do the rounds on social media?

[Read more…] about Can we make better graphs of global temperature history?

Filed Under: Climate Science, Communicating Climate, Instrumental Record, Paleoclimate

The Nenana Ice Classic and climate

7 Mar 2014 by Gavin

I am always interested in non-traditional data sets that can shed some light on climate changes. Ones that I’ve discussed previously are the frequency of closing of the Thames Barrier and the number of vineyards in England. With the exceptional warmth in Alaska last month (which of course was coupled with colder temperatures elsewhere), I was reminded of another one, the Nenana Ice Classic.
[Read more…] about The Nenana Ice Classic and climate

Filed Under: Climate impacts, Climate Science, Instrumental Record

New daily temperature dataset from Berkeley

5 Mar 2014 by group

Guest commentary from Zeke Hausfather and Robert Rohde

Daily temperature data is an important tool to help measure changes in extremes like heat waves and cold spells. To date, only raw quality controlled (but not homogenized) daily temperature data has been available through GHCN-Daily and similar sources. Using this data is problematic when looking at long-term trends, as localized biases like station moves, time of observation changes, and instrument changes can introduce significant biases.

For example, if you were studying the history of extreme heat in Chicago, you would find a slew of days in the late 1930s and early 1940s where the station currently at the Chicago O’Hare airport reported daily max temperatures above 45 degrees C (113 F). It turns out that, prior to the airport’s construction, the station now associated with the airport was on the top of a black roofed building closer to the city. This is a common occurrence for stations in the U.S., where many stations were moved from city cores to newly constructed airports or wastewater treatment plants in the 1940s. Using the raw data without correcting for these sorts of bias would not be particularly helpful in understanding changes in extremes.
[Read more…] about New daily temperature dataset from Berkeley

Filed Under: Climate Science, Instrumental Record

It never rains but it pause

4 Mar 2014 by Gavin

There has been a veritable deluge of new papers this month related to recent trends in surface temperature. There are analyses of the CMIP5 ensemble, new model runs, analyses of complementary observational data, attempts at reconciliation all the way to commentaries on how the topic has been covered in the media and on twitter. We will attempt to bring the highlights together here. As background, it is worth reading our previous discussions, along with pieces by Simon Donner and Tamino to help put in context what is being discussed here.

[Read more…] about It never rains but it pause

Filed Under: Aerosols, Climate modelling, Climate Science, El Nino, Instrumental Record

Going with the wind

17 Feb 2014 by group

A new paper in Nature Climate Change out this week by England and others joins a number of other recent papers seeking to understand the climate dynamics that have led to the so-called “slowdown” in global warming. As we and others have pointed out previously (e.g. here), the fact that global average temperatures can deviate for a decade or longer from the long term trend comes as no surprise. Moreover, it’s not even clear that the deviation has been as large as is commonly assumed (as discussed e.g. in the Cowtan and Way study earlier this year), and has little statistical significance in any case. Nevertheless, it’s still interesting, and there is much to be learned about the climate system from studying the details.

Several studies have shown that much of the excess heating of the planet due to the radiative imbalance from ever-increasing greenhouses gases has gone into the ocean, rather than the atmosphere (see e.g. Foster and Rahmstorf and Balmaseda et al.). In their new paper, England et al. show that this increased ocean heat uptake — which has occurred mostly in the tropical Pacific — is associated with an anomalous strengthening of the trade winds. Stronger trade winds push warm surface water towards the west, and bring cold deeper waters to the surface to replace them. This raises the thermocline (boundary between warm surface water and cold deep water), and increases the amount of heat stored in the upper few hundred meters of the ocean. Indeed, this is what happens every time there is a major La Niña event, which is why it is globally cooler during La Niña years. One could think of the last ~15 years or so as a long term “La-Niña-like” anomaly (punctuated, of course, by actual El Niño (like the exceptionally warm years 1998, 2005) and La Niña events (like the relatively cool 2011).

A very consistent understanding is thus emerging of the coupled ocean and atmosphere dynamics that have caused the recent decadal-scale departure from the longer-term global warming trend. That understanding suggests that the “slowdown” in warming is unlikely to continue, as England explains in his guest post, below. –Eric Steig

Guest commentary by Matthew England (UNSW)

For a long time now climatologists have been tracking the global average air temperature as a measure of planetary climate variability and trends, even though this metric reflects just a tiny fraction of Earth’s net energy or heat content. But it’s used widely because it’s the metric that enjoys the densest array of in situ observations. The problem of course is that this quantity has so many bumps and kinks, pauses and accelerations that predicting its year-to-year path is a big challenge. Over the last century, no single forcing agent is clearer than anthropogenic greenhouse gases, yet zooming into years or decades, modes of variability become the signal, not the noise. Yet despite these basics of climate physics, any slowdown in the overall temperature trend sees lobby groups falsely claim that global warming is over. Never mind that the globe – our planet – spans the oceans, atmosphere, land and ice systems in their entirety.

This was one of the motivations for our study out this week in Nature Climate Change (England et al., 2014)  With the global-average surface air temperature (SAT) more-or-less steady since 2001, scientists have been seeking to explain the climate mechanics of the slowdown in warming seen in the observations during 2001-2013. One simple way to address this is to examine what is different about the recent decade compared to the preceding decade when the global-mean SAT metric accelerated. This can be quantified via decade-mean differences, or via multi-decadal trends, which are roughly equivalent if the trends are more-or-less linear, or if the focus is on the low frequency changes.

[Read more…] about Going with the wind

References

  1. G. Foster, and S. Rahmstorf, "Global temperature evolution 1979–2010", Environmental Research Letters, vol. 6, pp. 044022, 2011. http://dx.doi.org/10.1088/1748-9326/6/4/044022
  2. M.A. Balmaseda, K.E. Trenberth, and E. Källén, "Distinctive climate signals in reanalysis of global ocean heat content", Geophysical Research Letters, vol. 40, pp. 1754-1759, 2013. http://dx.doi.org/10.1002/grl.50382
  3. M.H. England, S. McGregor, P. Spence, G.A. Meehl, A. Timmermann, W. Cai, A.S. Gupta, M.J. McPhaden, A. Purich, and A. Santoso, "Recent intensification of wind-driven circulation in the Pacific and the ongoing warming hiatus", Nature Climate Change, vol. 4, pp. 222-227, 2014. http://dx.doi.org/10.1038/nclimate2106

Filed Under: Climate modelling, Climate Science, El Nino, Instrumental Record, Oceans

  • « Go to Previous Page
  • Page 1
  • Interim pages omitted …
  • Page 11
  • Page 12
  • Page 13
  • Page 14
  • Page 15
  • Interim pages omitted …
  • Page 25
  • Go to Next Page »

Primary Sidebar

Search

Search for:

Email Notification

get new posts sent to you automatically (free)
Loading

Recent Posts

  • Critiques of the ‘Critical Review’
  • Unforced Variations: Aug 2025
  • Are direct water vapor emissions endangering anyone?
  • The Endangerment of the Endangerment Finding?
  • National Climate Assessment links
  • Ocean circulation going South?

Our Books

Book covers
This list of books since 2005 (in reverse chronological order) that we have been involved in, accompanied by the publisher’s official description, and some comments of independent reviewers of the work.
All Books >>

Recent Comments

  • Tomáš Kalisz on Unforced Variations: Aug 2025
  • Ron R. on Critiques of the ‘Critical Review’
  • patrick o twentyseven on The Endangerment of the Endangerment Finding?
  • Ron R. on Critiques of the ‘Critical Review’
  • b fagan on Critiques of the ‘Critical Review’
  • David on Unforced Variations: Aug 2025
  • Piotr on The Endangerment of the Endangerment Finding?
  • Barry E Finch on Unforced Variations: Aug 2025
  • Piotr on The Endangerment of the Endangerment Finding?
  • Tomáš Kalisz on The Endangerment of the Endangerment Finding?
  • Ken Towe on Critiques of the ‘Critical Review’
  • Geoff Miell on Unforced Variations: Aug 2025
  • Barton Paul Levenson on Unforced Variations: Aug 2025
  • Barton Paul Levenson on Unforced Variations: Aug 2025
  • Barton Paul Levenson on Unforced Variations: Aug 2025
  • Barton Paul Levenson on Critiques of the ‘Critical Review’
  • Barton Paul Levenson on Critiques of the ‘Critical Review’
  • Barton Paul Levenson on Critiques of the ‘Critical Review’
  • Silvia Leahu-Aluas on Unforced Variations: Aug 2025
  • zebra on Critiques of the ‘Critical Review’
  • Ken Towe on Critiques of the ‘Critical Review’
  • Paul Pukite (@whut) on The Endangerment of the Endangerment Finding?
  • zebra on Unforced Variations: Aug 2025
  • Atomsk's Sanakan on The Endangerment of the Endangerment Finding?
  • Rory Allen on Critiques of the ‘Critical Review’
  • Rory Allen on Critiques of the ‘Critical Review’
  • Rory Allen on Critiques of the ‘Critical Review’
  • Silvia Leahu-Aluas on Critiques of the ‘Critical Review’
  • Rory Allen on Critiques of the ‘Critical Review’
  • Rory Allen on Critiques of the ‘Critical Review’

Footer

ABOUT

  • About
  • Translations
  • Privacy Policy
  • Contact Page
  • Login

DATA AND GRAPHICS

  • Data Sources
  • Model-Observation Comparisons
  • Surface temperature graphics
  • Miscellaneous Climate Graphics

INDEX

  • Acronym index
  • Index
  • Archives
  • Contributors

Realclimate Stats

1,375 posts

11 pages

245,770 comments

Copyright © 2025 · RealClimate is a commentary site on climate science by working climate scientists for the interested public and journalists.