Climate science from climate scientists...
Here is a continuation of the last Arctic sea ice discussion as we get closer to the 2011 minimum. All figures will update continuously.
JAXA Sea ice extent and area:
Cryosphere Today sea ice concentration:
Estimated sea ice volume from UW PIOMAS (updated every month):
The long-awaited first paper from the CERN/CLOUD project has just been published in Nature. The paper, by Kirkby et al, describes changes in aerosol nucleation as a function of increasing sulphates, ammonia and ionisation in the CERN-based ‘CLOUD’ chamber. Perhaps surprisingly, the key innovation in this experimental set up is not the presence of the controllable ionisation source (from the Proton Synchrotron accelerator), but rather the state-of-the-art instrumentation of the chamber that has allowed them to see in unprecedented detail what is going on in the aerosol nucleation process (this is according to a couple of aerosol people I’ve spoken about this with).
This paper is actually remarkably free of the over-the-top spin that has accompanied previous papers, and that bodes very well for making actual scientific progress on this topic.
[Read more…] about The CERN/CLOUD results are surprisingly interesting…
Climate modeling groups all across the world are racing to add their contributions to the CMIP5 archive of coupled model simulations. This coordinated project, proposed, conceived and specified by the climate modeling community itself, will be an important resource for analysts and for the IPCC AR5 report (due in 2013), and beyond.
There have been previous incarnations of the CMIP projects going back to the 1990s, but I think it’s safe to say that it was only with CMIP3 (in 2004/2005) that the project gained a real maturity. The CMIP3 archive was heavily used in the IPCC AR4 report – so much so that people often describe those models and simulations as the ‘IPCC models’. That is a reasonable shorthand, but is not really an accurate description (the models were not chosen by IPCC, designed by IPCC, or run by IPCC) even though I’ve used it on occasion. Part of the success of CMIP3 was the relatively open data access policy which allowed many scientists and hobbyists alike to access the data – many of whom were dealing with GCM output for the first time. Some 600 papers have been written using data from this archive. We discussed some of this success (and some of the problems) back in 2008.
Now that CMIP5 is gearing up for a similar exercise, it is worth looking into what has changed – it terms of both the model specifications, the requested simulations and the data serving to the wider community. Many of these issues are being discussed in a the current CLIVAR newsletter (Exchanges no. 56). (The references below are all to articles in this pdf).
There are three main novelties this time around that I think are noteworthy: the use of more interactive Earth System models, a focus on initiallised decadal predictions, and the inclusion of key paleo-climate simulations as part of the suite of runs.
The term Earth System Model is a little ambiguous with some people reserving that for models that include a carbon cycle, and others (including me) using it more generally to denote models with more interactive components than used in more standard (AR4-style) GCMs (i.e. atmospheric chemistry, aerosols, ice sheets, dynamic vegetation etc.). Regardless of terminology, the 20th Century historical simulations in CMIP5 will use a much more diverse set of model types than did the similar simulations in CMIP3 (where all models were standard coupled GCMs). That both expands the range of possible evaluations of the models, but also increases the complexity of that evaluation.
The ‘decadal prediction’ simulations are mostly being run with standard GCMs (see the article by Doblas-Reyes et al, p8). The different groups are trying multiple methods to initialise their ocean circulations and heat content at specific points in the past and are then seeing if they are able to better predict the actual course of events. This is very different from standard climate modelling where no attempt is made to synchronise modes of internal variability with the real world. The hope is that one can reduce the initial condition uncertainty for predictions in some useful way, though this has yet to be demonstrated. Early attempts to do this have had mixed results, and from what I’ve seen of the preliminary results in the CMIP5 runs, significant problems remain. This is one area to watch carefully though.
Personally, I am far more interested in the inclusion of the paleo component in CMIP5 (see Braconnot et al, p15). Paleo-climate simulations with the same models that are being used for the future projections allow for the possibility that we can have true ‘out-of-sample’ testing of the models over periods with significant climate changes. Much of the previous work in evaluating the IPCC models has been based on modern period skill metrics (the climatology, seasonality, interannual variability, the response to Pinatubo etc.), but while useful, this doesn’t encompass changes of the same magnitude as the changes predicted for the 21st Century. Including tests with simulations of the last glacial maximum, the Mid-Holocene or the Last Millennium greatly expands the range of model evaluation (see Schmidt (2010) for more discussion).
The CLIVAR newsletter has a number of other interesting articles, on CFMIP (p20), the scenarios begin used (RCPs) (p12), the ESG data delivery system (p40), satellite comparisons (p46, and p47) and the carbon-cycle simulations (p27). Indeed, the range of issues covered I think presages the depth and interest that the CMIP5 archive will eventually generate.
There will be a WCRP meeting in October in Denver that will be very focused on the CMIP5 results, and it is likely that much of context for the AR5 report will be reflected there.
The entire CRUTEM3 database of station temperature measurements has just been released. This comes after a multi-year process to get permissions from individual National Weather Services to allow the passing on of data to third parties and from a ruling from the UK ICO. All the NWSs have now either agreed or not responded (except for Poland which specifically refused). Since the Polish data is a such a small fraction of the globe (and there are a few Polish stations in any case via RBSC or GCOS), this doesn’t make much difference to hemispheric means or regional climate. These permissions were obtained with help from the UK Met Office (who have also placed the station data on their website in a slightly different format) and whose FAQ is quite informative.
This dataset has occasionally come up in blogospheric discussions.
There is an interesting new wiki site, Reanalyses.org, that has been developed by a number of groups dedicated to documenting the various reanalysis products for atmosphere and ocean that are increasingly being made available.
For those that don’t know, a ‘reanalysis’ is a climate or weather model simulation of the past that includes data assimilation of historical observations. The observations can be very comprehensive (satellite, in situ, multiple variables) or relatively sparse (say, sea level pressure only), and the models themselves are quite varied. Generally these models are drawn from the weather forecasting community (at least for the atmospheric components) which explains the odd terminology. An ‘analysis’ from a weather forecasting model is the 6 hour (say) forecast from the time of observations. Weather forecasting groups realised a decade or so ago that the time series of their weather forecasts (the analyses) could not be used to track long term changes because their models had been updated many times over the decades. Thus the idea arose to ‘re-analyse’ the historical observations with a single consistent model. These sets of 6 hour forecasts using the data available at each point are then more consistent in time (and presumably more accurate) that the original analyses were.
The first two reanalysis projects (NCEP1 and ERA-40) were groundbreaking and allowed a lot of analysis of the historical climate (around 1958 or 1948 onwards) that had not been possible before. Essentially, the models are being used to interpolate between observations in a (hopefully) physically consistent manner providing a gridded and complete data set. However, there are noted problems with this approach that need to be borne in mind.
The most important issue is that the amount and quality of the assimilated data has changed enormously over time. Particularly in the pre-satellite era (around 1979), data is relatively sparse and reliant on networks of in-situ measurements. After 1979 the amount of data being brought in increases by orders of magnitude. It is also important to consider how even continuous measurement series have changed. For instance, the response time for sensors in radiosondes (that are used to track atmospheric profiles of temperature and humidity) has steadily improved which, if uncorrected for in the reanalyses, would lead to an erroneous drying in the upper troposphere that has nothing to do with any actual climate trend. In fact it is hard to correct for such problems in data coverage and accuracy, and so trend analysis in the reanalyses have to be treated very carefully (and sometimes avoided altogether).
A further problem is that different outputs from the reanalyses are differently constrained by observations. Where observations are plentiful and span the variability, the reanalysis field is close to what actually happened (for instance, horizontal components of the wind), but where the output field is only indirectly related to the assimilated observations (rainfall, cloudiness etc.), the changes and variability are much more of a product of the model.
The more modern products are substantially improved (NCEP-2, ERA-Interim, MERRA and others) over the first set, and new approaches are also being tried. The ‘20th Century Reanalysis‘ is a new product that only uses (plentiful) surface pressure measurements to constrain dynamics and although it uses less data than other products, it can go back much earlier (to the 19th Century) and still produce meaningful results. Other new products are the ocean reanalyses (ECCO for instance) that tries to take the same approach with ocean temperature and salinity measurements.
These products should definitely not be assumed to have the status of ‘real observations’, but they are very useful as long as people are careful to take the caveats seriously, and be clear about the structural uncertainties. Results that differ enormously across different reanalyses should be viewed with caution.
The new site includes some very promising descriptions on how to download and plot the data, and will hopefully soon be able to fill up the rest of pages. Some suggestions might be for a list of key papers discussing the results of these reanalyses and lists of issues found (so that others don’t waste their time). It’s a very promising start though.
Readers may recall discussions of a paper by Thompson et al (2008) back in May 2008. This paper demonstrated that there was very likely an artifact in the sea surface temperature (SST) collation by the Hadley Centre (HadSST2) around the end of the second world war and for a few years subsequently, related to the different ways ocean temperatures were taken by different fleets. At the time, we reported that this would certainly be taken into account in revisions of data set as more data was processed and better classifications of the various observational biases occurred. Well, that process has finally resulted in the publication of a new compilation, HadSST3.
[Read more…] about Revisiting historical ocean surface temperatures
Willie Soon is a name that pops up every so often in climate ‘debate’. He was the lead author on the Soon and Baliunas (2003) paper (the only paper that has ever led to the resignation of 6 editors in protest at the failure of peer-review that led to its publication). He was a recent speaker (from 37.20) at the 2011 Heartland Institute conference, and can be counted on to produce a contrarian take on any particular issue that anyone might care about – ranging from climate, to mercury in fish and polar bear population dynamics.
[Read more…] about How Soon is now?
Some readers might recall a story from a couple of years of ago relating polar ozone depletion to cosmic rays and the subsequent failure of predictions made using that theory. The idea came from from a Qian-B. Lu (U. Waterloo), and initially seemed interesting (at least to those of us who were not specialists). Perhaps cosmic ray induced chemistry was playing some part in releasing chlorine from CFCs as well as the more accepted idea of heterogeneous chemistry on polar stratospheric particles? Lu’s predictions for increased polar ozone loss in 2008/2009 as a function of the low solar activity (and therefore higher CR flux) did not come to pass. Worse (for this idea), new analyses demonstrated that the hypothesized CR-induced CFC loss wasn’t detectable at all.
[Read more…] about Lu: from ‘interesting but incorrect’ to just wrong
The international Aquarius/SAC-D satellite was successfully launched yesterday (thankfully!). Media coverage was good – except for the almost absolute avoidance of the term ‘salinity’ to describe the concentration of salts in the surface ocean that Aquarius will retrieve – oh well. But what is Aquarius going to see, and why is it important?
[Read more…] about The age of Aquarius
A paper in the scientific literature has to have some minimum level of content to be worth publishing (and regrettably, the search for the ‘Least Publishable Unit’ (LPU) of work is occasionally apparent for those wishing to pad their CVs). But what happens when someone has something worth saying that falls below that level? This is might be an update to an earlier paper, with modifications to figure, one extra sensitivity test, or some other minor addition, that could be of interest to readers of the original, but it doesn’t really get to the point where one would write a whole new paper. Some new journals (such as Geoscientific Model Development, GMD) have set up mechanisms to provide versioning of papers so that small updates can be made relatively easily, but this is rather uncommon.
A common reason to want to add additional material is in the light of subsequent commentary. In the usual case of an official submitted comment, the required response provides a good opportunity to give further details, add justification, or even agree with the comment (this last one doesn’t happen very often, but it does occur). Comments are often hard to publish for all sorts of non-scientific reasons, see Rick Trebino’s appalling story for instance, and note GRL’s 2010 decision to stop accepting comments altogether. Unfortunately not all comment/response pairs that do get published are worthwhile, but I still think they can be useful.
Where criticism occurs on a blog, there is no necessity to respond (as there would be for a submitted comment), but it is possible that there is something worth addressing (not everything is of course). Responses posted to that material – either in blog comments or in other blogs are however a little unsatisfying since the blog commentary and response are not tied to the actual paper (though mechanisms like that used by ‘Research Blogging‘ or JournalTalk could conceivably be used), and can quite frequently spiral out of control (with additional criticisms, responses, and often vast amounts of irrelevant commentary). As a useful archive of a discussion, this leaves much to be desired, nonetheless, the determined reader can usually find some nuggets.
But there is a third case where the comment/response effectively never sees the light of day. For a number of reasons critics will sometimes decide not to submit a comment, but rather a whole new paper. This might be because they want to include more information than a comment would allow or are making a comment on a previous work as part of a larger paper. Or it might be that they (correctly) note that comments are not as useful on the CV as a ‘proper’ paper, or indeed, a journal does not want to accept a comment for some reason. Less nobly, comments are sometimes avoided to try to prevent the original authors from having the last word. However, there is a risk that this paper never gets published at all (perhaps because it has less than one LPU, or it isn’t very good, or it clearly nothing more than a comment on a previous paper, or the authors lose enthusiasm). In that case, the criticism, and any response to it from the original authors (if they were asked to respond), simply disappears from sight. While possible, in my experience it is very rare that the critics then turn back to the official comment route.
It is very unusual for any scientific paper to the last word on anything, and there are almost always things that, in retrospect, one would have done differently. So it is not surprising that questions get raised through all this that the original authors might want to tackle without themselves submitting a whole other paper. Theoretically most papers would benefit from a well-refereed post-publication commentary. Yet, without a formal mechanism to shepherd this process, this material generally falls through the cracks.
As readers might have surmised, this is leading up to something.
Two papers that I was an author or co-author on in recent years generated a fair amount of blog commentary – Schmidt (2009) in IJoC and Benestad and Schmidt (2009) in JGR – mostly because they were explorations of issues raised by authors critical of the mainstream view of climate science. Despite the blog discussions, however, in neither case was a comment/response pair published. A comment was submitted on Schmidt (2009) by Jos de Laat, but this did not pass peer review (rightly I think) and no more has been heard of it. In both cases however, other authors whose work was criticised (specifically Ross McKitrick and Nicola Scafetta) submitted new papers to the same journal that were effectively just extended comments. A couple of valid points were made, but much in the draft texts was either wrong or irrelevant. I was asked to respond to both submissions by the editors involved, and did so in the form of a signed draft response as if the papers had indeed been submitted as comments. In both cases however, the papers were eventually rejected. A similar paper by McKitrick and Nierenberg appeared in another journal, while Scafetta’s paper has not been seen again.
So why bring this up now?
The fact is well-crafted comments and responses on both these papers would have been a useful contribution to the literature, and it is a shame that this didn’t happen (as I stated in at least one of the responses). That the authors were unwilling to submit ‘just’ a comment for whatever reason is part of the story (but it is not clear that any actual comment would have stuck to the points I thought worth making, or that the comment/response would have passed peer review either). But both papers have been mentioned recently in various contexts and it was apparent that the conversations might have been at least a little more interesting if the at least some of the unpublished correspondence on the papers had been available.
It strikes me that these are unlikely to be unique circumstances (or at least I would be very surprised if this kind of thing hasn’t happened to other people). So is there interest in RC providing space for these kinds of discussions? Authors, with something extra to say that they don’t ever think they’ll put in a new paper, could add some extra analysis and tie up some of the loose ends. I’d be happy to start the ball rolling by dealing with some issues relating to the papers mentioned above, but is this something else anyone would care to do? Should we instead be advocating for a rapid reaction online journal specifically for worthwhile comments and replies, especially since some journals have stopped accepting them? Thoughts welcome.