Friday, November 20, 2009

 

Global Warming Bombshell--or "Mushroom Cloud"?

Folks, I don't use sensational headlines too often. Also, I am in Auburn, AL after spending all day at a conference, and I'm headed out the door. So I haven't been able to carefully parse all the blogs on this issue.

Having given that caveat, this seems HUGE. The Climate Research Unit (CRU) is the world record keepers of global temperature data; it keeps the numbers that the IPCC bases its reports on. There have been some very dubious things recently where outside skeptics want the original temperature readings before CRU "smooths" them and does other things, and CRU basically stonewalled before saying, "We don't have the original readings anymore. All we have is the corrected data at this point."

So anyway, apparently a whistleblower couldn't live with him or herself anymore, [UPDATE: The official story is that the University's webmail server was hacked from the oustide, see the comments] and dumped a 61 MB file of CRU emails, data, etc. to an outside server, and now the blogosphere has gone nuts.

Some of the emails (if legitimate) are pretty amazing. I haven't been able to look at this too much, but here are the two most jaw-dropping ones I've come across so far. Note that Phil Jones is the head of CRU, and once again CRU is the group that maintains the global temperature data on which the IPCC reports are based. Also note that Michael Mann is the creator of the infamous "hockey stick" temperature graph that is so controversial. (I have bolded the parts below.)

=======================

From: Phil Jones

To: “Michael E. Mann”

Subject: HIGHLY CONFIDENTIAL

Date: Thu Jul 8 16:30:16 2004

The other paper by MM is just garbage - as you knew. De Freitas again. Pielke is also losing all credibility as well by replying to the mad Finn as well - frequently as I see it. I can’t see either of these papers being in the next IPCC report. Kevin and I will keep them out somehow - even if we have to redefine what the peer-review literature is !

========================


From: Phil Jones
To: ray bradley ,mann@xxxxx.xxx, mhughes@xxxx.xxx
Subject: Diagram for WMO Statement
Date: Tue, 16 Nov 1999 13:31:15 +0000
Cc: k.briffa@xxx.xx.xx,t.osborn@xxxx.xxx



Dear Ray, Mike and Malcolm,
Once Tim’s got a diagram here we’ll send that either later today or first thing tomorrow.
I’ve just completed Mike’s Nature trick of adding in the real temps
to each series for the last 20 years (ie from 1981 onwards) amd from
1961 for Keith’s to hide the decline.
Mike’s series got the annual
land and marine values while the other two got April-Sept for NH land
N of 20N. The latter two are real for 1999, while the estimate for 1999
for NH combined is +0.44C wrt 61-90. The Global estimate for 1999 with
data through Oct is +0.35C cf. 0.57 for 1998.
Thanks for the comments, Ray.

Cheers
Phil

Prof. Phil Jones
Climatic Research Unit Telephone +44 (0) xxxxx
School of Environmental Sciences Fax +44 (0) xxxx
University of East Anglia
Norwich Email p.jones@xxxx.xxx
NR4 7TJ
UK

=================================




Now of course, the question is: Are these emails legit? Well let's turn to the RealClimate response. I'll reproduce a large portion of what they say, in light of the above bombshells (or "mushroom cloud" as Pat Michaels called it). So anyway here is how the NASA climate scientists defend their colleagues across the pond:
As many of you will be aware, a large number of emails from the University of East Anglia webmail server were hacked recently (Despite some confusion generated by Anthony Watts, this has absolutely nothing to do with the Hadley Centre which is a completely separate institution). As people are also no doubt aware the breaking into of computers and releasing private information is illegal, and regardless of how they were obtained, posting private correspondence without permission is unethical. We therefore aren’t going to post any of the emails here. We were made aware of the existence of this archive last Tuesday morning when the hackers attempted to upload it to RealClimate, and we notified CRU of their possible security breach later that day.

Nonetheless, these emails (a presumably careful selection of (possibly edited?) correspondence dating back to 1996 and as recently as Nov 12) are being widely circulated, and therefore require some comment. Some of them involve people here (and the archive includes the first RealClimate email we ever sent out to colleagues) and include discussions we’ve had with the CRU folk on topics related to the surface temperature record and some paleo-related issues, mainly to ensure that posting were accurate.

Since emails are normally intended to be private, people writing them are, shall we say, somewhat freer in expressing themselves than they would in a public statement. For instance, we are sure it comes as no shock to know that many scientists do not hold Steve McIntyre in high regard. Nor that a large group of them thought that the Soon and Baliunas (2003), Douglass et al (2008) or McClean et al (2009) papers were not very good (to say the least) and should not have been published. These sentiments have been made abundantly clear in the literature (though possibly less bluntly).

More interesting is what is not contained in the emails. There is no evidence of any worldwide conspiracy, no mention of George Soros nefariously funding climate research, no grand plan to ‘get rid of the MWP’, no admission that global warming is a hoax, no evidence of the falsifying of data, and no ‘marching orders’ from our socialist/communist/vegetarian overlords. The truly paranoid will put this down to the hackers also being in on the plot though.

Instead, there is a peek into how scientists actually interact and the conflicts show that the community is a far cry from the monolith that is sometimes imagined. People working constructively to improve joint publications; scientists who are friendly and agree on many of the big picture issues, disagreeing at times about details and engaging in ‘robust’ discussions; Scientists expressing frustration at the misrepresentation of their work in politicized arenas and complaining when media reports get it wrong; Scientists resenting the time they have to take out of their research to deal with over-hyped nonsense. None of this should be shocking.

It’s obvious that the noise-generating components of the blogosphere will generate a lot of noise about this. but it’s important to remember that science doesn’t work because people are polite at all times. Gravity isn’t a useful theory because Newton was a nice person. QED isn’t powerful because Feynman was respectful of other people around him. Science works because different groups go about trying to find the best approximations of the truth, and are generally very competitive about that. That the same scientists can still all agree on the wording of an IPCC chapter for instance is thus even more remarkable.

No doubt, instances of cherry-picked and poorly-worded “gotcha” phrases will be pulled out of context. One example is worth mentioning quickly. Phil Jones in discussing the presentation of temperature reconstructions stated that “I’ve just completed Mike’s Nature trick of adding in the real temps to each series for the last 20 years (ie from 1981 onwards) and from 1961 for Keith’s to hide the decline.” The paper in question is the Mann, Bradley and Hughes (1998) Nature paper on the original multiproxy temperature reconstruction, and the ‘trick’ is just to plot the instrumental records along with reconstruction so that the context of the recent warming is clear. Scientists often use the term “trick” to refer to a “a good way to deal with a problem”, rather than something that is “secret”, and so there is nothing problematic in this at all. As for the ‘decline’, it is well known that Keith Briffa’s maximum latewood tree ring density proxy diverges from the temperature records after 1960 (this is more commonly known as the “divergence problem”–see e.g. the recent discussion in this paper) and has been discussed in the literature since Briffa et al in Nature in 1998 (Nature, 391, 678-682). Those authors have always recommend not using the post 1960 part of their reconstruction, and so while ‘hiding’ is probably a poor choice of words (since it is ‘hidden’ in plain sight), not using the data in the plot is completely appropriate, as is further research to understand why this happens.

The timing of this particular episode is probably not coincidental. But if cherry-picked out-of-context phrases from stolen personal emails is the only response to the weight of the scientific evidence for the human influence on climate change, then there probably isn’t much to it.

There are of course lessons to be learned. Clearly no-one would have gone to this trouble if the academic object of study was the mating habits of European butterflies. That community’s internal discussions are probably safe from the public eye. But it is important to remember that emails do seem to exist forever, and that there is always a chance that they will be inadvertently released. Most people do not act as if this is true, but they probably should.

It is tempting to point fingers and declare that people should not have been so open with their thoughts, but who amongst us would really be happy to have all of their email made public?

Let he who is without PIN cast the the first stone.
By all means, I encourage you to look at the Google hits yourself and draw your own conclusions. But my quick reaction after 20 minutes of reading is that this is huge. And the coverup by RealClimate is comparable to Paul Krugman dismissing it as "legal quibbling" when the Freako authors showed Joe Romm was being very dishonest with his readers.



Comments:
Re: Phil Jones' second email:
Now I'm a climate noob, but what is it exactly he's trying to say in the part you've bolded? Is it as sinister as I imagine; ie, that they have fudged the data to hide the decline?
 
No whistle-blower there, they got hacked.
 
Wow. So when the email says they hid things (aka created environments for false readings) that is now a "cherry-picked and poorly-worded 'gotcha' phrase[s]..pulled out of context"?!?

This sounds big. Mmm hmm. That response was just a little too anxiously pat and dismissive.
 
I can hear Glenn Beck salivating from my apartment.
 
Luke,

We don't know for sure what happened. The reason I said it was a whistleblower (note I've put in a change) is that that was the original impression in the first post I read, since the person who sent it to the Russian server had a preamble to the effect of, "I thought the world needed to see this" (not an actual quote!).

Also there are some oddities like they didn't call the cops right away, but instead called RealClimate to figure out damage control.

So my point is, the only reason we think it was hacked is that the university is saying it got hacked, right? (Also I think there was a report of RealClimate repelling an attack.)

But like I said I changed the post to reflect this issue.
 
Well, "I thought the world needed to see this" might as well come from a hacker.

The reason I think this info was... shall we say, extracted by an intruder into their systems is that it contains personal e-mail/data from all users, which is something that normally only a system administrator has access to. If all we had was one guy's inbox, now that would be a different thing.
 
http://www.youtube.com/watch?v=uldc1oXpMCE
 
gotcha, bitch!
 
I think the NASA email hits the nail right on the head. I don't know anything about GW or any of that stuff. But I don't see how a few out of context, cherry picked emails proves much.
 
By the way, if somebody were to put a bunch of emails between, say, Hans Hoppe and Lew Rockwell out in the public in which Hans Hoppe said "Selgin disagrees with me on FRB, so I'm going to smear him as a Keynesian and Gene Callahan & Robert Murphy disagree with my argumentation ethics, so they're both commies. The former of course seems to take issue with my advocacy of low time preference, so I'm smearing him as a libertine. All for Murray, of course". it wouldn't mean much at all for libertarianism or Austrian economics...
 
Giles,

What if you found emails saying, "We have this letter in which Mises agrees with Mr. Doe that Hayek was smarter than Rothbard. So we're going to use Hans' white out trick to hide Mises' appreciation of that socialist Hayek.

And man I can't stand Gene's paper. I'm going to be sure to send it to two 'expert' referees who I know hate all Irishmen to keep it out of the QJAE."

You're saying that wouldn't be a big deal, right?

And then of course it also would matter that governments around the world were taking over their energy sectors on the basis of the info maintained by the Mises Institute.
 
Argh, even my analogy doesn't work because what's happening here is much worse. All I discussed was Mises' personal opinions of Hayek, which don't affect Austrian economics per se.

You can't say, "Who cares about their personal lives, all that matters is whether the models are really accurate," because one of the ways we test the models is largely by relying on the integrity of the CRU data.

I am not knowledgeable enough to say how independent the other data sets are, and whether the case for anthropogenic warming would be just as strong even if we had to throw out the entire CRU data. I'm just making the point that your analogy doesn't work Giles because you can evaluate Austrian economics on the basis of the arguments themselves; it doesn't really matter what people were doing behind the scenes.
 
OK, let me trying again then. Let's say Hans Hoppe decides to undertake a thorough examination of the ABCT and he goes back in time and looks at all major business cycles throughout history and decides that in fact every single one of them is consistent with the hypothesis that FRB caused the traditional Hayekian story of what causes booms and busts.

Now, it turns out to be a huge hit. The profession adopts the traditional story of the business cycle etc. and he wins a Nobel prize in economics. Even if there's a few skeptics who think his choice of significance levels was a bit odd and all that sort of stuff.

Now what if it comes out that he had to mess with the data for every example he used and that really the typical story is never applicable. Perhaps somebody discovered an email from him to somebody else.

Does this refute the ABCT? I don't think so, there are still the more sophisticated versions of Garrison et al.

The analogy isn't perfect, but it gets the point across.
 
To make things more clear, I think I can make an argument without an analogy.

I suppose I'm being extra critical cause I see people claiming that this is the end of AGW or some other rubbish. But here's two conditions that need to be met before these emails mean anything:

1) The emails are being intepreted correctly (and haven't been edited),
2) The information that is no cast in doubt was central to the case for AGW.

Now, with regards to 1. I think if you're going to hack into somebody's email there's a good chance that you've got it in for them and that when you put this stuff up on the internet you're probably not going to try your hardest to give the most charitable presentation.

As for 2, I can't even begin to answer that. But I have trouble believing that it was central to the case for AGW.
 
The first email is what leaves a bitter taste in my mouth. You have the head of Hadley conspiring to keep a paper out of the IPCC review. I'm familiar with that paper. It's the one that everyone there should have read first. After looking at a bunch of the emails, it's apparent that they just weren't trying to make their own theory look better than it was. They were actively suppressing other theories of human impacts on climate, like land use. That's where the real travesty is. marty
 
1) The emails are being intepreted correctly (and haven't been edited),

None of these professors cared about digitally signing their emails? If that were the case, you could easily test their authenticity.
 
"2) The information that is no cast in doubt was central to the case for AGW."

I can't imagine how temperature levels and trends aren't central for the case of AGW.
 
If this is the result of a hack we are dealing with the best hacker the world has ever known hands down. When a hacker enter a system, they have a short amount of time to rake in whatever they can find and then GTFO! This is a very comfortable package that has taken a conciderable amount of time to assemble and not something that was done in the span of a hack. Then the hacker should have worked for months, infiltrating, analyzing and collecting. A server is a HUGE filesystem. Those who believe that this is the result of a hack, will have to similarly believe that you can indeed find not 1, not 2, not 10 but 100+ needles in a haystack the size of Kansas. Either the "hacker" knew exactly what they came for and was able to navigate through the filesystems and find all the relevant individual parts which points towards an insider, or the hacker new exactly what package to get. This itself raises questions. who then packed this package and from where did the hacker know what to look for and where? The last suggestion is pure luck, but then again...who compiled the package of data? I think it was an insider job and like many others I think it may be "Harry" who either did it, or compiled the package and then told someone where to look. No evidence for this, but the sheer amount of luck required by a random hacker to come upon this package is just unacceptable.
 
Post a Comment

Subscribe to Post Comments [Atom]





<< Home

This page is powered by Blogger. Isn't yours?

Subscribe to Posts [Atom]