Main

Archive by category: Data

Bookmark in Connotea

CRU data hack

Everyone's talking about the CRU data hack. Quirin Schiermeier reports on Nature News:

One of Britain's leading climate-research centres has had more than 1,000 files stolen from its computers and republished on the Internet. The cyber-attack is apparently aimed at damaging the reputations of prominent climate scientists.

The full story is here:

Bookmark in Connotea

WCC-3: Global ‘climate services’ framework agreed, but long process ahead

Heads of state agreed yesterday in Geneva to establish a global framework to deliver climate services to society. “We agreed on the need for climate services across all nations”, says Martin Visbeck, chair of the committee of scientific experts to the World Climate Conference.

The global framework will oversee the supply of demand-driven climate data to end-users such as farmers to water-resource managers, with the ultimate aim of aiding adaptation to climate change. Climate services would particularly help developing nations, for example, many of which lack access to the weather and climate observations needed to plan their global-warming adaptation strategies.

But the implementation of such services will face several political and scientific hurdles. Over the next four months, an independent task force set up by World Meteorological Organization, which convened the conference, will work out how to make this vision a reality. An arduous 12-month consultation process with signatory nations will then follow.

I’ve reported this for Nature News in full here. The news story covers the scientific challenges ahead in moving from climate ‘projections’ to decadal scale ‘predictions’, and also looks at the issue of data sharing, which will be require some careful negotiating over the coming months.

Ultimately, delegates expressed optimism about the vision agreed in Geneva this week, but there are concerns about how tough its implementation will be. According to Visbeck, the deal was much stronger on Tuesday, but “an unfortunate negotiation” meant that a couple of keys aspects were changed late in the day. One crucial change is that WMO is now ‘convening’ the implementation strategy rather than leading on it. Lacking one organization at the helm, the process of decision making could become that much harder. Secondly, a clause was added that says to all UN member states can weigh on each stage of the implementation plan before the final report is delivered to WMO in January 2011. “We didn’t achieve the maximum achievable”, says Visbeck.

In the meantime, however nations are charging ahead with implementing serivice-oriented climate science on their own steam. In July, Germany opened a national climate services centre in Hamburg, and the US is currently discussing plans for a national climate service in Congress and among relevant agencies.

Olive Heffernan

Bookmark in Connotea

WWC-3: Should all climate data be freely available?

Following the recent discussion here on access to climate data, it’s been interesting to see the theme emerge in Geneva this week at the third World Climate Conference.

Almost 2,000 climatologists, weather forecasters and policy makers have come together to discuss the need to develop climate services that will enable adaptation to climate change. Better predictions of the changes to come will form the basis of such services. But in order to predict climate change more accurately and over smaller areas and time periods, investments in observations, research and computing will be necessary.

Delegates here are hoping that governments will commit to investing in these areas, but some say it’s also crucial that observational and modelled data become available to others. “It’s absolutely crucial. The societal importance far outweighs any commercial benefit”, says Ralph Rayner, chair of the scientific committee of the Global Ocean Observing System, an international effort to monitor marine variables. José Achache, director of the Group on Earth Observations, agrees. “We need more observations. Commerce and security are limiting the availability of some necessary and useful climate data”, says Achache.

That’s a bit of a thorny topic here, because some Met services package proprietary data and sell it to users. But it’s also a complex issue, says Vicky Pope of the UK Met Office, which operates as a trading fund. She says that a lot of data are made freely available by Met services, but that detailed climate data has commercial value. Pope also points out that nothing is ever free. "The tax payer is actually paying, and one of the reasons we charge users is so that the taxpayer doesn't pay too much".

Speaking at the conference on Monday, Jean-Jacques Dordain, director general of the European Space Agency, promoted sharing of climate data. “We are sharing our data. We are providing our data to African nations and are cooperating with other nations”

There have been vast improvements in data sharing in recent years, says Achache, but he warns that there is the risk of moving backward in certain areas. For example, some nations are calling for restrictions on data collected from ARGO oceanographic data buoys when they drift inside a country’s Exclusive Economic Zone, he says.

Kuniyoshi Takeuchi, director of the International Center for Water Hazards and Risk Management in Japan says that lack of access to climate data other than by climate professionals in rich nations is a problem. “Local ownership of climate information is needed for human empowerment” says Takeuchi.

Climatologist Jerry Meehl of the National Centre for Atmopsheric Researc in Boulder, Colorado says “it would make things a lot easier” if climate data were openly available to all, though he says that scientists probably should be allowed a grace period in which they have exclusive access to the results.

Olive Heffernan

Bookmark in Connotea

McIntyre versus Jones: climate data row escalates

Many of our readers will no doubt be aware of the long-standing dispute between Steve McIntyre and members of the climate science community whose data McIntyre is keen to get hold of.

For those of you less familiar with the story, here’s some background. McIntyre, who runs the Climate Audit blog, is best known for questioning the validity of the statistical analyses used to create the ‘hockey stick’ graph. The ‘hockey stick’ is the graph that illustrates the past 1000 years of climate based on palaeo proxy data and was published by Penn state climatologist Michael Mann and co-authors in Nature back in 1998.

More recently, McIntyre has turned his attention to criticizing the quality of global temperature data held by institutes such as NASA’s Goddard Institute of Space Studies. Several organizations worldwide collect and report global average temperature data for each month. Of these, a temperature data set held jointly by the Climatic Research Unit (CRU) at the University of East Anglia and the UK Met Office’s Hadley Centre in Exeter, known as HadCRU , extends back the farthest, beginning in 1850.

Since 2002, McIntyre has repeatedly asked Phil Jones, director of CRU, for access to the HadCRU data. Although the data are made available in a processed gridded format that shows the global temperature trend, the raw station data are currently restricted to academics. While Jones has made data available to some academics, he has refused to supply McIntyre with the data. Between 24 July and 29 July of this year, CRU received 58 freedom of information act requests from McIntyre and people affiliated with Climate Audit. In the past month, the UK Met Office, which receives a cleaned-up version of the raw data from CRU, has received ten requests of its own.

I’ve reported the full story for this week’s Nature, but here’s a breakdown, plus some details that didn’t make the cut.

Why does McIntyre want the data?
Given McIntyre’s track record in critiquing data that comprise a significant part of the evidence for global warming, one might wonder whether he is in fact interested in having a go at reproducing the global temperature record. But McIntyre insists hat he’s not interested in challenging the science of climate change, or in nit-picking; rather he is simply asking that the “data be made available”.

Why won’t Jones give McIntyre the data?
Jones says that he tried to help when he first received data requests from McIntyre back in 2002, but says that he soon became inundated with requests that he could not fulfill, or that he did not have the time to respond to. He says that, in some cases, he simply couldn’t hand over entire data sets because of long-standing confidentiality agreements with other nations that restrict their use.

Although Jones agrees that the data should be made publicly available, he says that “it needs to be done in a systematic way”. He is now working to make the data publicly available online and will post a statement on the CRU website tomorrow to that effect, with any existing confidentiality agreements. “We’re trying to make them all available. We’re consulting with all the meteorological services – about 150 members of WMO – and will ask them if they are happy to release the data”, says Jones. But getting the all-clear from other nations could take several months and there may be objections. “Some countries don’t even have their own data available as they haven’t digitized it. We have done a lot of that ourselves”, he says.

Are there likely to be 'holes' in the data’?
Everyone agrees that raw station data are imperfect; that’s why they are cleaned up before being handed over to the UK Met Office. Jones says that existing issues include stations being relocated without being renamed, but he emphasises that these minor errors do not affect the global temperature trend, because there are thousands of individual stations collecting data worldwide at any one time.

McIntyre says that he does not expect to find any major errors in the data. But he also believes that too few resources are put into quality checking climate data, and that independent professional statistical services should be employed to check the data. Any thoughts on who might offer such services?

What was the CRU ‘data purge’ about?
A couple of weeks ago, it became clear that McIntyre had in fact retrieved some of the HadCRU data from a server on the CRU website. On realizing this, CRU immediately removed the data from their website, leading to speculation about a CRU ‘data lockdown’ over on Climate Audit. It transpires, however, that these data were on an anonymous ftp server intended for Met Office Hadley Centre project partners only, and were not for public use.

What’s next?
Given that McIntyre’s wish for access to the data will take time to be granted, this dispute will likely continue for some time. He’s especially aggrieved by the fact that hurricane expert Peter Webster at Georgia Tech University was recently provided with data that had been refused to him. McIntyre’s point here is that he should be treated as a legitimate academic given his background and publication record.

But Webster points out that he was allowed access because of the nature of his request, which was very specific and will result in a joint publication with Phil Jones. “Reasonable requests should be fulfilled because making data available advances science”, says Webster, “but it has to be an authentic request because otherwise you’d be swamped".

Once the data become publicly available, Jones wants McIntyre to produce a global temperature record. “Science advances that way. He might then realize how robust the global temperature record is”, says Jones. Asked if he would take on the challenge, McIntyre said that it’s not a priority for him, but added “if someone wanted to hire me, I’d do it”.

Olive Heffernan

Categories