Peer-to-Peer

Paying taxes is not a qualification for assessing research programmes

2008-05-06T15:22:10Z

Massimo Pinto has discovered an unusual qualification for being a peer-reviewer: paying your taxes. Since 2006, Italians have been allowed to donate 0.5 per cent of their taxes to charity in a highly specific way (previously, such donations had to be made to the church or the state). On his Nature Network blog Science in the Bel Paese, Dr Pinto points out that one can elect to donate one's contribution to specific research institutes. Leaving aside the fact that some of the intended recipients do not yet seem to have received their 2006 or 2007 contributions, specifying an individual project could have the effect of bypassing the peer-review system, particularly in Italy, where science funding levels are low. Dr Pinto writes that taxpayers have three choices:

--donate to funding agencies. It happens in many countries of the world. As long as the agency is committed to assign that money in a transparent manner, including, possibly, peer review, that should be fine.
--donate to individual institutes. In this way, taxpayers may be exercising a little peer-review power. Less troublesome, perhaps, if the institute acts, internally, as the agency above. Still, it is not obvious why institute A should be so much better than institute B. Maybe the cleverest scientist, with the best idea right now, is in institute B.
--donate to a specific project. Here the taxpayers are exercising bolder peer-review powers, and that raises a red flag

As some institutes have taken to advertising the importance of their research and the difference one's money would make to humanity (no details provided in the advertisements), there is definitely scope for a loophole or two to be closed. As Dr Pinto puts it, "The particular advert that irritated me was a dialogue between two young citizens; one was asking whether the researcher in XYZ University were really going to deliver results, and the other one replied, reassuringly, that they were among the very best in Europe. Donating to them was a guarantee of success."

Refining and communication of science via blogs

2008-04-29T10:26:39Z

This post is a continuation of the discussion about blogging and peer-review by selected reactions at RealClimate (a climate scientists' community blog) to Nature Geoscience's two commentaries on blogging.

Philip Machanick writes that the "problem with blogs is that there is no way for an outsider to know which are reasonably careful creations of informed scientists, which are opinions of the scientifically illiterate, and which are astroturf creations designed to confuse critics of science that is in conflict with an industry. Given that terrain, I would rather have something like RealClimate than not: it helps to balance things out. Errors tend to be corrected quickly here as a consequence of a large informed readership (even if it is sometimes annoying that you get drive-by ignoramuses who don’t benefit from getting their misconceptions answered). He goes on to suggest that a site such as RealClimate is of value in providing a forum for rebuttals of peer-reviewed science in order to develop a consensus on whether a "formally published rebuttal is worth the effort".

Ray Ladbury's view: "When it comes to peer reviewed papers, one has to presume the reader will have a minimum level of familiarity with the subject matter. One also presumes that the reader will have a day job, and so the question becomes whether the information in the paper is of sufficient interest to the average scientist in the community to say, “Hey, take a look at this. It looks mostly correct to me and has some interesting information/insights/methods…” This is not in any way the gold standard in the sciences. The gold standard comes when the community as a whole says, “Hey, cool, I can use this.” The paper is cited. The techniques are used. Science advances. Eventually, what was in the paper becomes part of the tacit knowledge assumed by reviewers.
The tacit knowledge one can presume for a blog like Realclimate is much lower. One presumes there is an interest in the subject–why else would the reader be perusing the blog. One presumes at least a passing acquaintance with the scientific method and maybe some familiarity with basic results like conservation of energy, etc. One could perhaps assume that the average reader has taken the time to acquaint him- or herself with material to which one is vectored via the “Start Here” button–although this is far from Universal.
For the average newspaper reader of a science story, the tacit knowledge is nearly nonexistent–or worse, wrong. And then we have the blogosphere, where information density is at best, rarified and often toxic.......in an information economy, it seems that all too many readers and journalists are content to remain paupers."

What the job of an editor is all about

2008-04-23T10:44:38Z

In a comment to an earlier Peer to Peer post, 'Regular Scientist' takes issue with Nature Cell Biology's definition of a good report, writing (slightly edited for length): the journal sometimes asks the authors to undertake many experiments even before sending a paper to review. Not strangely, papers in Nat Cell Biology, even small reports, contain many Supplementary Figures (up to 20, I´ve seen). I miss the old days where publications were for sending a very interesting result so you could extend it and discuss its importance for your field. Nat Cell Biology's system is undermining research efforts in the authors´ labs, which have to dedicate an enormous effort to provide many additional experiments that don´t even add much to the concept. This is not what science, and the peer-review process, should be about. I would recommend the editors of Nat Cell Biol a calm reading of the original paper on the structure of nucleic acids, and note the way it was written.

Bernd Pulverer, Chief Editor of Nature Cell Biology, has kindly agreed to my request to write a guest post to respond, and to elaborate on the journal's practices and policies:

As ‘Regular scientist’ points out, we do strive to publish rather well-developed studies in Nature Cell Biology. It is interesting to read the concern about the supplementary information, since we usually hear the opposite complaint: namely that the tight format restrictions applied preclude presentation of complete datasets. In considering submissions, we expect fewer details of molecular mechanistic analysis if the paper reports a highly novel observation. And because the study of cell biology tends to throw up surprising new findings that deserve a wide audience but that cannot be developed in a reasonable timeframe, we decided some years ago to publish a short ‘Brief Communication’ format, which I hope is appreciated by Regular Scientist.
In the Editorial under discussion, we wrote:

Nevertheless, the most important part of the report is assessment of the data: are key experiments or crucial controls missing? Are the data significant and definitive? Are all claims made supported by the data? A black and white model should not be a requirement — in fact it often underestimates biological complexity. Formulate a clear set of recommendations for additions or improvements. Experimental suggestions are important even if an outright rejection is recommended, as it makes for a transparent and constructive report that will allow the author to improve the dataset and select an appropriate target journal. If the overall assessment is positive, do not feel obliged to ask for non-essential experiments. New experiments should add key information, buttress claims or improve existing data, and they must be achievable. Indeed, the perception that referees invariably ask for more data encourages some authors to hold back data in the hope that these will be requested and can then be provided by return post; clearly, this is a futile exercise. Referees and editors alike should take great care that all key issues are raised in the first assessment — draw a line and adhere to it. Subsequent evaluations may raise issues on new data, but raising yet more ways to develop a study is not fair.

We, the Nature Cell Biology editors, agree that one can always ask for more data, and that sometimes data require an unrealistic amount of effort for the information added. However, we entirely disagree that our editorial and review process does not result in the publication of much-improved datasets. The tendency of referees to feel an obligation to ask for some new data, and conversely for authors to hold back data to give referees something obvious to ask for, is an issue that we tried to address in the Editorial.
We certainly do not ask for more data because we, the editors, feel under any compulsion to do so: the simple fact is that a good number of manuscripts submitted to the journal are rather premature, and we cannot justify wasting our referee’s time when we perceive obvious holes in a dataset that the referees would invevitably want to be addressed. We believe that this step is in an author’s interest, since we will not undertake multiple rounds of peer-review without good reason. If requested data are deemed to be unobtainable for technical reasons, or indeed unnecessary, we are always willing to hear an author’s arguments.
Regarding the 1953 Nature paper that Regular Scientist recommends: indeed, the paper is a good read. However, science has become much more complex since then, and the discoveries often more detail-oriented, requiring a more in-depth analysis. At the same time, the tools available have developed tremendously in 55 years. Even in 1953, readers will note that Watson and Crick's conclusions depended on the two following papers in the issue, providing experimental details. The challenge is to set ‘the bar’ correctly to what is achievable and what should be achieved for publication in a top-flight journal. This is what the job of an editor is all about.

To many, blog posts are the face of science

2008-04-16T08:21:02Z

Continuing the discussion of the relative contributions of blogs and the peer-reviewed literature to scientific understanding, I'm highlighting another reaction to the two Nature Geoscience Commentaries presenting different perspectives.
In the comment thread at Real Climate blog, Simon Donner of the University of British Columbia writes:

"Blogs have created a forum for many people to informally discuss science. They are also a great forum for scientists to provide context to their own work and to the work of others in their field.
And some of the time, that may take the form of criticism. That’s ok. But we do have to be careful in blurring the line too much between peer-reviewed publications and blogs. The first problem is the obvious one. Blog posts are unfiltered, un-reviewed, and often written off the cuff, while journal articles are screened, reviewed, and (should be) meticulously researched. It is far easier to write a criticism of a paper on one’s blog than to write a response and submit it to the journal. The issue isn’t just that no reviewers check the work… the blog author is unlikely to do even close to the amount of research and analysis nor give the wording nearly the same level of consideration as is expected in a paper submitted to a high-quality, peer-reviewed journal.
The other problem is that blog posts are readily accessible to anyone at anytime, both in language, and in the unlicensed nature of the internet. To a huge swath of the public, blog posts are the face of science. Like it or not, bloggers with scientific credentials are like self-appointed ambassadors for science. If we are going to write about our science, we should do it with thought, and we should do it well. That is a standard that myself and many other science bloggers often struggle to meet."

Judge's ruling protects confidentiality

2008-04-11T14:11:51Z

From Nature 452; 677; 2008:
A federal magistrate in Massachusetts last week ruled that The New England Journal of Medicine (NEJM) does not have to comply with a subpoena issued by Pfizer forcing the journal to provide confidential peer-review documents related to the painkillers Celebrex (celecoxib) and Bextra (valdecoxib).
The drug firm had tried to compel the journal to hand over peer reviews and internal editorial discussions for 11 papers on the painkillers. It argued that these would help it defend the arthritis drugs in lawsuits alleging that they caused heart attacks and strokes (see Nature 452, 6–7 ; 2008 and this post on Spoonful of Medicine blog).
In his 12-page opinion, Leo Sorokin wrote that the material Pfizer sought seemed relevant on first examination, but that “NEJM's interest in maintaining the confidentiality of the peer-review process is a very significant one … and tip[s] the scales in favor of the NEJM" .
The judgement comes three weeks after an Illinois judge ruled against Pfizer after it issued almost identical subpoenas to The Journal of the American Medical Association and Archives of Internal Medicine.
The Nature journals' guidelines for reviewers state: "Reviewers should be aware that it is our policy to keep their names confidential, and that we do our utmost to ensure this confidentiality. Under normal circumstances, blind peer-review is protected from legislation. We cannot, however, guarantee to maintain this confidentiality in the face of a successful legal action to disclose identity in the event of a reviewer having written personally derogatory comments about the authors in his or her reports. For this reason as well as for reasons of standard professional courtesy, we request reviewers to refrain from personally negative comments about the authors of submitted manuscripts. Frank comments about the scientific content of the manuscripts, however, are strongly encouraged by the editors."
We are advised that if peer-reviewers follow this advice, it would be extremely unlikely that there could be legal grounds to force their identities to be revealed.

Sharing insights with researchers

2008-04-10T18:15:49Z

The two Nature Geoscience Commentaries expressing opposing views on blogging's role in science research communication have been much discussed in the blogosphere (see Climate Feedback blog, for example.). One discussion took place at RealClimate blog, where Gavin Schmidt's post about his Nature Geoscience view on how science blogs and traditional peer-review intersect has attracted more than 100 online comments from climate scientists and others.
One commenter, "Tamino", writes: "Blogs don’t serve very well for communication among scientists. Peer review does more than just protect us from being inundated with substandard work; it protects authors from their own mistakes and improves the quality of what we write. Peer review itself is an immensely valuable avenue of communication; who among us hasn’t at some time included a phrase like “We thank an anonymous referee for comments and suggestions which dramatically improved the final manuscript”?
But as bad as blogs are for actual research, peer-reviewed journals are far worse for communicating with and educating the lay reader. Yet when it comes to climate science the lay public is hungry for knowledge, and many of them are eager, and well-prepared, for a level of sophistication and detail that can’t be found in lay journalism or even popular literature; An Inconvenient Truth isn’t enough. So blogs serve an incredibly useful purpose, enabling the interested and well-educated reader to share insights with researchers who are at the cutting edge of new knowledge.....................while blogs aren’t part of the machinery for legitimate scientific research, they’re an indispensible tool for communication and combating misinformation."

More to follow.

Will NIH's overhaul be cosmetic or curative?

2008-04-07T11:39:58Z

The first phase of the NIH review of the peer-review system was completed on 28 February , when the final draft of the 2007–2008 Peer Review Self-Study was submitted to NIH (US National Institutes of Health). In advance of NIH's announcement this Spring about the changes to be implemented, this month's (April) Editorial in Nature Medicine (14, 351; 2008) explores whether the NIH recommendations of a major overhaul of the system are likely to be cosmetic or curative.
The grant review process is onerous for both applicants and reviewers. According to the report, the success rate of first-time applicants (for A0 grants) is on the order of eight per cent. On average, investigators submit a grant three times before securing funding. Reviews can vary dramatically depending on the study section, and funding decisions often seem arbitrary. From a reviewer's standpoint, applications are long and numerous (about seven per reviewer), and the large time commitment dissuades many of the best-qualified people from participating in a process that lacks uniform review criteria, consistency and, arguably, objectivity. The report identifies seven main challenges to enhancing NIH peer review, each of which is described in the Nature Medicine Editorial. But, as the Editorial points out, the problem of too many researchers chasing too few dollars remains. More money won't alleviate administrative burden or improve the quality of reviews.
NIH's Enhancing peer-review report and next steps can be viewed here.

What constitues a good report?

2008-04-04T11:29:44Z

Nature Cell Biology continues its coverage of peer-review in its (free access) April Editorial 'Good review' (Nat. Cell Biol. 10, 371; 2008).
After stating the rationale for peer-review, the Editorial asks whether reviewing is essentially an altruistic activity, or whether there are significant rewards for doing it. "The biggest benefit of refereeing is probably to stay engaged with the scientific community in a sort of 'real-impact journal club'. We review less than a quarter of submitted manuscripts, with the aim of involving referees only for studies that seem worthy of publication. This saves time for authors, and referees know that the manuscripts they receive meet a minimum standard, so that refereeing should be an enriching experience. Nevertheless, the time commitment for refereeing is considerable and we are campaigning to ensure that this is taken into account in assessing research performance."
Although much has been said about alternatives and enhancements to 'single-blind' peer review, what actually constitutes a good referee report? The rest of the Editorial provides some answers, which are further explored at our author and peer-reviewers' website.
Nature Cell Biology's previous editorial (March 2008) is discussed here.

Role of blogs in communicating scientific knowledge

2008-04-01T14:56:16Z

Scientists know much more about their field than is ever published in peer-reviewed journals. Blogs can be a good medium with which to disseminate this tacit knowledge, according to Gavin Schmidt of the NASA Goddard Institute of Space Studies Columbia University, and co-founder of RealClimate.org, in a Commentary in the April issue of Nature Geoscience (1, 208; 2008). Dr Schmidt asks "why read a blog when you can go directly to the scientific literature? Unfortunately, access to new findings in the traditional way is harder than it should be. Many technical papers are behind pay-walls, which make it impractical and expensive for unaffiliated individuals to read them. More importantly, however, even when papers are freely available, they often do not provide the insight expected."
In another Commentary in the same issue of the journal (Nat. Geosci. 1, 209; 2008), Myles Allen of the University of Oxford agrees that "explaining science to journalists and the public on blogs is fast and efficient." But after his own bruising experience, he wonders: "is it all just too good to be true? Can science survive Web 2.0?"
After describing his own difficult experiences of having his own peer-reviewed work criticised and misinterpreted by people who would not subject their own conclusions to peer-review, Dr Allen concludes: "Everyone agrees we need to communicate science better to the general public. But more and faster should not be confused with better. I'm certainly not advocating closing science blogs or discouraging science websites. We just need to remember the basic courtesies that our doctoral supervisors took for granted: criticism of peer-reviewed results belongs in the peer-reviewed literature. Direct communication over the Internet, far from creating a level playing field, just ploughs it up and makes the game impossible. The problem is, without witty and cutting criticisms, what is the point of a blog? Sure, the peer-review system is creaking. Sure, science journalism sometimes trips up. But like Churchill's quip about democracy, it is the worst possible system for communicating scientific results, apart from all the alternatives that have been tried from time to time."
Yet Dr Schmidt remains optimistic: "Some may dismiss blogs as being a distraction from real scientific work, or of egging on the very controversies that we seek to diffuse. There is an element of truth to both of these claims. But the response should not be a return to the ivory tower. That simply leaves the field clear for those who prefer to confuse rather than enlighten. With the importance of science in policy decisions being more apparent than ever, our ability to do science and enhance its relevance in public life relies on the community's willingness to engage, inspire and inform. Blogs are one way to do that, and they can excel at providing the context that is so often missing in other media. Not every scientist needs to have one, but maybe every scientific field does."

Nature Neuroscience joins neuroscience peer-review consortium

2008-03-31T09:18:56Z

Nature Neuroscience is joining a consortium of journals that enables reviews to be transferred from one journal to another, while allowing authors, referees and editors to control their degree of participation in the system flexibly. The reasons for the decision are explained in this month's (April) Editorial (Nat. Neurosci. 11, 375; 2008). Briefly, in January, a group of editors, supported by the Society for Neuroscience, implemented a system for transfer of submitted manuscripts between journals that allows voluntary participation by authors, referees and editors, known as the Neuroscience Peer Review Consortium. This consortium reduces the overall reviewing workload of the community by allowing authors to continue the initial review process when their paper moves from one consortium journal to another, once the paper has been rejected or withdrawn from the first journal. This arrangement is similar to the manuscript transfer system that has been available within the Nature family of journals , and all the other journals published by Nature Publishing Group, for almost a decade.
The neuroscience transfer system, described in detail in the Editorial and at the Neuroscience Peer Review Consortium website, is voluntary for authors and peer-reviewers. Journal editors have full discretion in deciding how to use transferred reviews. The receiving editor may choose to accept or reject a paper based on these reviews, without further consideration; to send the paper to some or all of the previous referees for evaluation of the authors' revisions; or to request a fresh set of reviews from new referees. Only comments to the authors are transferred to the receiving journal. Confidential comments to the editors are not passed along. Thus, to ensure transparency in the review process, both at Nature Neuroscience and at other journals after the paper has been transferred, journal editors encourage referees to include all their concerns about the paper in comments to the authors. According to the Nature Neuroscience Editorial, the small amount of extra time required to phrase comments diplomatically for the authors should be more than counterbalanced by the resulting improvement in the peer-review process.
Many members of the community have strong views on the issue of confidential comments, which can be found on the Action Potential blog, and which has previously been discussed at Peer to Peer. The success of the neuroscience journals' transfer system will be evaluated at the end of this year. Nature Neuroscience editors will also be evaluating the journal's participation on an ongoing basis, so they encourage authors, referees and readers to share their comments with the editors, either on Action Potential blog or privately by e-mail.

Many grants to few researchers

2008-03-20T14:05:07Z

In an analysis reported in a News story in Nature this week, 222 NIH grants: 22 researchers (Nature 452, 258-259; 2008), it emerges that 200 scientists received six or more grants each from the US National Institutes of Health (NIH) in 2007. One principal investigator was awarded 32 grants, and many others got eight or nine. This is counter to the recommendation last month by the advisory panels reviewing the NIH peer-review system that researchers should devote at least 20% of their time to any project awarded a research grant (see Nature 451, 1035; 2008).
According to the Nature news story, NIH director Elias Zerhouni says that the inequities between the haves and have-nots were caused by a doubling of NIH funding between 1998 and 2003. As funding levels rose, many new PhD positions were created. Established investigators, using data produced by the new PhDs, were able to submit better grant proposals. But hordes of these grant-hungry PhDs were left standing when NIH funding flattened out after 2003. The agency now funds significantly more people over the age of 70 than under the age of 30. “We're eating our seedcorn,” says Zerhouni. Changes to the NIH peer-review system will be unveiled in mid-April.

See the related article by Gene Russo in NatureJobs (Nature 421, 381; 2008).

Why there is not much online discussion of neuroscience research

2008-03-17T14:00:25Z

Noah Gray, an editor at Nature Neuroscience, asks at Action Potential blog why neuroscientists are passing on the seemingly golden opportunity to communicate with one another online, for example on published articles at a journal website, or in an online journal club. Many have expressed opinions about reasons for this reticence: Noah links to some articles in his well-argued post, and you can read other thoughts (and find links to some of the same articles) at Nature Network (for example at Gobbledygook and at Flags and Lollipops).

Here, I'd like to highlight a response by "Michael" in the comment thread to Noah's Action Potential post, as I believe this summary covers many, if not all, of the reasons why scientists in a discipline tend not to post comments on, and discuss, scientific research papers online. "Michael" writes:

I think there are a number of reasons as to why “Web 2.0” has not played much of a role in discussing neuroscience research. In no particular order:
1) Inefficiency: If I want to know why somebody used buffer x for their biochemistry experiments, or why they didn’t do control experiment xyz I email the authors, or use the phone if I know them. Why post it in the comment section of their paper, and wait for 5 weeks until they bother to check? And why does everybody else need to know about it?
2) Lack of dialogue: Commenting forums are poor venues for true dialogue. If you analyse the comment sections for the more popular entries, either here or elsewhere (for example the New York Times) there rarely is a true back-and-forth of ideas. All too often it’s 50 comments trying to be as witty as possible, with few people attempting to follow and respond to what others have written. There are rare cases where a small number of like-minded people post thoughtful comments at just the right rate to allow for a meaningful discussion. Without some type of moderation, it will remain the exception. The dynamics of a true group discussion, be it at a Journal Club or at your poster, are often taken for granted, but can’t be easily replicated online.
3) Who is commenting: It’s fine to have a democracy of opinions: in science, I don’t care so much about it. The people I want to hear/read often choose not to comment, whereas others who have nothing to say keep posting.
4) The Fear Factor: This one is obvious, and is why scientists have lab meetings or face-to-face Journal Clubs. It’s also why attempts to discuss papers online haven’t quite lived up to expectation. Ideally, we want to be honest in our opinion of a paper, but we are also human and don’t want to suffer the consequences of bruising the ego of a potential reviewer or search committee member. Staying anonymous is not the solution, since that makes it difficult for everybody else to properly evaluate the comment. After all, it does matter who is doing the criticizing.
5) Speed: Even the liveliest online discussion of a paper will drag on over hours or days. If a paper grabs my attention I will discuss at a lab meeting or Journal Club and over the course of one hour we will have thoroughly dissected it. Our attention span only lasts so long. Again, the online dynamics of who logs in at what time don’t allow for a true discourse that leads to some sort of resolution.

Open review at Scholarly Research Exchange

2008-03-12T13:09:54Z

The newly launched journal Scholarly Research Exchange, published by Hindawi, is for original research articles in all areas of science, technology and medicine. The journal is operating a transparent peer-review system, in which authors and reviewers interact directly throughout the peer-review process. Authors submitting to Scholarly Research Exchange suggest potential reviewers, who are then approved by the journal's editors. Reviewers are asked to provide an assessment of the quality of the manuscript, a written critique for the authors, and a written commentary for the journal's readers. When the journal accepts its first articles for publication, the reviewers' commentaries and their assessment of the manuscript's quality will be published with them. In addition to these reviewers' evaluations, members of the scientific community will be able to participate in a discussion around every manuscript.
A journal with a similar, but not identical, peer-review process is Biology Direct, published by BioMed Central, currently covering the areas of genomics, bioinformatics and systems biology, immunology, and mathematical biology. Biology Direct makes the author responsible for obtaining reviewers' reports, via the journal's editorial board, operates an open peer-review process, and publishes reviewers' reports with the articles. It has been publishing articles since January 2006.

Nature Nanotechnology on reviewer performance statistics

2008-03-10T14:47:20Z

How many papers does the typical researcher review in a year? How long do they take? And why do they do it? For the answers, read the Editorial in this month's (March) issue of Nature Nanotechnology, "Who'd be a referee?" (3, 119; 2008). The Editorial reports some of the findings of the recent Publishing Research Consortium report on peer-review (previously discussed at Peer to Peer), whose survey revealed that the "average review takes about 8.6 hours (with a median of about 5 hours) and is completed within 3–4 weeks, although there are significant differences between the four broad subject areas covered by the survey: in the physical sciences and engineering, for instance, the average (mean) is 10.4 hours, compared with 6.3 for clinical researchers. Of course, on top of this, many researchers spend considerable time reviewing grant applications for funding agencies, which can be equally onerous and possibly even more important than reviewing papers."
For similar statistics, and a more general discussion of the peer-review process in publishing, see the Nature Nanotechnology Editorial, or see here for Nature Cell Biology's take.

Nature Cell Biology's peer-review process

2008-03-06T10:24:06Z

This month's (March 2008) free-access Editorial in Nature Cell Biology (10, 247; 2008) addresses the journal's peer-review process: specifically, what the journal does to ensure that its selection process is fair.
From the Editorial:
"A legitimate question for editors at Nature Cell Biology is whether we are considering alternatives to the status quo of anonymous peer review, in particular, why we do not use a 'double blind' process (which received significant endorsement in a recent survey of the Publishing Research Consortium). The existing process, based on a thorough pre-selection by five full-time editors and subsequent external peer review by carefully selected referees, works well — individual stories of woe notwithstanding."
The editorial goes on to outline how changes to the system, when being considered, must show a demonstrable improvement to the process. Several of the commonly proposed alternatives to the 'single blind' system are discussed in this light (see here for a recent popular debate on the topic at this blog). The Editorial concludes with a summary of the process as currently run by the Nature Cell Biology editors, together with the journal's planned enhancments.
The editors welcome your views on the Editorial as comments to this post.
Further information about the Nature journals' peer-review policies are available at the authors' and reviewers' website.
Connotea tags for peer-review.