« August 2007 | Main | October 2007 »

Archive by date: September 2007

Ask the editor at Nature Network


Bookmark in Connotea

Corie Lok, Editor of Nature Network, announces a Nature Network-hosted Q&A session with Nature editors. She, as well as some Nature and Nature journal editors (including me) have formed a Nature Network "ask the editor" group, which you are welcome to join (by clicking on this link). At the forum, Corie explains: "Hosted by the editors of Nature Network, this group/forum is for scientists who want to learn more about scientific publishing straight from the editors of Nature and the other Nature journals. Join the group and post your questions in the forum. We’ll do our best to get the right editor to answer them here."
One topic in the forum is, naturally, peer-review. Paul Wicks asks: "Do your peer-reviewers get trained? Should they? I’m conscious of the fact I receive some reviews which I perceive to be unfair because they’ve gone to a non-expert in the field. No doubt some people feel the same way about reviews I write too! Whilst there are pages and pages of guidelines for authors I don’t feel there is much guidance out there for reviewers, and as a reviewer it’s rare to get feedback on my review other than to see what the other reviewer has said."
Go to the peer-review forum to read the answer from Linda Miller, US Executive Editor of Nature and the Nature journals. And please do ask your own questions: we look forward to hearing from you and will be delighted to help.
By the way, the Nature journals' policies, advice and information about peer-review is on our author and reviewers' website.

Peer Review and Scientific Consensus


Bookmark in Connotea

Dr Robert Higgs of the Independent Institute, writes:

Journalists, politicians and advocacy groups refer to “peer-reviewed research” and “scientific consensus” as the authoritative last words on controversial matters involving the natural sciences, from climate change to stem-cell research and genetically engineered foods. But many people have an unrealistic view of how the scientific community actually works.
The peer-review process is not, contrary to popular belief, a nearly flawless system of Olympian scrutiny. Any editor of a peer-reviewed journal who desires to reject or accept a submission can easily do so by choosing appropriate referees.
Unfortunately, personal vendettas, ideological conflicts, professional jealousies, methodological disagreements, sheer self-promotion and irresponsibility are as much part of the scientific world as any other. Peer review cannot ensure that research is correct in its procedures and conclusions. A part of the work in every discipline – from the physical sciences to economics –consists of correcting previous mistakes.
At any given time, “scientific consensus” may exist about various matters. Over time, however, new interpretations, tests or observations may demolish that consensus. For instance, in the mid-1970s, an apparent scientific consensus existed that our planet was about to enter another Ice Age. Drastic proposals, such as exploding hydrogen bombs over polar icecaps to melt them. and damming the Bering Strait to prevent icy waters from entering the Pacific, were put forth by reputable scientists and seriously considered by the US government.
The truth is that scientific research at the upper echelons occurs within a fairly small world. Leading researchers attend the same conferences, belong to the same societies, review one another’s work for funding organizations, and so forth. If you do not belong to this tight fraternity, it becomes extremely difficult to gain a hearing for your work, to publish in a “top” journal, to acquire a government grant, to receive an invitation to participate in a scientific conference, or even to place your grad students in decent positions.
“Scientific consensus” often emerges because the members of this exclusive club, and those who support them, have too much invested in the reigning ideas to let go. In this context, it behooves bright young scientists not to rock the boat by challenging anything fundamental or dear to the hearts of those who constitute review committees of funders or journals. The terms "peer review" and "scientific consensus" often serve to suggest a process of disinterested neutrality and saintly pursuit of truth. Like every other human endeavour, however, science is conducted by people with the full range of human emotions and motives.
Good rules of thumb for the non-scientist might be the following: government-funded research that is used to justify that government’s policy should be suspect, whether or not it’s peer-reviewed; and the research of scientists who appear at press conferences in the company of politicians or activists whose agendas they are there to support should be suspect, whether or not the work upholds the consensus opinion.

Robert Higgs is Senior Fellow in Political Economy at the Independent Institute, editor of the quarterly journal The Independent Review, and the author of Depression War and Cold War, as well as numerous books and more than 100 articles in scholarly journals.


Ethical duties cannot be outsourced


Bookmark in Connotea

Leonard H. Glantz of the Boston University School of Public Health writes in Nature's Correspondence page (Nature 449, 139; 2007):
Your News Feature 'Trial and error', on the problems with research ethics committees designed to establish whether a proposed experiment is ethically sound (Nature 448, 530–532; 2007), presents avoidance of liability and the desire to retain power as the main reasons why institutions favour local control over centralized review. But institutions are ethically, not just legally, responsible for what happens to human subjects under their care.
Research is a suspect activity designed to advance knowledge, not benefit individuals. This does not denigrate its importance but rather reminds us why experiments involving humans are regulated differently from other kinds of research, and more heavily.
If a central institutional review board says it's fine to enrol patients into a project, this does not mean that the institution involved can ignore its obligation to protect the rights and welfare of human subjects in its facility. Any institution that outsources its ethical responsibilities towards subjects should not be allowed to conduct research on human beings.

NIH grant-assessment system under review


Bookmark in Connotea

The (free access) Editorial in this week's Nature (Nature 449, 115; 2007) argues that "the peer-review system used by the $29-billion National Institutes of Health (NIH) is more than half-a-century old, and is showing its age. It has become stretched by the breadth of today's science, in which inter- and multidisciplinary grant applications are common, and by the sheer volume of submissions in an era in which one-grant labs have gone the way of the dinosaur......A radical transformation is urgently needed."
The Editorial describes how the NIH solicited ideas from leaders of scientific societies in Washington DC this summer, and will contine to gather opinons at meetings in Chicago, New York and San Francisco this month and next. About 2,000 electronic opinions were also submitted. The goal is to create concrete recommendations by early this winter, with pilot projects to follow as soon as next spring.
The NIH have asked for 'creative' and even 'radical' ideas. One such, states the Nature Editorial, is the proposal of the Association of American Medical Colleges to "allow individual scientists to have only one application of a given kind in the system at any one time. Multiple grants could still be held by one scientist, but he or she could have only one application per mechanism under review. This would compel self-selection of the best proposals by scientists upstream of the review process. To be workable, this would necessitate a funding cycle that lasts at most six months rather than the current ten. But that compression is highly desirable in any case and has already been accomplished in pilot trials.
Such an approach can only help the most creative scientists by stemming the current deluge of applications. It's a radical idea but, for that reason at least, an excellent one."
The full text of the Editorial is available here.
The NIH Center for Scientific Review is here.