Comment on Heredity papers

Inherently Responsive is the blog of the journal Heredity, published by NPG. As explained at the post Your chance to respond, the journal is seeking to improve its peer-review process using the opportunities provided by the web. One proposed model is to publish papers accompanied by referees’ comments, another is to publish correspondence columns in the journal after publication of the paper, to air legitimate differences of scientific opinion.

Inherently Responsive combines aspects of these two approaches. It publishes rapid feedback on papers that have appeared in Heredity: technical comments, relevant work published elsewhere and so on. Here is one example, about inheritance of litter size in Arctic foxes. It also plans to publish comments provided for public consumption by the peer-reviewers, so readers can see why the paper is controversial or why publication was recommended.

Inherently Responsive also features discussion on the editorial direction of the journal. In large part the content of Heredity is determined by what is submitted, but some of it is are commissioned. The blog seeks to obtain journal readers’ views on whether important areas are being negelected.

NIH to examine peer-review process

NIH Establishes Working Groups to Examine Peer Review

The Director of the US National Institutes of Health (NIH), Dr Elias A. Zerhouni, annnounced on Friday last week (8 June) the formation of two working groups to examine the NIH peer review process, with the goal of maximizing its effectiveness. The two groups will seek input from the scientific community, including investigators, scientific societies, academic institutions and health organizations, as well as from within NIH. The groups will study the context, criteria and culture of peer review to make sure the most talented individuals and reviewers are engaged in the process. More details, and the composition of the external and internal working groups, are available at the link at the top of this post.

Reviewing appeals

Reviewing appeals : Article : Nature Immunology

This month’s Nature Immunology editorial (8, 541; 2007 — link above); which is freely available, describes the journal’s peer-review process and how it deals with appeals against decisions not to publish a submitted paper. This process is similar in all the Nature journals that publish original scientific research. From the editorial:

We believe that constructive critiques made during the review process improve manuscript quality, whether the manuscript is ultimately published in Nature Immunology or in another journal. Clarification of the review and appeal processes, as provided here, should assist authors in their preparation of manuscripts. We hope that by offering this advice to authors we can lessen frustration should a negative decision be rendered.

The full text of the editorial can be accessed via the link at the top of this post. Comments are welcome.

Rewards for peer reviewers

The Good, the Bad and the Ugly is the title of a post by Thomas Lemberger at the Seven Stones about how peer-reviewers might be rewarded. Nature is in the habit of thanking its thousands of peer-reviewers at the end of the year and providing a token of our appreciation, such as a special rate for subscription, but could we introduce other useful benefits? On occasion, for example, we have provided a letter of support for Green Card applications for regular peer-reviewers, and also have done the same for people’s CVs.

But should peer-reviewers be penalised for being slow, or for providing a useless report? This is a tricky question, for reasons explained by Thomas at the Seven Stones, as well as others.

A peer-reviewed blog journal?

In A Blog Around The Clock : Two Cultures, Coturnix writes about his surprise that the humanities seem more reluctant to experiment with peer-review systems than the scientific community. Coturnix describes his experiences of selecting posts for blog “carnivals” (themed collections of posts on one blog by various authors), and suggests that a peer-reviewed online blog-journal is the next logical step, or as he puts it: “I’d love to see publication of blogging anthologies collecting the best annual output by medical, environmental, education and humanities bloggers.”

Paolo Massa has collected some links to articles with a similar theme.

Peer review for traditional Chinese medicine?

Nature publishes a News story today (5 April) about China’s plans to modernize traditional medicine. (Nature 446, 590-591; 2007; subscription or site licence required). The article describes China’s plans to bring traditional medicine in line with modern standards, but reports scepticism among many about whether the research will reach “the scientific standards necessary for international recognition”.

Some critics also worry that the plan doesn’t set strict enough scientific standards. Although clinical research is listed as a priority, the plan doesn’t specify whether there should be randomized, controlled trials in which neither practitioners nor patients know who is receiving active remedy and who is getting a placebo. And there is no requirement for TCM researchers to publish in internationally recognized journals. “Most research on TCM in the past is of poor quality, and is published only in Chinese medical journals without proper peer-review processes,” remarks Wang [director of the National Centre for Drug Screening at the Shanghai Institute of Materia Medica]. “Without a clear position from the government, it is unlikely that the situation will change.”

Other similar concerns, and the question of whether traditional medicine is even susceptible to a mechanistic approach, are discussed in the News article.

Peer review for academic blogs

The Valve – A Literary Organ | Idea for Discussion: An Academic Blog Review

Amardeep Singh, of The Valve literary review, proposes a system of academic blog reviewing, whereby people self-select individual blog posts they’ve written for review by others, via a community system such as proposed in some of the contributions to Nature’s peer-review debate (see left-hand vertical column for a link). The proposal is intended to help those with academic blogs to be able to “publish”, or at least, to “credentialize”, selected shorter posts in addition to their more formal publications in the literature.

US Patent Office tries open peer review

Open Call From the Patent Office – washingtonpost.com

The Washingtonpost.com reports (link above) that the US Patent and Trademark Office is starting a pilot project that will not only post patent applications on the Web and invite comments, but also use a community rating system designed to push the most respected comments to the top of the file, for serious consideration by the agency’s examiners. The Washingtonpost.com article compares the the system to that used by Wikipedia, the popular user-created online encyclopedia.

The “peer to patent” project starts next week (week of 2 April) with a pilot programme, led by the Institute for Information Law and Policy at New York Law School and the US Patent and Trademark Office. The pilot will initially accept 250 patent applications from companies including IBM, Intel, Oracle, Hewlett-Packard and Microsoft.

Access to the literature and peer review

According to an article in Wired news on 14 March, the “$10 billion science publishing industry hasn’t heard the last of a bill that would make publicly funded studies available for free. Sen. John Cornyn (R-Texas) has pledged this year to resurrect the Federal Research Public Access Act (S.2695), which would require federally funded research to become publicly available online within six months of being published.”

The Wired article refers to a news story in Nature of 24 January, which describes how a group of journal pubishers have employed a public relations firm to “take on” the ‘open-access’ movement, to help communicate that the issue is not only about preserving profits, as some of the open-access proponents claim. From Wired :

“Our core message is that we believe in the integrity of the peer-review system and the investments in it,” said Brian Crawford, chairman of the executive council of the Professional and Scholarly Publishing Division of the Association of American Publishers. “It’s inappropriate for the government (to interfere).”

Later in the article: "A few traditional subscription publishers are also experimenting with open access, making more research freely available after a certain amount of time or if authors pay extra fees. Nature, for example, is experimenting with a free journal and allowing some authors to pay to make their findings publicly available. And earlier this month, the Howard Hughes Medical Institute announced it would pay the large Elsevier publishing house to make institute-funded research available to the public for free after six months. The change will take effect on Sept. 1, affecting research published after that date.

“But it is already clear that a journal like Nature would struggle under an open-access business model,” said David Hoole, head of brand marketing for the Nature Publishing Group. “We reject 90 percent of the articles we receive, and spreading the cost of peer review over the few authors who do get published would be very unfair (and would probably deter submissions). We [Nature] have approximately 1,000 authors, and 60,000 subscribers [a year]. It seems fairer to spread the costs over the subscribers.” "