« December 2007 | Main | February 2008 »

Archive by date: January 2008

Searching for duplicate publication


Bookmark in Connotea

Much attention is being given to a Commentary in the current issue of Nature (Nature 451, 379-399; 2008), A tale of two citations, some of which I have attempted to encapsulate in this Nautilus post, for those interested. Although the issues immediately concern a possible increase in duplicate publication and plagiarism, as detected by software systems and database searches, peer reviewers are an integral part of the check/balance procedures that journals use. For this reason, I thought it well worth highlighting here the comment by Brian Derby at the Nature Network forum currently discussing these questions. Part of Dr Derby's response:

"As a referee I have identified duplicate or severely overlapping content while reviewing papers in the past (for reasonably high profile/impact factor journals). I do not search for duplication routinely but, as someone who is used to referee papers in particular niche areas, I received both papers in one instance and in another I had read an on-line pre-pub before receiving the duplicate. The authors will not be named as that would break referee confidentiality but they were from well known institutions in the developed world.
What was the common factor (apart from the paper!) – the authors were relatively junior new appointments. Younger academics seem to feel themselves under a lot of pressure to publish. In my department I believe that my younger colleagues are much more sensitive to impact factor than is possibly healthy when they consider where to publish an article."

Researchers like the peer-review system


Bookmark in Connotea

The Publishing Research Consortium publishes a study this month (January 2008) in whch more than 3,000 senior authors, reviewers and editors were asked about the peer-review system. The conclusions are that researchers want to "improve, not change, the system of peer review for journal articles". According to the report, a summary of which is available (1.7 MB; PDF), more than 93 per cent of respondents believe that peer review is necessary, and more than 85 per cent say that it helps to improve scientific communications and increases the overall quality of published papers.
Although many respondents pointed out the operational difficulties in double-blind peer review, two-thirds of respondents felt that it is the most objectively fair system, compared with single-blind (the current prevalent system). Alternatives such as post-publication and open peer-review were not popular.
While of the majority of respondents saw peer review as an effective filter for research, some did not think it was effective at detecting plagiarism, fraud or misconduct. Interestingly, most reviewers among the respondents thought that paying peer-reviewers would be too expensive for publishers; most of them said that they perform reviewing as part of their support to their research community.
The full report is available here (1 GB; PDF). According to the Publishing Research Consortium, the main objective of the study was "to measure the attitudes and behaviour of the academic community with regard to peer review. This will inform debate concerning peer review, and underpin discussions, either in discussion lists or at future workshops/conferences."
This new report comes as the NIH (National Institutes of Health) finish analysing the thousands of responses to their assessment of grant peer review. Lawrence Tabak and colleagues are filtering the list into a set of key recommendations, which will be given to Elias Zerhouni, director of NIH, at the end of February.
Update, 29 Jan 2008. Nature Neuroscience discusses the NIH peer-review exercise in its February issue Editorial (Rethinking grant review Nature Neuroscience 11, 119; 2008).

Double-blind peer review reveals gender bias


Bookmark in Connotea

Double-blind peer review, in which neither author nor reviewer identity are revealed, was introduced by the journal Behavioral Ecology in 2001. Amber E. Budden et al., in an article published in Trends in Ecology and Evolution this month (Trends Ecol. Evol. 23, 4-6; 2008) report "a significant increase in female first-authored papers" compared with a similar journal, Behavioral Ecology and Sociobiology. From the authors' conclusions:
"A difference of 7.9% in the proportion of female first-authored papers following the implementation of double-blind review in BE is three times greater than the recorded increase in female ecology graduates in the USA across the same time period and represents a 33% increase in the representation of female authors. Furthermore, this increased representation of female authors more accurately reflects the (US) life sciences academic workforce composition, which is 37% female.
The consequences of this shift could extend beyond publications. If females are less successful in publishing research on account of their gender, then given the current practices associated with appointment and tenure, and the need for women dramatically to out-compete their male counterparts to be perceived as equal [C. Wenneras and A. Wold, Nepotism and sexism in peer-review, Nature 387 341–343; 1997] any such publication bias impedes the progress of women to more advanced professional stages."

Scientific American's open web experiment


Bookmark in Connotea

Scientific American is undertaking a social web experiment in its article Science 2.0: Great New Tool, or Great Risk?, by M. Mitchell Waldrop (article dated 9 January 2008). The article addresses whether wikis, blogs and other collaborative web technologies are the start of a "new era of science". The article itself, however, is a draft: not yet formally published in the magazine, the author encourages readers to comment on it before he revises it for final publication.
In the draft article, scientists and scientific publishers provide their views of collaborative science, in which researchers are posting drafts, preprints and other information online before formal publication of their work, and soliciting comments from fellow-scientists and other readers. But is "using blogs and social networks for your serious work..... an open invitation to have your online lab notebooks vandalized--or worse, have your best ideas stolen and published by a rival?" Or does competition turn into cooperation?
Issues of due credit and scooping are clearly uppermost in the minds of many who are nervous about such projects. This is countered by Jean-Claude Bradley's Open Notebook system, in which "everything goes online: experimental protocols, successful outcomes, failed attempts, even discussions of papers being prepared for publication....... The time-stamps on every entry not only establish priority, but allow anyone to track the contributions of every person, even in a large collaboration."
There are more than 70 comments from readers to the draft article at time of writing this post (17 January), many of them related to accreditation, priority, trustworthiness, and filtering, all central to the concept of peer review. One example, from a pseudonymous commenter: "there is a rather less savoury side to Web 2.0 as well. You just need to look at the scorn recently and unjustifiably heaped upon one surfing physicist for having the temerity to suggest that string theory might not be the only way of looking at the universe, and weblogs were the primary conduit for that scorn."
Thomas Lemberger adds his view: "Are we not going to be submerged by this avalanche of details, data, preliminary results? Who manages to keep up even with the classical "science 1.0" literature? Who manages to keep up with the hundreds of blog RSS feeds? How can the relevant information be retrieved, aggregated and evaluated in this ocean of data?" Here is Jim Morris's view: "It's already standard for many scientists to put their draft papers on their web sites. This is a more plausible if less amazing practice than putting lab notebooks online. Why not build on that to build online journals that start from those drafts to produce well-refereed papers?"
There are many more comments on the article, but perhaps the last word goes to another pseudonymous entry: "This whole argument reminds me of what you'd read in articles about Linux five to ten years ago. Open source was supposedly the future, and soon to replace Windows on the desktop. Well, the rest of the world outside of the enthusiasts couldn't be bothered. They had work to do, and didn't have the massive amounts of time required by such things (and the tools discussed here are huge time sinks)...... Often it can take months, if not years, to realize the true significance of your data. I worked with a mouse mutant where it took us over a year to figure out the cause of death. Putting your raw data out, before you have figured it out thoroughly, is just asking for someone else to make that leap instead of you."

Becoming a reviewing doormat


Bookmark in Connotea

FemaleScienceProfessor: Extreme Reviewing

In the post linked above, Female Science Professor writes about the affliction of peer-review addiction, also termed extreme reviewing, "not because my reviews are extremely negative/positive or extremely long/short, but because I am currently reviewing what I would typically consider (for me) to be an extreme number of manuscripts (8), in addition to a few dozen proposals. Another way to describe this syndrome is that I have become a reviewing doormat, unable to just say no to editor requests to review." Female Science Professor discusses several possible reasons for this behaviour in her post. There is also some discussion in the comments about reasonable reviewing loads: whether for manuscripts submitted to journals, or for grants.