« Should authors' financial interests be known to reviewers? | Main | More on Nature Precedings and peer review »

Bookmark in Connotea

Reviewer performance statistics

The pseudonymous FemaleScienceProfessor is also an editor for a journal. She has reviewed its reviewers:

"I did a quick, statistically invalid analysis of the reviewer data for the past year to see whether the time it took a reviewer to complete the review was random or correlated with seniority. My working hypothesis was that younger scientists do quicker reviews. The dataset is sufficiently large to make an analysis like this reasonable, but I wasn't rigorous about tracking down reviewer time-from-Ph.D. data. I put reviewers in one of several bins: postdoc, assistant professor, mid-career, late-career, retired, and I put research scientists into these same bins based on where they would be in terms of time since Ph.D. if they were tenure-track. It's not a perfect system, but I just wanted to get a sense for any trends. The quickest reviewing groups are the early-career and retired scientists. "

More analysis is provided in FemaleScienceProfessor's post, and there are some reactions in the comments to this post. At the Nature journals we do not publish reviewer statistics of this type, nor do we capture information about the reviwers' gender, seniority level and so on. Is there interest from among our peer-reviewers to know these statistics, and to have published the type of information provided by the preliminary results of FSP?

Post a comment

Comments will be reviewed by the blog editors before being published, mainly to ensure that spam and irrelevant material (such as product advertisements) are not published . Please keep your comment brief. Excessively long or offensively phrased entries will be edited. Remember this blog is for feedback and discussion of matters concerning scientific authorship or peer-review - not for drawing attention to your research.

If you want to know if a NPG journal would be interested in your research, you will need to contact the journal's editorial office, which can be done via the authors & referees website.

We strongly encourage you to use your real, full name. E-mail addresses are required in case we need to discuss your comment with you directly. We won't publish your e-mail address unless you request it.

Please enter the numbers you see below - this helps us to avoid spam. If you are having trouble with this system, you can send your comment by e-mail to 'referees at nature.com'.

please enter code