Further experiments in peer review

Guest post by Nandita Quaderi, PhD, Publishing Director, Nature Publishing Group/Palgrave Macmillan

There is a post on the Scholarly Kitchen blog this week that asks: “how can we improve the article review and submission process?”.  For all of us involved in scientific and scholarly publishing, it has long been accepted that peer review is necessary and beneficial in ensuring the quality of scientific communication. But it is also seen by many as an imperfect system: less efficient than it should be and sometimes frustratingly slow.

In a 2014 survey of over 30,000 NPG researchers, authors told us that they want us to innovate when it comes to peer review:

  • 70% authors are frustrated with the time peer-review takes
  • 77% think traditional peer review could be made more efficient
  • 67% think publishers should experiment with alternative peer-review methods

NPG is first and foremost here to serve scientists. As scientists our method is to run experiments, measure the results, learn and adapt. Testing and evolving the peer review process is something we’ve embraced over many years at NPG. Recently, our innovations have included offering double blind peer review (now available across Nature and the Nature sister journals following a successful trial), and an open peer review trial for monographs last year. We’re committed to exploring, learning, and better understanding the needs and choices of our authors.

In that spirit, this week we launched a small-scale opt-in trial of a faster peer review service for Scientific Reports. Authors submitting a manuscript to Scientific Reports can choose a fast-track peer-review service at an additional cost. Authors who opt-in to fast-track will receive an editorial decision (accept, reject or revise) with peer-review comments within three weeks of their manuscript being submitted and passing initial quality checks.

The fast-track service is being provided in partnership with a third party, Research Square, using their Rubriq peer-review system, which incentivises its reviewers with a fee per review. The trial is currently restricted to biology manuscripts, which is an area that Rubriq has a long-established reputation of supporting with its peer review service. Editorial decisions, based on these peer review reports, reside with Scientific Reports in-house editors. We’ve chosen Research Square as our partner on this trial because we have worked with them for a number of years in other parts of our business and because we recently conducted a successful private parallel run of peer-review outputs comparing Rubriq with Scientific Reports.  Importantly we share a common goal of putting researchers at the heart of what we do, and are both continually experimenting with different innovations in the publishing process.

Needless to say, an author choosing the fast-track option is only benefiting from a quicker decision. The introduction of this service has no bearing on our editorial decision process – whether we accept, reject or request revisions – and we have worked closely with Research Square to be confident that their reviewer reports are as rigorous as we would expect from our own Scientific Reports reviewers. This is an opt-in small scale pilot for a limited period of time, and will not affect the overall service we provide to authors who don’t choose the service. Our aim is to experiment with different options to deliver author choice.

We know with any innovation that there will be as many challenges as opportunities. Experimentation is key if we are to improve scholarly communications and support the researcher community, be they authors, reviewers, editorial board members or readers.  We hope this trial will provide useful feedback, in whatever form it takes, and will share what we’ve learnt in the coming weeks.

 

Leave a Reply

Your email address will not be published. Required fields are marked *