<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0">
   <channel>
      <title>Peer-to-Peer</title>
      <link>http://blogs.nature.com/peer-to-peer/</link>
      <description>For peer reviewers and about the peer review process.</description>
      <language>en</language>
      <copyright>Copyright 2008</copyright>
      <lastBuildDate>Wed, 02 Jul 2008 09:45:25 +0000</lastBuildDate>
      <generator>http://www.sixapart.com/movabletype/?v=3.2</generator>
      <docs>http://blogs.law.harvard.edu/tech/rss</docs> 

            <item>
         <title>Trustworthiness of online encyclopaedias</title>
         <description><![CDATA[<p>In its July Editorial Wouldn't you like to know?, <em>Nature Physics</em> <a href="http://www.nature.com/nphys/journal/v4/n7/full/nphys1012.html">(<strong>4</strong>, 505; 2008)</a> asks how much of the mass of information available online in encyclopaedic form can be trusted. The Editorial discusses various sources: <a href="http://en.wikipedia.org/wiki/Main_Page">Wikipedia</a>, of course; <a href="http://en.citizendium.org/wiki/Main_Page">Citizendium</a> (with its associated <a href="http://en.citizendium.org/wiki/CZ:Eduzendium">Eduzendium</a>); <a href="http://www.scholarpedia.org/">Scholarpedia</a> ; and a brief mention of <a href="http://www.britannica.com/#tab=active~home%2Citems~home&title=Britannica%20Online%20Encyclopedia"><em>Encyclopaedia Britannica</em></a>, which has just begun experimenting with user-generated input (although not noted in the Editorial).<br />
<a href="http://www.scholarpedia.org/">Scholarpedia</a> is the most recent of these resources, and says of itself that it "feels and looks like Wikipedia - the free encyclopedia that anyone can edit. Indeed, both are powered by the same program - MediaWiki. Both allow visitors to review and modify articles simply by clicking on the edit this article link."  Scholarpedia is said to differ from Wikipedia in that each  article is written by an expert (invited or elected by the public); anonymously peer reviewed to ensure accurate and reliable information; and has a curator - typically its author -- who is responsible for its content and who has to approve any proposed modifications. The website claims that, by this method, "while the initial authorship and review processes are similar to a print journal so that Scholarpedia articles could be cited, they are not frozen and outdated, but dynamic, subject to an ongoing process of improvement moderated by their curators. This allows Scholarpedia to be up-to-date, yet maintain the highest quality of content." <br />
The <em><a href="http://www.nature.com/nphys/journal/v4/n7/full/nphys1012.html">Nature Physics</a></em> verdict? "Expert authorship and curatorship of free online information are indeed welcome. If scientists embrace Scholarpedia, then perhaps the opportunity to make sure that their own favourite area is well represented in its pages — as well as the possibility of citations — will prove sufficient incentive to the hard-pressed experts. The potential is huge, and so is the challenge."</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/07/trustworthiness_of_online_ency.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/07/trustworthiness_of_online_ency.html</guid>
         <category>Technical solutions</category>
         <pubDate>Wed, 02 Jul 2008 09:45:25 +0000</pubDate>
      </item>
            <item>
         <title>Stifling innnovation or filtering for excellence?</title>
         <description><![CDATA[<p>An article in the <em>Financial Times</em>, <a title="Science stifled? Why peer review is under pressure" href="http://www.ft.com/cms/s/0/4409911c-37df-11dd-aabb-0000779fd2ac.html?nclick_check=1">Science stifled? Why peer review is under pressure</a> (11 June 2008), reports various recent criticisms of the peer-review system, including a <a href="http://www.ft.com/cms/s/0/b1338bc6-303c-11dd-86cc-000077b07658.html">letter to the newspaper</a> by 25 distinguished scientists calling for a "global fund to support inspired scientists, free of peer review"; news of a <a href="http://www.ft.com/cms/s/0/6a1aecd2-338b-11dd-ba8a-0000779fd2ac.html">Royal Society pilot scheme </a>for a “blue skies” research fund, to avoid the "constraints of conventional peer review by using a generalist panel to consider proposals from any field, on the basis of their novelty and potential to open up new areas of science and technology"; and in the announcement of this year's <a href="http://www.gatesfoundation.org/GlobalHealth/Announcements/Announce-080331.htm">Grand Challenges programme</a> of the Bill and Melinda Gates Foundation, Tachi Yamada, the foundation's head of global health, is cited as saying "We've got to get around peer review – it’s anathema to innovation. Innovation has no peers, by definition.”<br />
The <a href="http://www.ft.com/cms/s/0/4409911c-37df-11dd-aabb-0000779fd2ac.html?nclick_check=1"><em>Financial Times</em> article</a> goes on to identify various innovations in the peer-review process itself, being tried or in normal use by various publications. Scientists themselves, however, choose to publish in the highest quality journals rather than on the basis of their peer-review systems. Linda Miller, US Executive Editor of <em>Nature</em>, is quoted in the article:<br />
<blockquote>Linda Miller, executive editor of <em>Nature</em>, agrees that scientists continue to seek publication in prestigious journals to enhance their own standing. They also concentrate on reading the best-regarded ones, precisely because their time is precious. “You want to be directed, to use the best journals as a filtering device,” she says. “I have been an editor for more than 20 years and I have handled a lot of papers. Every single one has been improved by peer review.”</blockquote><br />
The article concludes that "Peer review may not be immortal, and may be experimenting with different forms, but it looks set to guard the gates of research for some time to come." <br />
</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/06/stifling_innnovation_or_filter.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/06/stifling_innnovation_or_filter.html</guid>
         <category>Perspectives</category>
         <pubDate>Wed, 25 Jun 2008 11:38:52 +0000</pubDate>
      </item>
            <item>
         <title>Nature Precedings and open review, one year on</title>
         <description><![CDATA[<p>Today, 18 June, is the first anniversary of  <a href="http://precedings.nature.com/"><em>Nature Precedings</em></a>, where researchers can post their unpublished manuscripts, presentations, posters, white papers, technical papers, supplementary findings and other scientific documents, which can all be "peer-reviewed" online by anyone in the scientific community. (The website was available before June 2007 in 'beta' form.) Santosh Patnaik, a user who periodically tracks <em>Nature Precedings</em> at the <a href="http://network.nature.com/forums/precedings/1800?page=1">Nature Network Nature Precedings forum</a>, estimates that the 500th document will be uploaded some time in the next two weeks. <br />
Because the code for <em>Nature Precedings</em> is freely available, Dr Patnaik has mined some data to chart the growth of the website. His results are <a href="http://www.scribd.com/doc/3414477/Growth-of-the-yearold-Nature-Precedings">presented here,</a> in graphical form.  The number of posters and presentations, common when the site first launched, is now barely increasing, whereas the number of manuscript uploads has grown at a steady rate over the past year. The most popular discipline, perhaps unsurprisingly, is bioinformatics, although most other disciplines are also becoming more popular, particularly neurosience, 'evolution and ecology', and chemistry. (For those interested in statistics, Dr Patnaik has also <a href="http://network.nature.com/forums/precedings/1823">estimated the productivity of <em>Nature Precedings </em>authors</a>.)<br />
One aspect of this type of open peer-review is that <a href="http://precedings.nature.com/documents/1958/version/1#comments">discussion is not limited to the English language</a>, even though the language of uploaded documents is in English. The vast majority of comments are, however, in English: <a href="http://precedings.nature.com/documents/1766/version/1#comments">here is an example of constructive review in the neuroscience field</a>, <em>Nature Precedings</em> style. There are many other examples: the <a href="http://precedings.nature.com/#active-discussions">most active discussions are here</a>, but one can also filter by subject area.</p>

<p>Update: Hilary Spencer and the <em>Nature Precedings</em> team provide a one-year perspective at <a href="http://network.nature.com/forums/precedings/1841">Nature Network</a>.</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/06/nature_precedings_an_experimen.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/06/nature_precedings_an_experimen.html</guid>
         <category>Technical solutions</category>
         <pubDate>Wed, 18 Jun 2008 10:34:02 +0000</pubDate>
      </item>
            <item>
         <title>NIH responds to critics</title>
         <description><![CDATA[<p>A News story in the 12 June issue of <a href="http://www.nature.com/nature/journal/v453/n7197/full/453823a.html"><em>Nature</em> (<strong>453</strong>, 823; 2008</a>) by <strong>Meredith Wadman</strong>:<br />
Responding to hundreds of critical comments, the US National Institutes of Health (NIH) has reversed several controversial proposals made in February as part of a year-long effort to overhaul the agency's peer-review system (see <a href="http://www.nature.com/news/2008/080222/full/4511035a.html"><em>Nature</em> <strong>451</strong>, 1035; 2008</a>).<br />
As part of an initiative called <a href="http://enhancing-peer-review.nih.gov/">Enhancing Peer Review</a>, announced in a finalized form on 6 June, the agency will spend at least $200 million annually over the next five years to foster groundbreaking, investigator-initiated research. Of that, at least $250 million will go to a new beast: a Transformative R01 Award, a reach-for-the-skies version of the NIH's basic grant. The remaining $750 million will go to existing awards that reward risk and innovation: the Eureka, New Innovator and Pioneer awards.<br />
The changes “are concrete solutions that will maximize flexibility, remove any unnecessary burden, stimulate new innovation and promote transformative research”, says NIH director Elias Zerhouni.<br />
They include rewards for long-serving reviewers; a streamlined, 12-page R01 grant application, down from 25; and a seven-point, integer scoring scale for grant applications, which will be assessed across five criteria: impact, investigators, innovation, feasibility and environment. Current applications are graded on a 41 point scale, from 1.0 to 5.0, raising complaints that they claim a degree of accuracy that can't be scientifically defended.<br />
Among the controversial proposals shelved by the agency was a recommendation that all applications, even those on a second or third submission, would be treated as new, without reviewer access to prior reviews.<br />
Gone, too, is the category “not recommended for resubmission”, which had been suggested for dismal applications. Scientists felt that branding projects with “a clear, checkbox-driven stigma is bad, that it could have unintended consequences”, Jeremy Berg, director of the National Institute of General Medical Sciences, told the advisory committee.<br />
Berg and Lawrence Tabak, director of the NIH's dental institute, head the group that developed the recommendations and are charged with implementing them over the next 18 months.<br />
The agency also jettisoned a “minimum effort requirement” that would have required principal investigators to commit at least 20% of their time to any single NIH grant — an item of particular concern for 'grandee grantees' (see <a href="http://www.nature.com/news/2008/080319/full/452258a.html"><em>Nature</em> <strong>452</strong>, 258–259; 2008</a>). Instead, grantees will need to indicate if they will have more than $1 million in cumulative NIH funding.</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/06/nih_responds_to_critics.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/06/nih_responds_to_critics.html</guid>
         <category>Grants, tenure and positions</category>
         <pubDate>Thu, 12 Jun 2008 08:45:59 +0000</pubDate>
      </item>
            <item>
         <title>Scientific discourse 2.0: Second Life</title>
         <description><![CDATA[<p>Stephen T Huang, Maged N Kamel Boulos and Robert P Dellavalle write an article in the June issue of <em>EMBO Reports</em> <a href="http://www.nature.com/embor/journal/v9/n6/full/embor200886.html">(<strong>9</strong>, 496-499; 2008</a>) with the title: Scientific discourse 2.0. Will your next poster session be in Second Life? <br />
From the article:<br />
 <br />
<blockquote>Certainly, peer-reviewed literature and scientific meetings in the physical world will remain the main modes of distributing scientific information and informal communication. Yet, communication through virtual-world technology might become a useful supplement to the traditional discourse. The particular strengths of this technology include: its potential to share, review and comment on information, both with the public and one's peers; options that allow users to create and develop unique objects, and presentations to educate and inform others and to display data; and, last but not least, the time and cost of bringing people together within and across disciplines can be reduced.<br />
As with any new technology, there are issues that could have an impact on the usefulness of online communication and its acceptance within the scientific community. Scientists who rely on peer-reviewed data for their work might find Web 2.0's lack of proofreading unacceptable to document research findings. However, we should explore the existing and potential applications of virtual communication for unique ways to discuss ideas, answer questions, educate and debate. Our ability to understand what we can accomplish in online worlds depends on our collective experience with the technology. The more scientists and clinicians who work with and comprehend the applications of virtual worlds for their respective research fields, the sooner we will realize how this technology can be best applied. The next step is to invite ourselves into these online realms, experiment with what they have to offer, and see where our exploration and creativity takes us.</blockquote></p>

<p>(Stephen T. Huang is at Northwestern University's Feinberg School of Medicine in Chicago, Illinois, USA;  Maged N. Kamel Boulos is at the University of Plymouth, UK; <a href="mailto:robert.dellavalle@uchsc.edu">Robert P. Dellavalle </a> is at the Denver Veteran's Affairs Medical Center and the University of Colorado Denver, Denver, Colorado, USA.)<br />
</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/06/scientific_discourse_20_second.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/06/scientific_discourse_20_second.html</guid>
         <category>Technical solutions</category>
         <pubDate>Tue, 10 Jun 2008 07:39:10 +0000</pubDate>
      </item>
            <item>
         <title>No demonstrated gender bias in double-blind peer review</title>
         <description><![CDATA[<p>The Editorial 'Working double-blind' (<em>Nature</em> <strong>451</strong>, 605–606; 2008), also <a href="http://blogs.nature.com/peer-to-peer/2008/02/working_doubleblind.html">republished on this blog</a> and stimulating more than 70 comments,  referred to a study (1)  that found more female first-author papers were published using a double-blind, rather than a single-blind, peer-review system. The data reported in ref. 1 have now been re-examined (2). The conclusion of ref. 1, that <em>Behavioral Ecology</em> published more papers with female first authors after switching to a double-blind peer-review system, is not in dispute. However, ref. 2 reports that other similar ecology journals that have single-blind peer-review systems also increased in female first-author papers over the same time period. After re-examining the analyses, <em>Nature</em> has concluded that ref. 1 can no longer be said to offer compelling evidence of a role for gender bias in single-blind peer review. In addition, upon closer examination of the papers listed in PubMed on gender bias and peer review, we cannot find other strong studies that support this claim. Thus, we no longer stand by the statement in the fourth paragraph of the Editorial, that double-blind peer review reduces bias against authors with female first names.<br />
References<br />
1. Budden, A. E. <em>et al . <a href="http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6VJ1-4R05HXW-2&_user=906544&_coverDate=01%2F31%2F2008&_fmt=full&_orig=search&_cdi=6081&view=c&_acct=C000047747&_version=1&_urlVersion=0&_userid=906544&md5=01bf63978e83abce81c58861689ab555&ref=full">Trends Ecol. Evol.</em> <strong>23,</strong> 4–6 (2008). </a><br />
2. Webb, T. J. , O'Hara, B. & Freckleton, R. P. <a href="http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6VJ1-4SD36MP-2&_user=906544&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000047747&_version=1&_urlVersion=0&_userid=906544&md5=31dc7bfb68a334b58d845815a5468775"><em>Trends Ecol. Evol</em>. doi:10.1016/j.tree.2008.03.003 (2008). </a><br />
</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/06/no_demonstrated_gender_bias_in.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/06/no_demonstrated_gender_bias_in.html</guid>
         <category>Systems</category>
         <pubDate>Thu, 05 Jun 2008 09:08:15 +0000</pubDate>
      </item>
            <item>
         <title>Stem Cell paper and Insights are open for scrutiny</title>
         <description><![CDATA[<p>In the latest <em>Nature Reports Stem Cells</em> <a href="http://www.nature.com/stemcells/2008/0805/080522/full/stemcells.2008.84.html">Inside the Paper feature</a>, senior <em>Nature</em> editor Natalie DeWitt  discusses the paper by H. H. Chang <em>et al</em>.  'Transcriptome-wide noise controls lineage choice in mammalian progenitor cells', published in <a href="http://www.nature.com/nature/journal/v453/n7194/full/nature06965.html"><em>Nature</em> <strong>453</strong>, 544-547 (2008).</a></p>

<p>The <a href="http://www.nature.com/nature/journal/v453/n7194/edsumm/e080522-18.html">Editor's summary</a> of this paper: Even in clonal populations of cells, there is significant phenotypic variation from cell to cell. This could reflect the 'noise' inherent in gene expression: or the various cell states could represent stable phenotypic variants. Chang <em>et al.</em> analysed the behaviour of an 'outlier' in clonal populations of mouse haematoipoietic stem cells that had very high expressions of the stem cell marker Sca-1 and found that outliers possessed distinct transcriptomes. Though the transcriptomes eventually reverted back to that of the median cells, while they differed they could drive the cells to express characteristics of distinct cell fates. Thus clonal heterogeneity of gene expression may not be due to noise in the expression of individual genes, but rather is a manifestation of metastable states of a slowly fluctuating transcriptome. These fluctuations may govern the reversible, stochastic priming of multipotent progenitor cells in cell fate decision.</p>

<p>The <em>Nature Reports Stem Cells</em> article provides the details of what the peer-reviewers thought of this paper when it was submitted, and how the authors responded. The initial view of the three peer-reviewers can be summarized as follows:</p>

<p><strong>Reviewer 1</strong> In summary, we believe that this paper reports a novel and important biological mechanism for differentiation: it gives evidence that slow stochastic variations in stem cell state last for a long time and result in different fates. It relates the recent finding of slow fluctuations in human protein levels to the biological outcome of cell fate, and finds long lasting differences in transcriptomes in different subpopulations. It is an excellent choice for <em>Nature,</em> provided that the comments are addressed.</p>

<p><strong>Reviewer 2</strong> Although the phenomenon described is immensely interesting and the idea of heterogeneity being retained within even clonal populations of cells is plausible, the authors merely describe this phenomenon and in some instances, do not provide conclusive data to support their interpretation. If a mechanism was determined this would definitely aid in its novelty and interest. In its current form, I believe this manuscript should not be accepted at <em>Nature.</em></p>

<p><strong>Reviewer 3</strong> This is a very timely and interesting paper, that should be of interest to a broad range of researchers. However, I have some serious concerns over the modeling.</p>

<p>The details of the reviewers' concerns, and the authors' response, can be read at <a href="http://www.nature.com/stemcells/2008/0805/080522/full/stemcells.2008.84.html"><em>Nature Reports Stem Cells,</em> </a></p>

<p>You can also read a set of question-and-answer sessions between editor Monya Baker and several of the peer-reviewers of the recent <em>Nature</em> Insight on Regenerative Medicine, <a href="http://blogs.nature.com/reports/theniche/2008/05/regenerative_medicine_q_and_a_1.html">here on The Niche</a>, the blog of <em>Nature Reports Stem Cells</em>.<br />
</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/06/stem_cell_papers_and_insights.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/06/stem_cell_papers_and_insights.html</guid>
         <category>Systems</category>
         <pubDate>Mon, 02 Jun 2008 13:55:10 +0000</pubDate>
      </item>
            <item>
         <title>Peer-review is crucial for Italy&apos;s research programme</title>
         <description><![CDATA[<p><strong>Ignazio R. Marino*</strong> writes in Correspondence in the current issue of <em>Nature</em> <a href="http://www.nature.com/nature/journal/v453/n7194/full/453449a.html">(<strong>453</strong>, 449; 22 May 2008</a>):<br />
'Italy must invest more in science and technology' according to I. Bertini, S. Garattini and R. Rappuoli in Correspondence <a href="http://www.nature.com/nature/journal/v452/n7188/full/452685b.html">(<em>Nature</em> <strong>452</strong>, 685; 2008</a>). They lament the Italian lack of financial resources and political attention for research, technology and education. As a researcher, clinician and academician, I share their concerns. However, as former chair of the health committee of the Italian Senate, I take exception to their implication that none of the major political parties recognizes science, technology and education as crucial for the future of the country's economy.<br />
The 2007 and 2008 national budget laws, drawn up when the centre-left coalition was in power, allocated 96 million (US$149 million) to projects submitted by researchers under 40 years old. These are judged by an international committee comprising ten scientists under 40 — five from foreign institutions — selected according to impact factor and citation index scores. This alone is a revolutionary approach for the unregulated Italian system of research funding allocation.<br />
In spite of such advances, Italy is still far behind in research investment, and this needs to change. But the crucial switch is not simply to increase funding. The way the new government should proceed is to reform the allocation criteria for funding and to start applying across the board the selection and evaluation rules of peer review. Such a system would acknowledge meritocracy and free researchers from the virtual slavery under which they have been kept by old academicians.<br />
By applying international rules of peer review and evaluating grant applications only on the basis of merit, looking at curricula and objectives, comparing lists of publications and evaluating results, we will provide opportunities for Italy's scientists, thereby promoting the country's intellectual, cultural and economic growth.<br />
*Department of Surgery, Jefferson Medical College, 19107 Philadelphia, Pennsylvania, USA, and Senate of the Republic of Italy, Piazza Madama snc, 00186 Rome, Italy.</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/05/peerreview_is_crucial_for_ital.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/05/peerreview_is_crucial_for_ital.html</guid>
         <category>Quality and value</category>
         <pubDate>Tue, 27 May 2008 16:02:13 +0000</pubDate>
      </item>
            <item>
         <title>Hellinga story exemplifies weaknesses of the scientific process</title>
         <description><![CDATA[<p>From an Editorial (free to access online) in last week's <a href="http://www.nature.com/nature/journal/v453/n7193/full/453258b.html"><em>Nature</em> (<strong>453</strong>, 258; 15 May 2008</a>):</p>

<p>At first glance it seems to be a shining example of the scientific method in action. Two papers published by biochemist Homme Hellinga and his students at Duke University Medical Center in Durham, North Carolina, claimed a breakthrough in rational enzyme design. Last year, another chemist found that Hellinga's enzymes didn't actually work, which led to the retraction of the two papers this February (see<a href="http://www.nature.com/news/2008/080514/full/453275a.html"> page 275</a> of this issue and an <a href="http://www.nature.com/news/2008/080213/full/news.2008.569.html">earlier story</a> on 13 February). Then, this March, a third group published research showing that rational enzyme design really is possible. All has ended happily, it seems, with the field marching forward in triumph.<br />
But examined more closely, the episode reveals some less than happy aspects of science as it is actually practised. For example, the problems with Hellinga's enzymes were identified by John Richard at the State University of New York in Buffalo, who hoped to use the proteins in his own work. In effect, Richard and his two co-workers wasted seven months and tens of thousands of dollars failing to reproduce the results from Hellinga's lab. Richard's subsequent efforts to correct the scientific record thus came at considerable cost, with no discernable benefit to his own career.<br />
This is a perennial problem in science. Many researchers who come across non-reproducible work save themselves extra hassle and money by simply not pursuing it further. Meanwhile, those who refuse to let it go — like Richard — gain nothing.</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/05/hellinga_story_exemplifies_wea.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/05/hellinga_story_exemplifies_wea.html</guid>
         <category>Quality and value</category>
         <pubDate>Wed, 21 May 2008 08:55:54 +0000</pubDate>
      </item>
            <item>
         <title>Paying taxes is not a qualification for assessing research programmes</title>
         <description><![CDATA[<p><a href="http://network.nature.com/blogs/user/massimopinto/2008/05/03/0-5-of-your-taxes-to-whom-and-why">Massimo Pinto </a>has discovered an unusual qualification for being a peer-reviewer: paying your taxes. Since 2006, Italians have been allowed to donate 0.5 per cent of their taxes to charity in a highly specific way (previously, such donations had to be made to the church or the state). On his Nature Network blog <a href="http://network.nature.com/blogs/user/massimopinto/2008/05/03/0-5-of-your-taxes-to-whom-and-why">Science in the Bel Paese</a>, Dr Pinto points out that one can elect to donate one's contribution to specific research institutes. Leaving aside the fact that some of the intended recipients do not yet seem to have received their 2006 or 2007 contributions, specifying an individual project could have the effect of bypassing the peer-review system, particularly in Italy, where science funding levels are low. Dr Pinto writes that taxpayers have three choices:<br />
<blockquote>--donate to funding agencies. It happens in many countries of the world. As long as the agency is committed to assign that money in a transparent manner, including, possibly, peer review, that should be fine. <br />
--donate to individual institutes. In this way, taxpayers may be exercising a little peer-review power. Less troublesome, perhaps, if the institute acts, internally, as the agency above. Still, it is not obvious why institute A should be so much better than institute B. Maybe the cleverest scientist, with the best idea right now, is in institute B. <br />
--donate to a specific project. Here the taxpayers are exercising bolder peer-review powers, and that raises a red flag</blockquote><br />
As some institutes have taken to advertising the importance of their research and the difference one's money would make to humanity (no details provided in the advertisements), there is definitely scope for a loophole or two to be closed. As Dr Pinto puts it, "The particular advert that irritated me was a dialogue between two young citizens; one was asking whether the researcher in XYZ University were really going to deliver results, and the other one replied, reassuringly, that they were among the very best in Europe. Donating to them was a guarantee of success."</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/05/paying_taxes_is_not_a_qualific.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/05/paying_taxes_is_not_a_qualific.html</guid>
         <category>Policy and Public</category>
         <pubDate>Tue, 06 May 2008 15:22:10 +0000</pubDate>
      </item>
            <item>
         <title>Refining and communication of science via blogs</title>
         <description><![CDATA[<p><a href="http://blogs.nature.com/peer-to-peer/2008/04/to_many_blog_posts_are_the_fac.html">This post is a continuation of the discussion about blogging and peer-review</a> by selected reactions at <a href="http://www.realclimate.org/">RealClimate</a> (a climate scientists' community blog) to <a href="http://blogs.nature.com/peer-to-peer/2008/04/role_of_blogs_in_communicating.html"><em>Nature Geoscience</em>'s two commentaries on blogging.</a></p>

<p><a href="http://www.realclimate.org/index.php/archives/2008/04/blogs-and-peer-review/#comment-83827">Philip Machanick writes</a> that the "problem with blogs is that there is no way for an outsider to know which are reasonably careful creations of informed scientists, which are opinions of the scientifically illiterate, and which are astroturf creations designed to confuse critics of science that is in conflict with an industry. Given that terrain, I would rather have something like RealClimate than not: it helps to balance things out. Errors tend to be corrected quickly here as a consequence of a large informed readership (even if it is sometimes annoying that you get drive-by ignoramuses who don’t benefit from getting their misconceptions answered). He goes on to suggest that a site such as RealClimate is of value in providing a forum for rebuttals of peer-reviewed science in order to develop a consensus on whether a "formally published rebuttal is worth the effort". </p>

<p><a href="http://www.realclimate.org/index.php/archives/2008/04/blogs-and-peer-review/#comment-83846">Ray Ladbury's view</a>: "When it comes to peer reviewed papers, one has to presume the reader will have a minimum level of familiarity with the subject matter. One also presumes that the reader will have a day job, and so the question becomes whether the information in the paper is of sufficient interest to the average scientist in the community to say, “Hey, take a look at this. It looks mostly correct to me and has some interesting information/insights/methods…” This is not in any way the gold standard in the sciences. The gold standard comes when the community as a whole says, “Hey, cool, I can use this.” The paper is cited. The techniques are used. Science advances. Eventually, what was in the paper becomes part of the tacit knowledge assumed by reviewers.<br />
The tacit knowledge one can presume for a blog like Realclimate is much lower. One presumes there is an interest in the subject–why else would the reader be perusing the blog. One presumes at least a passing acquaintance with the scientific method and maybe some familiarity with basic results like conservation of energy, etc. One could perhaps assume that the average reader has taken the time to acquaint him- or herself with material to which one is vectored via the <a href="http://www.realclimate.org/index.php/archives/2007/05/start-here/">“Start Here” button</a>–although this is far from Universal.<br />
For the average newspaper reader of a science story, the tacit knowledge is nearly nonexistent–or worse, wrong. And then we have the blogosphere, where information density is at best, rarified and often toxic.......in an information economy, it seems that all too many readers and journalists are content to remain paupers."</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/04/refining_and_communication_of.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/04/refining_and_communication_of.html</guid>
         <category>Quality and value</category>
         <pubDate>Tue, 29 Apr 2008 10:26:39 +0000</pubDate>
      </item>
            <item>
         <title>What the job of an editor is all about</title>
         <description><![CDATA[<p>In a comment to <a href="http://blogs.nature.com/peer-to-peer/2008/04/what_constitues_a_good_report.html">an earlier Peer to Peer post</a>, 'Regular Scientist' takes issue with <em>Nature Cell Biology'</em>s definition of a good report, writing (slightly edited for length): <em>the journal sometimes asks the authors to undertake many experiments even before sending a paper to review. Not strangely, papers in <em>Nat Cell Biology</em>, even small reports, contain many Supplementary Figures (up to 20, I´ve seen). I miss the old days where publications were for sending a very interesting result so you could extend it and discuss its importance for your field. <em>Nat Cell Biology</em>'s system is undermining research efforts in the authors´ labs, which have to dedicate an enormous effort to provide many additional experiments that don´t even add much to the concept. This is not what science, and the peer-review process, should be about. I would recommend the editors of <em>Nat Cell Biol</em> a calm reading of the original paper on the structure of nucleic acids, and note the way it was written.</em></p>

<p><strong>Bernd Pulverer</strong>, Chief Editor of <em>Nature Cell Biology</em>, has kindly agreed to my request to write a guest post to respond, and to elaborate on the journal's practices and policies:</p>

<p>As ‘Regular scientist’ points out, we do strive to publish rather well-developed studies in <em>Nature Cell Biology</em>. It is interesting to read the concern about the supplementary information, since we usually hear the opposite complaint: namely that the tight format restrictions applied preclude presentation of complete datasets. In considering submissions, we expect fewer details of molecular mechanistic analysis if the paper reports a highly novel observation. And because the study of cell biology tends to throw up surprising new findings that deserve a wide audience but that cannot be developed in a reasonable timeframe, we decided some years ago to publish a short ‘Brief Communication’ format, which I hope is appreciated by Regular Scientist.<br />
In the <a href="http://www.nature.com/ncb/journal/v10/n4/full/ncb0408-371.html">Editorial under discussion</a>, we wrote: </p>

<blockquote>Nevertheless, the most important part of the report is assessment of the data: are key experiments or crucial controls missing? Are the data significant and definitive? Are all claims made supported by the data? A black and white model should not be a requirement — in fact it often underestimates biological complexity. Formulate a clear set of recommendations for additions or improvements. Experimental suggestions are important even if an outright rejection is recommended, as it makes for a transparent and constructive report that will allow the author to improve the dataset and select an appropriate target journal. If the overall assessment is positive, do not feel obliged to ask for non-essential experiments. New experiments should add key information, buttress claims or improve existing data, and they must be achievable. Indeed, the perception that referees invariably ask for more data encourages some authors to hold back data in the hope that these will be requested and can then be provided by return post; clearly, this is a futile exercise. Referees and editors alike should take great care that all key issues are raised in the first assessment — draw a line and adhere to it. Subsequent evaluations may raise issues on new data, but raising yet more ways to develop a study is not fair.</blockquote>

<p>We, the <em>Nature Cell Biology</em> editors, agree that one can always ask for more data, and that sometimes data require an unrealistic amount of effort for the information added. However, we entirely disagree that our editorial and review process does not result in the publication of much-improved datasets. The tendency of referees to feel an obligation to ask for some new data, and conversely for authors to hold back data to give referees something obvious to ask for, is an issue that we tried to address in the Editorial. <br />
We certainly do not ask for more data because we, the editors, feel under any compulsion to do so: the simple fact is that a good number of manuscripts submitted to the journal are rather premature, and we cannot justify wasting our referee’s time when we perceive obvious holes in a dataset that the referees would invevitably want to be addressed. We believe that this step is in an author’s interest, since we will not undertake multiple rounds of peer-review without good reason. If requested data are deemed to be unobtainable for technical reasons, or indeed unnecessary, we are always willing to hear an author’s arguments.<br />
Regarding <a href="http://www.nature.com/nature/dna50/archive.html">the 1953 <em>Nature</em> paper </a>that Regular Scientist recommends: indeed, the paper is a good read. However, science has become much more complex since then, and the discoveries often more detail-oriented, requiring a more in-depth analysis. At the same time, the tools available have developed tremendously in 55 years. Even in 1953, readers will note that Watson and Crick's conclusions <a href="http://www.nature.com/nature/dna50/archive.html">depended on the two following papers in the issue</a>, providing experimental details. The challenge is to set ‘the bar’ correctly to what is achievable and what should be achieved for publication in a top-flight journal. This is what the job of an editor is all about.</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/04/what_the_job_of_an_editor_is_a.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/04/what_the_job_of_an_editor_is_a.html</guid>
         <category>Quality and value</category>
         <pubDate>Wed, 23 Apr 2008 10:44:38 +0000</pubDate>
      </item>
            <item>
         <title>To many, blog posts are the face of science</title>
         <description><![CDATA[<p><a href="http://blogs.nature.com/peer-to-peer/2008/04/sharing_insights_with_research.html">Continuing the discussion</a> of the relative contributions of blogs and the peer-reviewed literature to scientific understanding, I'm highlighting another reaction to the <a href="http://blogs.nature.com/peer-to-peer/2008/04/role_of_blogs_in_communicating.html">two <em>Nature Geoscience</em> Commentaries</a> presenting different perspectives.<br />
<a href="http://www.realclimate.org/index.php/archives/2008/04/blogs-and-peer-review/#comment-83781">In the comment thread at Real Climate blog</a>, <a href="http://simondonner.blogspot.com/">Simon Donner </a>of the University of British Columbia writes:</p>

<p>"Blogs have created a forum for many people to informally discuss science. They are also a great forum for scientists to provide context to their own work and to the work of others in their field. <br />
And some of the time, that may take the form of criticism. That’s ok. But we do have to be careful in blurring the line too much between peer-reviewed publications and blogs. The first problem is the obvious one. Blog posts are unfiltered, un-reviewed, and often written off the cuff, while journal articles are screened, reviewed, and (should be) meticulously researched. It is far easier to write a criticism of a paper on one’s blog than to write a response and submit it to the journal. The issue isn’t just that no reviewers check the work… the blog author is unlikely to do even close to the amount of research and analysis nor give the wording nearly the same level of consideration as is expected in a paper submitted to a high-quality, peer-reviewed journal.<br />
The other problem is that blog posts are readily accessible to anyone at anytime, both in language, and in the unlicensed nature of the internet. To a huge swath of the public, blog posts are the face of science. Like it or not, bloggers with scientific credentials are like self-appointed ambassadors for science. If we are going to write about our science, we should do it with thought, and we should do it well. That is a standard that myself and many other science bloggers often struggle to meet."</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/04/to_many_blog_posts_are_the_fac.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/04/to_many_blog_posts_are_the_fac.html</guid>
         <category>Quality and value</category>
         <pubDate>Wed, 16 Apr 2008 08:21:02 +0000</pubDate>
      </item>
            <item>
         <title>Judge&apos;s ruling protects confidentiality</title>
         <description><![CDATA[<p>From <a href="http://www.nature.com/news/2008/080409/full/452677d.html"><em>Nature </em> <strong>452</strong>; 677; 2008:</a><br />
A federal magistrate in Massachusetts last week ruled that The <em>New England Journal of Medicine </em> (<em>NEJM</em>) does not have to comply with a subpoena issued by Pfizer forcing the journal to provide confidential peer-review documents related to the painkillers Celebrex (celecoxib) and Bextra (valdecoxib).<br />
The drug firm had tried to compel the journal to hand over peer reviews and internal editorial discussions for 11 papers on the painkillers. It argued that these would help it defend the arthritis drugs in lawsuits alleging that they caused heart attacks and strokes (<a href="http://www.nature.com/news/2008/080305/full/452006a.html">see <em>Nature</em> <strong>452</strong>, 6–7 ; 2008</a> and <a href="http://blogs.nature.com/nm/spoonful/2008/03/bullet_dodged_for_now.html">this post on Spoonful of Medicine blog</a>).<br />
In his 12-page opinion, Leo Sorokin wrote that the material Pfizer sought seemed relevant on first examination, but that “<em>NEJM</em>'s interest in maintaining the confidentiality of the peer-review process is a very significant one … and tip[s] the scales in favor of the <em>NEJM</em>" .<br />
The judgement comes three weeks after an Illinois judge ruled against Pfizer after it issued almost identical subpoenas to The <em>Journal of the American Medical Association</em> and <em>Archives of Internal Medicine</em>. <br />
The Nature journals' <a href="http://www.nature.com/authors/editorial_policies/peer_review.html">guidelines for reviewers</a> state: "Reviewers should be aware that it is our policy to keep their names confidential, and that we do our utmost to ensure this confidentiality. Under normal circumstances, blind peer-review is protected from legislation. We cannot, however, guarantee to maintain this confidentiality in the face of a successful legal action to disclose identity in the event of a reviewer having written personally derogatory comments about the authors in his or her reports. For this reason as well as for reasons of standard professional courtesy, we request reviewers to refrain from personally negative comments about the authors of submitted manuscripts. Frank comments about the scientific content of the manuscripts, however, are strongly encouraged by the editors." <br />
We are advised that if peer-reviewers follow this advice, it would be extremely unlikely that there could be legal grounds to force their identities to be revealed. </p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/04/judges_ruling_protects_confide.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/04/judges_ruling_protects_confide.html</guid>
         <category>Ethics</category>
         <pubDate>Fri, 11 Apr 2008 14:11:51 +0000</pubDate>
      </item>
            <item>
         <title>Sharing insights with researchers</title>
         <description><![CDATA[<p><a href="http://blogs.nature.com/peer-to-peer/2008/04/role_of_blogs_in_communicating.html">The two <em>Nature Geoscience</em> Commentaries </a>expressing opposing views on blogging's role in science research communication have been much discussed in the blogosphere (see <a href="http://blogs.nature.com/climatefeedback/2008/04/web_20_friend_or_foe.html">Climate Feedback blog,</a> for example.). <a href="http://www.realclimate.org/index.php/archives/2008/04/blogs-and-peer-review/ ">One discussion took place at RealClimate</a> blog, <a href="http://www.realclimate.org/index.php/archives/2008/04/blogs-and-peer-review/">where Gavin Schmidt's post about his <em>Nature Geoscience</em> view </a> on how science blogs and traditional peer-review intersect has attracted more than 100 online comments from climate scientists and others.<br />
<a href="http://www.realclimate.org/index.php/archives/2008/04/blogs-and-peer-review/#comment-83781">One commenter, "Tamino", writes</a>: "Blogs don’t serve very well for communication among scientists. Peer review does more than just protect us from being inundated with substandard work; it protects authors from their own mistakes and improves the quality of what we write. Peer review itself is an immensely valuable avenue of communication; who among us hasn’t at some time included a phrase like “We thank an anonymous referee for comments and suggestions which dramatically improved the final manuscript”?<br />
But as bad as blogs are for actual research, peer-reviewed journals are far worse for communicating with and educating the lay reader. Yet when it comes to climate science the lay public is hungry for knowledge, and many of them are eager, and well-prepared, for a level of sophistication and detail that can’t be found in lay journalism or even popular literature; <em>An Inconvenient Truth</em> isn’t enough. So blogs serve an incredibly useful purpose, enabling the interested and well-educated reader to share insights with researchers who are at the cutting edge of new knowledge.....................while blogs aren’t part of the machinery for legitimate scientific research, they’re an indispensible tool for communication and combating misinformation."</p>

<p>More to follow.</p>]]></description>
         <link>http://blogs.nature.com/peer-to-peer/2008/04/sharing_insights_with_research.html</link>
         <guid>http://blogs.nature.com/peer-to-peer/2008/04/sharing_insights_with_research.html</guid>
         <category>Quality and value</category>
         <pubDate>Thu, 10 Apr 2008 18:15:49 +0000</pubDate>
      </item>
      
   </channel>
</rss>
