After nine years in print, Nature Methods today published its first retraction; one that could have been prevented by cell line authentication. What does this mean for journal-mandated cell line testing?
In a Nature Methods paper published in 2010, Ivan Radovanovic and colleagues described a method to isolate cancer-initiating cells in human glioma without the need for molecular markers. Based on morphology and on a green autofluorescence, the authors reported they could use FACS to sort cancer-initiating cells from gliomasphere cultures (which had been derived from primary tumors). They also detected autofluorescence in cells from fresh glioma specimens, but at a much lower level.Cells from the autofluorescent fraction could self renew clonogenically in vitro and were tumorigenic when transplanted into mouse brains, the authors reported, and in both cases performed better than non-autofluorescent cells from the rest of the culture or tissue. The origin of this autofluorescent signal was not understood at the time. The authors speculated it may have been related to the unique metabolism of the cancer-initiating cells.
It turns out that most of the primary gliomasphere lines (7 out of 10) were contaminated with HEK cells expressing GFP, leading to retraction of the paper. Using short-tandem-repeat (STR) profiling of two of the lines the authors determined that the contamination occurred over the course of culture in the lab: samples taken from early passages match the original tissue from which the lines were derived, but later passages no longer do so.
It is hardly surprising that the first retraction in Nature Methods is due to cell line contamination, a well acknowledged problem. A 2009 Editorial in Nature pointed to the disturbing results of cell testing by repositories which indicated that 18-36% of cultures were misidentified. It called on repositories to authenticate all of their lines, and for major funders to provide testing support to grantees. At that point funders could require cell line validation for investigators to retain funding, and Nature would require that all immortalized lines used in a paper were verified before publication. Unfortunately, it is now 2013 and we are still far from this goal.
But progress is being made. Community-based efforts are alerting researchers to this problem and providing resources to help them avoid being misled by erroneous results caused by cell line contamination. A 2012 Correspondence in Nature by John R. Masters on behalf of the International Cell Line Authentication Committee (ICLAC) pointed to the following resources available to researchers:
- An STR procedure available from the American National Standards Institute webstore.
- Two helpful PDF documents from the ICLAC with information and tips on authentication including ‘Advice to Scientists’ and an ‘Authentication SOP’.
- A continuously curated list of more than 400 misidentified cell lines (Database of Cross-Contaminated or Misidentified Cell Lines, Version 7.1)
Please go to the ICLAC website for the most recent version of each of these documents.
Meanwhile in early 2013, at the publication end of the process, the Nature journals published coordinated editorials announcing a reproducibility initiative and stating that “…authors will need to […] provide precise characterization of key reagents that may be subject to biological variability, such as cell lines and antibodies.” In practice, the Nature journals are currently requiring all authors to state whether or not testing was done but are only requiring testing in cases where it makes particular sense.
Advocates for mandatory testing have cogent arguments for a uniform mandatory testing policy. First, it would avoid sending a confusing message; second, researchers can’t be certain that cell identity or mycoplasma contamination aren’t affecting results; and finally, continued publication of inaccurate species and tissue designations of misidentified cell lines continues to propagate misinformation.
In the work described in the retracted 2010 manuscript from Radovanovic and colleagues mandatory testing would certainly have been beneficial. However, for probably the majority of work published by Nature Methods there is no question that testing would have no impact on the reported results. For example, in 2011 and 2012 we published at least 17 manuscripts reporting new fluorescence microscopy methods and using imaging data from cell lines to assess the performance of the techniques in measuring fundamental cell properties such as the appearance and width of actin or microtubule filaments, membrane vesicles or other universal cellular structures. Cell line identity and even mycoplasma contamination would not impact the efficacy or conclusions of these measurements. This same situation exists for the validation and testing of many methods in other research disciplines such as proteomics, genomics and biophysics.
Even if these labs should be doing cell validation and mycoplasma testing as a matter of course as part of proper cell culture procedure, mandating that all these studies include such testing as a requirement for publication is unjustified.
But clearly even our most recent efforts at improving compliance with good testing practice will not be sufficient to eliminate cell contamination as a problem in work published in Nature journals. A possible solution may be to require testing by default but authors would be permitted to argue why, in their case, testing is clearly unnecessary. Editors (possibly with reviewer input) would be the final arbiters and would need to ensure that although the lines must be named and sourced, no species or tissue identifiers should be included in the manuscript in the absence of proper validation.
Technology development labs or others that only use cell lines for purposes distinct from biological investigation could continue to avoid testing. But any lab that might potentially use their cell lines to obtain biological results would know that they should institute a proper testing regimen or risk their work not being publishable in a Nature journal.
At this point this is only an idea based on our experience at Nature Methods. We encourage the community to comment and let us know what they think.
Report this comment
Cell line contamination is a massive problem. Even in high quality institutions, this can be a pervasive issue. In my previous institute we ended up establishing a cell line testing service for this very issue. And, sure enough, in a minority of cases, cell lines were not what researchers thought they were.
Mandatory testing of cell lines can only improve the quality of data. Whenever lines are brought into a new lab, even from inside an institution, testing should be carried out. Regularly scheduled testing should take place thereafter to ensure no mix ups or contamination have occurred.
Report this comment
I support the opinions expressed by Liz, Achille and Amanda and agree that Ivan Radovanovic et al deserve credit for having the courage to retract their article. Thanks also to Methagora for signposting the resources that ICLAC has made available. What is of particular concern is the fact that Methagora states that for most articles published in Nature Methods cell line identity and Mycoplasma status would not impact on results or findings. Scientists do not work in isolation. This attitude not only propagates the continued use of suspect and potentially dangerous material but also fosters a culture where it is acceptable. This diminishes the efforts of scientists who believe that it does matter, confusing the Best Practice message. In the instance of Radovanovic’s paper; what would impact of developing fluorescent microscopy techniques using a cell line that exhibited autofluoresence? Surely, as scientists, we must adopt an overarching philosophy of scientific validity in our work. If a reagent, cell line or instrument is quoted or specified then that should be what was used. We should either test the identity of the materials or demonstrate provenance. Adopting an attitude of “it doesn’t really matter” does not do Scientists any favours and reinforces publicly held prejudice about our profession. Cell line misidentification not only undermines our credibility; perhaps more importantly, the issue poses a safety hazard. Through misidentification scientists could find themselves unwittingly working with a high containment category cell line whilst believing they were handling a low hazard counterpart. In the case of the Radovanovic retraction the scientists were unaware that they were growing Genetically Modified cultures. In the interests of scientific credibility and our own safety we should all pull together to adopt a zero tolerance policy to this fifty year old issue of misidentified cell lines once and for all.
Report this comment
There is little to no disagreement here. Nature Methods fully agrees that routine testing of cell lines is essential for proper scientific practice and laboratory safety.
But we are not convinced that it is the role of journals to mandate the laboratory practices of researchers who submitt work to us and use the refusal of consideration and publication to enforce this. In cases where such practices impact the stated findings and conclusions of the work, such as in the case of Radovanovic, yes we could institute a policy that induces us to reject a manuscript that has failed to conduct necessary cell line testing. But in cases where the results of such testing could not alter the stated findings and conclusions, such a policy would insert the journal into an oversight role that should instead be the job of the institution (laboratory safety) or funder.
Report this comment
Ivan Radovanovic and colleagues deserve recognition for their honesty and integrity in making this retraction. Many thanks also for linking to the International Cell Line Authentication Committee (ICLAC) resources. As a member of the committee it is great to see these being used!
Given that background, it’s no surprise that I am an advocate of mandatory testing and I think you set out the arguments for that approach very clearly.
Why mandatory testing? Because cell lines all need to be “named and sourced”.
ICLAC’s database of misidentified cell lines has 400+ examples where the name attached to a cell line is not correct. You can’t name a cell line with certainty unless you test it for cross-contamination.
Sure, you can make a case for methods papers not to know which tissue type or disease the cells represent. But at some level, you do need to know which cell line has been used for the work. Or why name it at all?
Report this comment
The ATCC Standards Development Organization (SDO) Workgroup authored a paper in Nature Reviews Cancer in 2010 that presents a history of cell line misidentification, methods and efforts to solve the problem.
https://www.nature.com/nrc/journal/v10/n6/full/nrc2852.html
In 2012 the ATCC SDO workgroup published an ANSI approved standard: “Authentication of Human Cell Lines: Standardization of STR Profiling”. The 104 page document delineates a standardized, universally applicable method for identifying human cell lines and primary tissue. Standardization fosters the reproducability and comparability of research employing human cell lines, leading to a marked decrease in the misidentification of human cells used by the scientific community.
Particularly frustrating is the fact that scientists have known about this problem for more than half a century. Surprisingly, there has been resistance to addressing or even acknowledging the problem. The consequences of using misidentified cell lines have included the retraction of published papers, as mentioned above and the inability to reproduce research results when incorrect cell lines are used, both of which leads to a waste of resources in support of research. Funding bodies and journals need to adopt a policy of zero tolerance and require proof that human cell lines have been correctly identified.