Tag Archives: reporting

Journals test the Materials Design Analysis Reporting (MDAR) checklist

Posted on by

Reproduced from summary presentation, available at https://osf.io/znq64 

This guest blog comes from Sowmya Swaminathan, Head of Editorial Policy and Research Integrity at Nature Research.

We are pleased to share results from a pilot with 13 journals that tested the Materials Design Analysis Reporting (MDAR) checklist, a minimum standards reporting checklist for the life sciences.

The MDAR framework, a minimum standards reporting framework for life sciences, was designed to provide a harmonizing principle for reporting requirements currently in use at various journals. It is meant to be flexible to adapt to various journal policies, and provides two levels of reporting stringency, a minimum recommendation and a best practice recommendation. The checklist was designed as an optional instrument to help adoption of this reporting framework. A statement of task can be found here.

We are very grateful to the 13 participating journals and platforms – BMC Microbiology, Ecology & Evolution, eLife, EMBO journals, Epigenetics, F1000R, Molecular Cancer Therapeutics, Microbiology Open, PeerJ, PLOS Biology, PNAS, Science, Scientific Reports – for testing the MDAR checklist.

The pilot had two main goals: first, to understand whether the checklist was accessible and useful for authors and editors to help comply with journal policy and second, to understand whether the elements within the checklist are clearly conveyed so as to help fulfil policy expectations. In total, 211 authors across participating journals tested the checklist and provided their feedback. Participating journal teams screened 289 manuscripts using the checklist and 89 of these manuscripts were subject to a dual-assessment by independent reviewers, which allowed us to determine inter-assessor agreement, and thus clarity of specific items on the checklist.

We are encouraged to find that about 80% of authors and editors found the checklist useful to different degrees and that the majority of participating editors reported only a small increase in manuscript processing time as a result of using the checklist. While participating authors and editors did not identify major gaps in the requirements covered in the checklist, the feedback from authors and editors and the inter-assessor agreement results have given us a better understanding of areas in the checklist and elaboration document where the language is unclear and needs to be improved.

We are making the draft MDAR Framework, MDAR Checklist and MDAR Elaboration document and the pilot datasets available here. This work was also recently presented at the NASEM workshop on Enhancing Scientific Reproducibility through Transparent Reporting (slides available here).

We are currently gathering feedback on the MDAR framework, checklist and elaboration document from a broad group of about 40-50 experts on transparency and reproducibility. Based on the feedback from the pilot and the expert input, we anticipate revising all three MDAR outputs by the end of 2019.

We are sharing this update on the work of the Minimum Standards Working Group through coordinated posts on member platforms. If you would like more information about our work and progress, please contact Veronique Kiermer and Sowmya Swaminathan.

On behalf of the “minimal standards” working group:
Karen Chambers (Wiley)
Andy Collings (eLife)
Chris Graf (Wiley)
Veronique Kiermer (Public Library of Science; vkiermer@plos.org)
David Mellor (Center for Open Science)
Malcolm Macleod (University of Edinburgh)
Sowmya Swaminathan (Nature Research/Springer Nature; s.swaminathan@us.nature.com)
Deborah Sweet (Cell Press/Elsevier)
Valda Vinson (Science/AAAS)

New neuroscience tools for team science in ‘big data’ era

Posted on by

By Esther Landhuis

Wandering the convention center among 30,000-plus researchers, students and vendors at the Society for Neuroscience annual meeting in San Diego last November, I struggled to wrap my head around a feature I was writing for this week’s Nature, on managing big brain data. Mice, molecular biology and cell sorting reigned supreme in my former life as a bench scientist. Neurons, brain imaging, terabytes — not so much. So when it came time to find an entry into the vast universe of the brain, I latched onto something that seemed small and manageable: the fruit fly.

Ann-Shyn Chiang of National Tsing Hua University, Taiwan, told the SFN crowd his team has spent a decade imaging 60,000 neurons in the Drosophila brain. The pictures produced 3D maps detailed enough to show which neurons control precise behaviors, such as shaking the head side to side (see video). But here’s the part that blew my mind: They aren’t even halfway done (flies have 135,000 brain neurons), and mapping the human brain with similar methods would take 17 million years!

Head shake behavior elicited by a 593.5-nm laser. Credit Po-Yen Hsiao and Ann-Shyn Chiang.

Continue reading →