The Power of Data: Notes from the STEM Summit 4.0

By James Cola, Communications Manager, Springer Nature

The STEM Summit 4.0 – The Power of Data was held by Scientific American and Macmillan Learning at the New York Academy of Sciences on October 14, 2016. Hosted by Susan Winslow, Managing Director, Macmillan Learning, and Mariette DiChristina, Editor in Chief, Scientific American, the summit aimed to further collaboration between educators, entrepreneurs and public policy leaders, and to highlight how data can impact and transform the way that people teach and learn.

Across the United States, there are kindergartens, schools and colleges that are using data analytics, adaptive learning platforms, apps, video streaming, images, gaming, and more to help inspire student curiosity, tailor content, enable students to work in ways that suit them and change the way students approach STEM subjects.

At the STEM Summit 4.0, real-life stories reinforced the view that using data in teaching and learning is vital — and is already making a huge difference by helping educators to not only just name challenges and problems, but to go underneath to the root of the problems to solve them. Several presenters noted that data will continue to be key in encouraging greater participation in science, technology, engineering and mathematics (STEM).

The summit championed the increased use of data in education, as well as focusing on specific strengths and weaknesses of data.  Through discussions about different types of data — and interactive breakout sessions that included “How do we get educators past phobias (the fear of teaching STEM)?” and “How Do We Use Technology and STEM to Create Globally Competent Citizens?” — attendees developed strategies to help educators and further encourage students to study STEM topics.

STEM summit image

The day’s highlight, an address from Paul Krugman, the renowned Nobel Laureate and New York Times columnist, captivated the audience. His talk, “Technology, Globalization, and Skills”, discussed how STEM represents 6% of the workforce in the United States (excluding healthcare), and the role that STEM education plays in countries’ ability to compete and succeed globally.

However, speakers were clear that the United States faces challenges.

Dr. Rosemarie Truglio, Senior Vice President, Curriculum and Content, Sesame Workshop, said: “The data are in. We know we have a problem, and students are underperforming in science compared to children in other developed countries.”

Terri McCullough of the Clinton Foundation also noted the fact that there are fewer women studying STEM subjects now compared to 30 years ago.  While Krishanti Vignarajah, Director of Policy and International Affairs, The White House, Office of the First Lady, discussed how a girl’s earning potential increases by 15-20% for every year of secondary school education.

Dr. Adam Black, Chief Learning Officer, Macmillan Learning, gave a presentation on “The Promises and Pitfalls of Big Data”. He suggested that there is a digital renaissance in education and we can start to measure many things empirically due to the growing use of digital and more touchpoints with the learner. These touchpoints include apps, websites, games, and other interfaces where information is recorded about the learner.

Elsewhere during the summit, a particularly joyous and charming presenter talked about “Tactics to Build Engaged Learners”. Renton Prep School 10th grade student Jennifer Fernandez energized the crowd by showing how she and her classmates benefitted from cutting-edge ideas and innovative teachers who use technology in the classroom.

Ms. Fernandez said that for her and her classmates: “Today, we have faster ways to share with each other and there is a community of other people collaborating. For example, when a CEO of a company responds to your app, no matter how young you are, you are challenged and you have to step up your game.”

For more information, the full list of presenters and to continue the conversation about the STEM Summit, visit www.community.macmillan.com/community/stemsummit.

For STEM resources and to find out how Scientific American engages citizen scientists, children, and adults with STEM topics, visit https://www.scientificamerican.com/education/.

Journal metrics: handle with care

We have recently updated the journal metrics page for Nature Research to include an array of additional bibliometric data (www.nature.com/npg_/company_info/journal_metrics.html).  In addition to the traditional 2-year impact factor, we are now providing the 5-year impact factor, the immediacy index, the Eigenfactor score and the Article Influence Score. Whilst it is a measure that reflects a journal’s citations, the 2-year impact factor as an arithmetic mean of the citations per article can be disproportionately skewed by a minority of highly cited outliers.

For Nature, the Nature-branded research and reviews journals, and Scientific Reports, we have also provided the 2-year median, defined as the “the median number of citations received in 2015 for articles published in in 2013 and 2014.” Although the median citation is not subject to distortion by outliers like the 2-year impact factor, it should be noted that the median does not address another concern: that for multidisciplinary journals, such indicators measure across a broad swath of disciplines which have their own distinct citation rates. Nevertheless, we consider it to be a useful complement to the 2-year impact factor.

Given that this citation median is not a standard indicator, it is important to explain its derivation. To calculate the median, datasets for individual journals were downloaded from Web of Science in the third quarter of 2016.

  • For Nature and the Nature-branded research journals, articles published in 2013 and 2014 and categorized as “Article” or “Review” in Web of Science were selected.
  • For Nature Reviews journals, articles published in 2013 and 2014 and categorized as “Review” in Web of Science were selected. In addition, a small number of review articles that are categorized as “Article” in Web of Science were also included.
  • For Scientific Reports, articles published in 2013 and 2014 and categorized as “Article” in Web of Science were selected. In addition, a small number of research articles that are categorized as “Review” in Web of Science were also included.

For each dataset, (1) duplicated items were removed, (2) items that were not genuine Articles or Reviews were removed and  (3) items that were published outside the 2013-2014 timeframe as determined by issue date (for Nature and Nature-branded journals with issues) or date of online publication (for Nature Communications and Scientific Reports) were also removed. For each curated dataset (i.e. following steps 1-3 outlined above), the number of citations in 2015 to each item was taken from Web of Science and the median value calculated accordingly.

Thus, the median represents the midpoint number of citations that articles published in 2013 and 2014 received during 2015.

We believe that a broader array of citation-based metrics including the 2-year median citation will provide a more balanced perspective on journal performance and will be helpful to authors, readers and the community at large in assessing the quality of our journals.  At the article level, we have provided article-level metrics and Altmetric data since October 2012 for Nature journals. Our ambition for the future is to add alternative metrics at a journal level, to complement the citation-based metrics and the article level metrics.

We would emphasise that although this wider suite of metrics at the journal and article-level might provide interest and context, there can be no substitute for assessing each article on its own merits.

The Nature journals have a long record of publishing editorials on the limitations of the traditional journal impact factor.  The journal metrics page also provides links to a selection of these editorials from Nature journals and to the Nature special collection on Metrics (Nature 2010).

For better or worse, in survey upon survey, our authors cite impact factor as a primary consideration in driving decisions about where to publish their work, and whether to write for a journal.  This is despite  increasing calls for due caution in using the journal impact factor and a growing recognition that the over-reliance on the journal impact factor as an indicator for the quality of individual articles is damaging to the practice of science. There is no question that decreasing a reliance on the impact factor as an assessment metric is proving to be exceedingly challenging for journals, publishers, funders, research institutions and researchers.

Nevertheless, we hope to see increasing efforts from the community at large to develop mechanisms that  credit best practice in reproducible, robust research, putting the attention squarely where it belongs: on the researchers and their contributions to their fields.

Philip Campbell, Editor-in-Chief, Nature and Nature Research
Sowmya Swaminathan, Head of Editorial Policy, Nature Research