The journal Science is adding an extra round of statistical checks to its peer-review process, editor-in-chief Marcia McNutt announced today. The policy follows similar efforts from other journals, after widespread concern that basic mistakes in data analysis are contributing to the irreproducibility of many published research findings.
“Readers must have confidence in the conclusions published in our journal,” writes McNutt in an editorial. Working with the American Statistical Association, the journal has appointed seven experts to a statistics board of reviewing editors (SBoRE). Manuscript will be flagged up for additional scrutiny by the journal’s internal editors, or by its existing Board of Reviewing Editors or by outside peer reviewers. The SBoRE panel will then find external statisticians to review these manuscripts.
Asked whether any particular papers had impelled the change, McNutt said: “The creation of the ‘statistics board’ was motivated by concerns broadly with the application of statistics and data analysis in scientific research and is part of Science’s overall drive to increase reproducibility in the research we publish.”
Giovanni Parmigiani, a biostatistician at the Harvard School of Public Health, a member of the SBoRE group, says he expects the board to “play primarily an advisory role.” He agreed to join because he “found the foresight behind the establishment of the SBoRE to be novel, unique and likely to have a lasting impact. This impact will not only be through the publications in Science itself, but hopefully through a larger group of publishing places that may want to model their approach after Science.”
John Ioannidis, a physician who studies research methodology, says that the policy is “a most welcome step forward” and “long overdue.” “Most journals are weak in statistical review, and this damages the quality of what they publish. I think that, for the majority of scientific papers nowadays, statist review is more essential than expert review,” he says. But he noted that biomedical journals such as Annals of Internal Medicine, the Journal of the American Medical Association and The Lancet pay strong attention to statistical review.
Professional scientists are expected to know how to analyze data, but statistical errors are alarmingly common in published research, according to David Vaux, a cell biologist. Researchers should improve their standards, he wrote in 2012, but journals should also take a tougher line, “engaging reviewers who are statistically literature and editors who can verify the process”. Vaux says that Science’s idea to pass some papers to statisticians “has some merit, but a weaknes is that it relies on the board of reviewing editors to identify ‘the papers that need scrutiny’ in the first place”.
31. It can be learned from Paragraph I that
[A] Science intends to simplify its peer-review process.
[B]journals are strengthening their statistical checks.
[C]few journals are blamed for mistakes in data analysis.
[D]lack of data analysis is common in research projects.
32. The phrase “flagged up ”(Para.2)is the closest in meaning to
33、Giovanni Parmigiani believes that the establishment of the SBoRE may
[A]pose a threat to all its peers
[B]meet with strong opposition
[C]increase Science’s circulation.
[D]set an example for other journals
34. David Vaux holds that what Science is doing now
A. adds to researchers’ workload.
B. diminishes the role of reviewers.
C. has room for further improvement.
D. is to fail in the foreseeable future.
35. Which of the following is the best title of the text?
A. Science Joins Push to Screen Statistics in Papers
B. Professional Statisticians Deserve More Respect
C. Data Analysis Finds Its Way onto Editors’ Desks
D. Statisticians Are Coming Back with Science