Sunday, April 21, 2019

“Nearly 100 scientists spent 2 months on Google Docs to redefine the p-value. Here’s what they came up with”



the paper is unique for the way it came about: from 100 scientists around the world, from big names to Ph.D. students, and even a few nonacademics writing and editing in a Google document for 2 months...

The diversity among participants was striking, says Lakens, with less prestigious institutes well-represented, and many contributors sharing their personal experiences. Some argued that they could not afford to set up the large studies needed to meet the new standard or were unable to recruit enough study participants. Some said the lower α could force researchers to resort to so-called “convenience samples,” such as undergrad students, or move studies online. Critics also noted that larger studies are less likely to be replicated, and a more stringent α could make researchers more risk-averse and less likely to take on hard questions.

But perhaps the main argument, the participants agreed, was that 0.005 is just as arbitrary as 0.05, and that the threshold depends on what is already known about a topic and the risks associated with getting a wrong answer. One might accept a higher chance of a false positive result in a preliminary study, for instance, whereas a drug trial might require a lower p-value.


Lakens extracted the gist of the discussions in a new Google document that served as the basis for the paper”

https://www.sciencemag.org/news/2018/01/nearly-100-scientists-spent-2-months-google-docs-redefine-p-value-here-s-what-they-came

No comments:

Post a Comment