Project Sherlock

Psychology · Research Methods & the Replication Crisis

Questionable Research Practices

A topic within Research Methods & the Replication Crisis, itself one of 10 topics in that field and part of Psychology.

Reading on Questionable Research Practices

2

2 works

Paper2011

False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant

Joseph P. Simmons, Leif D. Nelson & Uri Simonsohn

Ordinary, undisclosed researcher choices - when to stop collecting data, which conditions to drop, which covariates to control for - let a false hypothesis reach statistical significance far more often than the nominal 5% rate, demonstrated by using them to 'prove' an impossible effect.

8 pageslink checked 17 Sept 2026Notes on this copy
Psychology · Research Methods & the Replication Crisis
FreeIntermediate
Paper2015

The Extent and Consequences of P-Hacking in Science

Megan L. Head, Luke Holman, Rob Lanfear, Andrew T. Kahn & Michael D. Jennions

Text-mines the p-values reported across the biomedical and life sciences literature and finds a pattern consistent with widespread p-hacking, but argues the resulting bias is small relative to the true effects being measured, so it inflates rather than manufactures most published findings.

Notes on this copy
Psychology · Research Methods & the Replication Crisis
FreeIntermediate

Other topics in Research Methods & the Replication Crisis