Decision-Making in Research Tasks with Sequential Testing

Thomas Pfeiffer, David G. Rand, Anna Dreber · 2009

Read Decision-Making in Research Tasks with Sequential Testing by Thomas Pfeiffer, David G. Rand, Anna Dreber (2009) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/plos-pone-0004607.txt.

Description

Testing hypotheses one after another inflates false findings, a statistical problem examined by Thomas Pfeiffer, David Rand, and Anna Dreber in PLOS ONE in 2009. A controversial essay by John Ioannidis had argued that in some research fields, most published findings are false. Theoretical reasoning shows why: small effect sizes, error-prone tests, and low prior odds that a claim is true.

The authors study decision-making in research tasks with sequential testing, where results guide the next test. Each peek at the data changes the true error rate, often without the researcher noticing. The paper gives scientists and funders a clearer view of how study designs manufacture false positives, and how better decision rules could keep published science more honest.

Catalog record

CREATORThomas Pfeiffer, David G. Rand, Anna Dreber
YEAR2009
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
LICENSECreative Commons Attribution License
RIGHTSCC BY
SOURCEPLOS ONE

Source: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0004607

Browse the full library · About the Tower of Babel