The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases.

Schäfer T, Schwarz MA. · 2019

Read The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases. by Schäfer T, Schwarz MA. (2019) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc6470248.txt.

Description

Schäfer and Schwarz test whether psychology's published effect sizes can still anchor interpretation, comparing 900 effects drawn from ordinary publications against 93 from pre-registered ones. Cohen's benchmarks, or comparison with past literature, remain the standard ways to call an effect small or large. Both yardsticks wobble badly in the data.

Median effects in the ordinary literature reached r = 0.36, while pre-registered work, shielded from publication bias and questionable practices, sat at r = 0.16. Inflation has therefore corrupted the comparison pool. Effects also varied enormously between sub-disciplines and study designs, defeating any single benchmark. Many more pre-registered studies are needed before honest reference values exist.

Catalog record

CREATORSchäfer T, Schwarz MA.
YEAR2019
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC6470248

Browse the full library · About the Tower of Babel