Inference on effect size after multiple hypothesis testing
Andreas Dzemski, Ryo Okui, and Wenjie Wang · 2025
Read Inference on effect size after multiple hypothesis testing by Andreas Dzemski, Ryo Okui, and Wenjie Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22369.txt.
Introduction
Andreas Dzemski, Ryo Okui, and Wenjie Wang tackle a bias that creeps in when studies report only strong effects. Their 2025 paper deals with multiple hypothesis testing. When many effects are estimated, the ones flagged as significant get the attention. Standard estimates of those effects tend to be too big, and standard intervals cover the truth too rarely. The authors build tools to fix that.
Their estimators and intervals give valid statements about the significant effects after testing. The method rests on conditioning on the selection that was made. It works alongside many common tests, including step up tests and bootstrap step down tests. The approach scales to hundreds of effects; one application covers over 370. Two worked examples show how bias correction changes the reported sizes. The direction of the fix depends on how the estimates correlate.
Catalog record
| CREATOR | Andreas Dzemski, Ryo Okui, and Wenjie Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 161 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-22369