Representativeness and response validity across nine opt-in online samples
Michael N. Stagnaro, James N. Druckman, Adam J. Berinsky, Antonio A. Arechar, Robb Willer, David G. Rand · 2026
Read Representativeness and response validity across nine opt-in online samples by Michael N. Stagnaro, James N. Druckman, Adam J. Berinsky, Antonio A. Arechar, Robb Willer, David G. Rand (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/PMC13485695.txt.
Description
Michael N Stagnaro audits nine opt-in online survey panels that now supply much behavioral research data. Published in 2026, the study gathers 13,053 respondents across sources and grades each panel on answer quality, population matching, and respondent professionalism. Checks cover attentiveness, effort, honesty, speeding, dropout, demographics, attitudes, and experimental effects.
Panels differed substantially on every dimension graded. Quota-balanced panels matched the population better even beyond demographics, yet often showed weaker answer care. Placing two attention checks early in a survey lifted answer quality without hurting population matching. Heavy repeat survey-takers and device habits also varied by source. Practical guidance closes the report, matching panel choice to study purpose and budget instead of treating online samples as interchangeable.
Catalog record
| CREATOR | Michael N. Stagnaro, James N. Druckman, Adam J. Berinsky, Antonio A. Arechar, Robb Willer, David G. Rand |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82363 |
| LICENSE | https://creativecommons.org/licenses/by/4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |