Why do reviewers disagree? Evidence from four funders and 134,000 reviews
Jan-Ole Hesselberg, Pål Ulleberg, Øystein Sørensen, Knut Inge Fostervold, Sigrid Hegna Ingvaldsen, Ida Svege · 2026
Read Why do reviewers disagree? Evidence from four funders and 134,000 reviews by Jan-Ole Hesselberg, Pål Ulleberg, Øystein Sørensen, Knut Inge Fostervold, Sigrid Hegna Ingvaldsen, Ida Svege (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/plos-pone-0356108.txt.
Description
Jan-Ole Hesselberg leads a team of six dissecting why grant reviewers disagree, in PLOS ONE in 2026. The stakes are large: peer scores steer research money, yet two experts often rate the same proposal differently. The team analyzed nearly one hundred thirty-five thousand reviews from four Norwegian funders.
Most effects were real in tests but small in size. Reviewers of the same gender split slightly less. Reviewers given in depth charge of one bid also converged a little more. Reviews bought in for narrow know-how, and certain research areas, split a bit more. Only about three percent of the split came from stable personal tendencies of single reviewers. The bulk of the noise lives in the encounter between one proposal and its readers, which limits how far picking reviewers alone can fix things.
Catalog record
| CREATOR | Jan-Ole Hesselberg, Pål Ulleberg, Øystein Sørensen, Knut Inge Fostervold, Sigrid Hegna Ingvaldsen, Ida Svege |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64099 |
| LICENSE | CC_BY |
| RIGHTS | CC BY |
| SOURCE | PLOS |