Why do reviewers disagree? Evidence from four funders and 134,000 reviews

Jan-Ole Hesselberg, Pål Ulleberg, Øystein Sørensen, Knut Inge Fostervold, Sigrid Hegna Ingvaldsen, Ida Svege · 2026

Read Why do reviewers disagree? Evidence from four funders and 134,000 reviews by Jan-Ole Hesselberg, Pål Ulleberg, Øystein Sørensen, Knut Inge Fostervold, Sigrid Hegna Ingvaldsen, Ida Svege (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/plos-pone-0356108.txt.

Description

Jan-Ole Hesselberg leads a team of six dissecting why grant reviewers disagree, in PLOS ONE in 2026. The stakes are large: peer scores steer research money, yet two experts often rate the same proposal differently. The team analyzed nearly one hundred thirty-five thousand reviews from four Norwegian funders.

Most effects were real in tests but small in size. Reviewers of the same gender split slightly less. Reviewers given in depth charge of one bid also converged a little more. Reviews bought in for narrow know-how, and certain research areas, split a bit more. Only about three percent of the split came from stable personal tendencies of single reviewers. The bulk of the noise lives in the encounter between one proposal and its readers, which limits how far picking reviewers alone can fix things.

Catalog record

CREATORJan-Ole Hesselberg, Pål Ulleberg, Øystein Sørensen, Knut Inge Fostervold, Sigrid Hegna Ingvaldsen, Ida Svege
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64099
LICENSECC_BY
RIGHTSCC BY
SOURCEPLOS

Source: https://doi.org/10.1371/journal.pone.0356108

Browse the full library · About the Tower of Babel