Use of ChatGPT to Explore Gender and Geographic Disparities in Scientific Peer Review

Paul Sebo · 2024

Read Use of ChatGPT to Explore Gender and Geographic Disparities in Scientific Peer Review by Paul Sebo (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-11667125.txt.

Description

Sebo presents a 2024 study that used ChatGPT to probe fairness in scientific peer review. Some top medical journals now publish review reports next to papers. Tone in those reports may differ by author gender or country. The author asked ChatGPT-4 to score sentiment and politeness in reviews from nine general medical journals.

Twelve papers per journal, all from 2023, gave the review sample. Each review was scored five times on scales from harsh to warm, and the middle values were kept. Author names and countries were recorded for comparison. The study tests whether a chatbot can surface bias patterns in review tone at low cost.

Catalog record

CREATORPaul Sebo
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC11667125

Browse the full library · About the Tower of Babel