Risk of Guideline Overselling and Certainty Inflation in GPT-5 Responses: A Statement-Based Analysis of Four ESGE Colorectal Guidelines

Marcello Maida, Antonio Facciorusso, Lorenzo Fuccio, Tony Tham, Alessandro Vitello, Giulio Calabrese · 2026

Read Risk of Guideline Overselling and Certainty Inflation in GPT-5 Responses: A Statement-Based Analysis of Four ESGE Colorectal Guidelines by Marcello Maida, Antonio Facciorusso, Lorenzo Fuccio, Tony Tham, Alessandro Vitello, Giulio Calabrese (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/PMC13289777.txt.

Description

Marcello Maida and coauthors test a 2026 concern that GPT-5 overstates colorectal guideline advice. Language models follow guidelines closely, yet they may turn cautious recommendations into firm orders without showing evidence strength. Four European colorectal guidelines supplied the test material, with every statement, its strength, and its evidence grade extracted for fair judging.

For each statement, a case vignette and question went to the model under plain and guideline-focused prompts. Three experts rated fit to guideline content and fit to strength wording separately. Content fit was high, but strength fit lagged, worst for weak advice and low-grade evidence in the results. A tuned prompt lifted both scores sharply in a follow-up test.

Catalog record

CREATORMarcello Maida, Antonio Facciorusso, Lorenzo Fuccio, Tony Tham, Alessandro Vitello, Giulio Calabrese
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22355
LICENSEhttps://creativecommons.org/licenses/by/4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/article/MED/PMC13289777

Browse the full library · About the Tower of Babel