Performance and Hallucination Analysis of Large Language Models on European Anesthesiology Examinations: Cross-Sectional Comparative Study

Stefan Andrei, Thibault Giet, Alexis Belouard, Mihai Stefan, Mihai Popescu, Sébastien Tanaka, Philippe Montravers, Aurélie Gouel, Luke MacNeill · 2026

Read Performance and Hallucination Analysis of Large Language Models on European Anesthesiology Examinations: Cross-Sectional Comparative Study by Stefan Andrei, Thibault Giet, Alexis Belouard, Mihai Stefan, Mihai Popescu, Sébastien Tanaka, Philippe Montravers, Aurélie Gouel, Luke MacNeill (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13532392.txt.

Description

Andrei and co-authors test in 2026 how well four top language models answer European exam questions in anesthesiology, the field of putting patients to sleep for surgery. Models have done well on medical exams in other fields. No one had checked them across these exams while also scoring made up answers apart from plain confusion.

The team fed over four hundred exam questions from three sources to each model, using plain default settings. Two examiners scored each reply for right answers, invented facts, and mixed up reasoning. Nurse anesthetist school exams and diploma exams both fed the pool. The study weighs whether such tools can aid training safely.

Catalog record

CREATORStefan Andrei, Thibault Giet, Alexis Belouard, Mihai Stefan, Mihai Popescu, Sébastien Tanaka, Philippe Montravers, Aurélie Gouel, Luke MacNeill
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC13532392

Browse the full library · About the Tower of Babel