Adapted large language models can outperform medical experts in clinical text summarization

Dave Van Veen, Cara Van Uden, Louis Blankemeier, Jean-Benoit Delbrouck, Asad Aali, Christian Blüthgen, Anuj Pareek, Malgorzata Polacin, Eduardo Pontes Reis, Anna Seehofnerová, Nidhi Rohatgi, Poonam Hosamani · 2024

Read Adapted large language models can outperform medical experts in clinical text summarization by Dave Van Veen, Cara Van Uden, Louis Blankemeier, Jean-Benoit Delbrouck, Asad Aali, Christian Blüthgen, Anuj Pareek, Malgorzata Polacin, Eduardo Pontes Reis, Anna Seehofnerová, Nidhi Rohatgi, Poonam Hosamani (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/openalex-w4392193048.txt.

Description

Dave Van Veen, Cara Van Uden, Louis Blankemeier, and colleagues test whether language models can summarise clinical text better than doctors. Their study appeared in Nature Medicine in 2024. Clinicians spend huge shares of their day writing summaries, reports, and notes. Documentation can take two hours for every hour spent with patients, feeding burnout. The team adapted several large language models, open and commercial, to summarisation tasks in medicine.

Adaptation means extra training on clinical material so the models learn the style and content. As the title states, the adapted models outperformed medical experts in the study's comparisons of clinical summaries. The reference summaries came from practising clinicians. If such tools prove safe at scale, they could return hours of the working day to patient care.

Catalog record

CREATORDave Van Veen, Cara Van Uden, Louis Blankemeier, Jean-Benoit Delbrouck, Asad Aali, Christian Blüthgen, Anuj Pareek, Malgorzata Polacin, Eduardo Pontes Reis, Anna Seehofnerová, Nidhi Rohatgi, Poonam Hosamani
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEOpenAlex / Nature Medicine

Source: https://doi.org/10.1038/s41591-024-02855-5

Browse the full library · About the Tower of Babel