Can Reasoning LLMs Enhance Clinical Document Classification?

Akram Mustafa, Usman Naseem, Mostafa Rahimi Azghadi · 2025

Read Can Reasoning LLMs Enhance Clinical Document Classification? by Akram Mustafa, Usman Naseem, Mostafa Rahimi Azghadi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08040.txt.

Description

Akram Mustafa, Usman Naseem, and Mostafa Rahimi Azghadi ask whether language models that reason step by step code hospital documents better than those that answer directly, in this 2025 paper. Assigning standardized ICD-10 diagnosis codes to discharge summaries is essential and hard: the language is dense, data are private, and labeled examples are scarce.

Eight models, four reasoning and four not, classified summaries from the MIMIC-IV database after a clinical tool structured the text. Each case ran three times, with majority voting. Reasoning models won on accuracy, seventy-one versus sixty-eight percent, and more clearly on F1 score. The best single model, a reasoning Gemini variant, hit seventy-five percent accuracy. But non-reasoning models were steadier across runs, ninety-one versus eighty-four percent consistency. Reasoning shone on complex cases and stumbled on abstract categories. The authors suggest hybrid pipelines as the practical answer.

Catalog record

CREATORAkram Mustafa, Usman Naseem, Mostafa Rahimi Azghadi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-08040

Browse the full library · About the Tower of Babel