Bridging visual saliency and large language models for explainable deep learning in medical imaging

Paul Valery Nguezet, Elie Tagne Fute, Yusuf Brima, Benoit Martin Azanguezet, Marcellin Atemkeng · 2026

Read Bridging visual saliency and large language models for explainable deep learning in medical imaging by Paul Valery Nguezet, Elie Tagne Fute, Yusuf Brima, Benoit Martin Azanguezet, Marcellin Atemkeng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06197.txt.

Description

Paul Valery Nguezet and four co-authors make deep learning for brain tumor imaging explain itself in clinical language. Black box models block clinical adoption, since doctors need reasons they can act on, not just a label. Their framework links a convolutional network's prediction to visual evidence and then to a written diagnostic narrative from a language model.

Nine network designs gain a dual output that classifies and segments at once, feeding richer features into the explanation chain. Saliency heat maps are refined into tumor masks and mapped onto a named brain atlas, turning pixels into anatomical structures. Those findings, stored in structured form, prompt three language models to write radiology style reports. Tests on 4,834 MRI images across three tumor classes compare both vision and language stages.

Catalog record

CREATORPaul Valery Nguezet, Elie Tagne Fute, Yusuf Brima, Benoit Martin Azanguezet, Marcellin Atemkeng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.06197

Browse the full library · About the Tower of Babel