XAI-CLIP: ROI-Guided Perturbation Framework for Explainable Medical Image Segmentation in Multimodal Vision-Language Models

Thuraya Alzubaidi, Sana Ammar, Maryam Alsharqi, Islem Rekik, Muzammil Behzad · 2026

Read XAI-CLIP: ROI-Guided Perturbation Framework for Explainable Medical Image Segmentation in Multimodal Vision-Language Models by Thuraya Alzubaidi, Sana Ammar, Maryam Alsharqi, Islem Rekik, Muzammil Behzad (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07017.txt.

Description

Thuraya Alzubaidi and four co-authors make explanations for medical image segmentation clearer and cheaper to produce. Segmentation guides diagnosis, treatment plans, and disease tracking. Transformer models beat convolutional ones on score, yet their inner workings are hard to read, which hurts trust in clinics. Old explanation tools cost a lot, need many forward passes, and often yield noisy maps that miss anatomy.

Their system, XAI-CLIP, uses vision-language codes to find anatomical regions that matter for care, then steers targeted perturbations to those regions. The result is saliency maps that follow boundaries and carry fewer artifacts, at much lower cost. On the FLARE22 and CHAOS data sets, run time fell by up to 60 percent. Dice score rose by up to about 45 percent, and overlap for occlusion-based explanations nearly doubled, versus standard perturbation tools.

Catalog record

CREATORThuraya Alzubaidi, Sana Ammar, Maryam Alsharqi, Islem Rekik, Muzammil Behzad
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07017

Browse the full library · About the Tower of Babel