Attention Xception UNet (AXUNet): A Novel Combination of CNN and Self-Attention for Brain Tumor Segmentation
Farzan Moodi, MD, Fereshteh Khodadadi Shoushtari, MS, Gelareh Valizadeh, PhD, Dornaz Mazinani, BSc, Hanieh Mobarak Salari, BSc, Hamidreza Saligheh Rad, PhD · 2025
Read Attention Xception UNet (AXUNet): A Novel Combination of CNN and Self-Attention for Brain Tumor Segmentation by Farzan Moodi, MD, Fereshteh Khodadadi Shoushtari, MS, Gelareh Valizadeh, PhD, Dornaz Mazinani, BSc, Hanieh Mobarak Salari, BSc, Hamidreza Saligheh Rad, PhD (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20446.txt.
Introduction
Outlining a brain tumor on MRI, its whole mass, its core, and its bright rim, decides surgery and radiation plans, so points of accuracy matter. Farzan Moodi and five co-authors fuse two design fashions in 2025, an Xception convolutional backbone with the self-attention of language models, inside a U-shaped segmentation network.
Trained on the BraTS 2021 collection using three scan types, their AXUNet reached a mean overlap score of 93.7, ahead of four rival designs including attention-gated and residual variants. It led on whole tumor and tumor core, and stayed near the top on the enhancing rim. The authors present the hybrid as evidence that attention earns its keep inside medical image segmentation, not only in text.
Catalog record
| CREATOR | Farzan Moodi, MD, Fereshteh Khodadadi Shoushtari, MS, Gelareh Valizadeh, PhD, Dornaz Mazinani, BSc, Hanieh Mobarak Salari, BSc, Hamidreza Saligheh Rad, PhD |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-20446
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Attention Xception UNet (AXUNet): A Novel Combination of CNN and Self-Attention for Brain Tumor Segmentation Farzan Moodi, MD, Fereshteh Khodadadi Shoushtari, MS, Gelareh Valizadeh, PhD, Dornaz Mazinani, BSc, Hanieh Mobarak Salari, BSc, Hamidreza Saligheh Rad, PhD Abstract Accurate segmentation of glioma brain tumors is crucial for diagnosis and treatment planning. Deep learning techniques offer promising solutions, but optimal model architectures remain under investigation. We used the BraTS 2021 dataset, selecting T1 with contrast enhancement (T1CE), T2, and Fluid-Attenuated Inversion Recovery (FLAIR) sequences for model development. The proposed Attention Xception UNet (AXUNet) architecture integrates an Xception backbone with dot-product self-attention modules, inspired by state-of-the-art (SOTA) large language models such as Google Bard and OpenAI ChatGPT, within a UNet-shaped model. We compared AXUNet with SOTA models. Comparative evaluation on the test set demonstrated improved results over baseline models. Inception-UNet and Xception-UNet achieved mean Dice scores of 90.88 and 93.24, respectively. Attention ResUNet (AResUNet) attained a mean Dice score of 92.80, with the highest score of 84.92 for enhancing tumor (ET) among all models. Attention Gate UNet (AGUNet) yielded a mean Dice score of 90.38. AXUNet outperformed all models with a mean Dice score of 93.73. It demonstrated superior Dice scores across whole tumor (WT) and tumor core (TC) regions, achieving 92.59 for WT, 86.81 for TC, and 84.89 for ET. The integration of the Xception backbone and dot-product self-attention mechanisms in AXUNet showcases enhanced performance in capturing spatial and contextual information. The findings underscore the potential utility of AXUNet in facilitating precise tumor delineation. 1 Quantitative MR Imaging and Spectroscopy Group (QMISG), Tehran University of Medical Sciences, Tehran, Iran. 2 School of Medicine, Iran University of Medical Sciences, Tehran, Iran. 3 Department of Medical Physics and Biomedical Engineering, Tehran University of Medical Sciences, Tehran, Iran. August 9, 2026 1 Introduction Gliomas, the most common primary brain tumors, are classified into low-grade (LGG; grades 1–2) and high-grade (HGG; grades 3–4) gliomas [ 1 ] . High-grade gliomas carry a poor prognosis, with median survival often under 18 months [ 2 ] . Various factors influence patient survival, one of which is tumor boundary, as it determines the area for radiation treatment and surgical resection. Therefore, accurate delineation of tumor boundaries is crucial, and this is achieved through a process called tumor segmentation. Traditionally, tumor segmentation has been performed manually by clinicians. However, the results can vary depending on the clinician’s expertise, leading to inconsistent outcomes. Moreover, this manual process can be time-consuming, especially for magnetic resonance imaging (MRI) scans with numerous image slices. Automatic tumor segmentation, on the other hand, can significantly reduce the time required for segmentation. Additionally, by leveraging the knowledge of experts who have delineated tumor regions, automatic segmentation models can transfer their expertise to clinical settings. Initially, machine learning algorithms comprising supervised or unsupervised algorithms were employed for tumor segmentation. However, these methods had their own challenges. Supervised methods required manual feature extraction, while unsupervised methods, such as clustering or seeding techniques, struggled with determining the initial centroid or seed location, presenting significant hurdles in the segmentation process [ 3 ] .The introduction of the UNet [ 4 ] model revolutionized the field of segmentation, and the Brain Tumor Segmentation Challenge (BraTS) [ 5 ] further drew attention to glioma segmentation. In this study, building upon previous research, we propose Attention Xception UNet (AXUNet) model that combines the power of UNet architecture with memory-efficient Xception blocks, and an attention module called self-attention that gave rise to the state-of-the-art (SOTA) natural language processing models such as OpenAI chat GPT and Google Bard. Taking inspiration from the multi-attention network (MANet) model [ 6 ] which has shown successful application in Remote Sensing Images, we endeavored to design, implement, and develop our proposed model. To the best of our knowledge, this is the first utilization of such an algorithm in brain tumor segmentation, which not only marks a novel approach in this field but also yields promising performance. 2 Related Work The UNet model was a pioneering high-performance deep learning-based segmentation model. It featured a distinctive architecture comprising a down sampling encoder and an up sampling decoder, earning its name from the unique U-shaped design [ 4 ] . However, this model lacked some salient characteristics. One key issue was the loss of information through successive layers. The original UNet model could partially solve this by concatenating encoder layers in each depth level with the corresponding decoder layer. However, the problem still continued inside the encoder layers. In other words, information could be lost between the first and last layers of each encoder block. Also, using a deep network with a multitude of layers could lead to extremely low or high gradients that prevent model learning. This downside of UNet led to the introduction of residual blocks in the Resnet model. These blocks are designed to transfer residual input data to the output. The backpropagation mechanism ensures that only necessary data are transformed into the output [ 7 ] . Another issue with the UNet model lay in the skip-connection layers. The data from the encoder layers was concatenated with the decoder layers without any filtering or refinement, meaning that both relevant and irrelevant information were transferred, potentially leading to model confusion. While this feature effectively mitigated data loss, it also led to model confusion due to excessive information overload. Eventually, the attention mechanism was introduced [ 8 ] . Attention modules were implemented to make the model concentrate on the most important part of the image which is glioma tumor in our case. Attention modules can be classified based on four features [ 9 ] : 1. The Softness of Attention which is defined as soft (deterministic)/hard (stochastic) or global/local attention. 2. Forms of Input Feature categorized as either item-wise or location-wise, where former comprise of single items like words and latter comprise of inputs that are not discrete like images. 3. Input Representations which can be categorized as distinctive, self (ours), co-attention, hierarchical based on the number of inputs. 4. Output Representations which can be categorized as single-output, multi-head, and multi-dimensional based on the output of one attention map, multiple attention map for multiple inputs or multiple attention maps for one input, respectively. In the task of segmentation, various attention modules were placed in different parts of UNet. Maji et al. [ 10 ] proposed an attention gate guided decoder that places an attention gate (AG) between the skip connections and downstream decoder blocks. Jia et al. [ 11 ] took advantage of coordinate attention mechanism where it averages info in three directions i.e. axial, sagittal and coronal using global average pooling in the decoder layer. Zhou et al. [ 12 ] utilized attention-aware multi-modal fusion module for tumor segmentation. This module consists of multi-sized kernels to capture spatial information and average and global pooling layers to capture channel information. Cao et al. [ 13 ] built multiscale contextual attention module combined with residual UNet. The implemented attention module was a Convolutional Block Attention Module (CBAM), designed to extract spatial and channel information through a series of smaller modules primarily utilizing max and average pooling layers. The choice of attention module, based on the specific characteristics provided earlier, can significantly