An Efficient Dual-Line Decoder Network with Multi-Scale Convolutional Attention for Multi-organ Segmentation

Riad Hassan, M. Rubaiyat Hossain Mondal, Sheikh Iqbal Ahamed, Fahad Mostafa, Md Mostafijur Rahman · 2025

Read An Efficient Dual-Line Decoder Network with Multi-Scale Convolutional Attention for Multi-organ Segmentation by Riad Hassan, M. Rubaiyat Hossain Mondal, Sheikh Iqbal Ahamed, Fahad Mostafa, Md Mostafijur Rahman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17007.txt.

Introduction

Riad Hassan and co-authors design an efficient network for marking out several organs at once in medical scans, in a 2025 paper. Accurate organ segmentation guides radiation therapy, surgical planning, and diagnostic decisions in the clinic. Deep learning models lifted accuracy greatly, but many of them are too heavy for routine clinical use on site.

Most strong methods either chase accuracy at high computational cost or trade accuracy away for efficiency. The proposed dual-line decoder with multi-scale convolutional attention tries to hold both at once. A model that segments multiple organs quickly and well could run on ordinary hospital hardware, and that would spread access to automated planning far past large centers.

Catalog record

CREATORRiad Hassan, M. Rubaiyat Hossain Mondal, Sheikh Iqbal Ahamed, Fahad Mostafa, Md Mostafijur Rahman
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-17007

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An Efficient Dual-Line Decoder Network with Multi-Scale Convolutional Attention for Multi-organ Segmentation Riad Hassan, M. Rubaiyat Hossain Mondal, Sheikh Iqbal Ahamed, Fahad Mostafa, Md Mostafijur Rahman Abstract Proper segmentation of organs-at-risk is important for radiation therapy, surgical planning, and diagnostic decision-making in medical image analysis. While deep learning-based segmentation architectures have made significant progress, they often fail to balance segmentation accuracy with computational efficiency. Most of the current state-of-the-art (SOTA) methods either prioritize performance at the cost of high computational complexity or compromise accuracy for efficiency. This paper addresses this gap by introducing an efficient dual-line decoder segmentation network (EDLDNet). The proposed method features a noisy decoder, which learns to incorporate structured perturbation at training time for better model robustness, yet at inference time only the noise-free decoder is executed, leading to lower computational cost. Multi-Scale convolutional Attention Modules (MSCAMs), Attention Gates (AGs), and Up-Convolution Blocks (UCBs) are further utilized to optimize feature representation and boost segmentation performance. By leveraging multi-scale segmentation masks from both decoders, we also utilize a mutation-based loss function to enhance the model’s generalization. Our approach outperforms SOTA segmentation architectures on four publicly available medical imaging datasets (Synapse, ACDC, SegThor, and LCTSC). EDLDNet achieves SOTA performance with an 84.00% Dice score on the Synapse dataset, surpassing baseline model like UNet by 13.89% in Dice score while significantly reducing Multiply-Accumulate Operations (MACs) by 89.7%. Compared to recent approaches like EMCAD, our EDLDNet not only achieves higher Dice score but also maintains comparable computational efficiency. The outstanding performance across diverse datasets establishes EDLDNet’s strong generalization, computational efficiency and robustness. The source code, pre-processed data and pre-trained weights will be available at https://github.com/riadhassan/EDLDNet . \myfooter [C] © 2025. This manuscript version is made available under the CC-BY-NC-ND 4.0 license. 1 Introduction Figure 1: Dice score vs MACs count for different segmentation methods over synapse dataset. The figure presents our method offers the highest segmentation dice score with minimum MACs count. Accurate delineation of organs-at-risk (OAR) is critical in radiation therapy, computer-aided surgery, and treatment planning, where precision can significantly affect patient’s outcomes [ 1 , 2 ] . However, the identification and segmentation of OARs remain challenging and time-consuming, often involving manual processes that are prone to errors and potentially harmful consequences [ 3 ] . Recent advancements in deep learning (DL) have led to notable improvements in OAR segmentation. Different U-shaped networks, UNet [ 4 ] , UNet++ [ 5 ] , nnUNet [ 6 ] have become the standard for medical image segmentation. Attention mechanisms [ 7 , 8 ] have been incorporated into these models to enhance feature representation and improve pixel-level classification accuracy. Uncertainty aware segmentation networks extract uncertainty information to generate attention [ 9 ] and refine segmentation masks [ 10 ] . While those models have demonstrated better performance, they still encounter major challenges because of high computational demands. Recently, vision transformers [ 11 ] have shown significant potential in medical image segmentation tasks by utilizing self-attention mechanisms to capture long-range dependencies. To enhance segmentation performance further, hierarchical vision transformers such as SSFormer [ 12 ] , TransUNet [ 13 ] , DS-TransUNet [ 14 ] , TransFuse [ 15 ] , SwinUNet [ 16 ] , PolypPVT [ 17 ] , MT-UNet [ 18 ] , MISSFormer [ 19 ] , TransCASCADE [ 20 ] , PVT-GCASCADE [ 20 ] , and EMCAD [ 21 ] have been developed. These methods are high computation and resource intensive. This restricts their practical application, particularly where computational resources are often limited and real-time precise performance is essential. To overcome these limitations, we propose a segmentation network featuring a dual-line decoder with an efficient multi-scale convolutional attention architecture. Our method introduces a unique training strategy: one decoder operates with imposed noise termed as noisy decoder while the other remains noise-free . During training, both decoders generate segmentation maps in multiple stages that are mutated to create a comprehensive set of combinatorial masks which are used for regularizing the network to increase robustness. In testing or deployment scenarios, only the noise-free decoder is utilized which provides accurate and reliable segmentation with reduced computational overhead. Our architecture achieves superior segmentation performance by demonstrating 13.89% improvement over baseline methods, while 89.7% more computationally efficient (see Figure 1 ). The main contributions of this paper are summarized as follows: 1. Introduce noisy and noise free dual-line decoders, both of which are used in model training to produce multi-scale robust segmentation masks for improved regularization of the model, while only the noise free decoder is utilized during inference which preserves the computationally efficiency. 2. Implement a mutative implicit logit ensemble technique utilizing multi-level logits derived from both noisy and noise free decoders during training. The regularization using mutative logits which enhance the robustness and noise adaptability in segmentation tasks. 3. Conduct extensive experiments on four publicly available multi-organ segmentation datasets which show our proposed method outperform state-of-the-art (SOTA) methods. It improves 13.89% in terms of segmentation accuracy (Dice) and 89.7% computation reduction with compared to the baseline. Compared to recent methods, proposed method delivers a higher Dice score while maintaining comparable computational efficiency. The remainder of the paper is structured as follows: Section 2 highlights on CNN-based and Transformer-based related work; Then, Section 3 presents our Methodology; Experimental details, results of experiments on four publicly available datasets, and ablation studies are discussed in Section 4 . Finally, the overall conclusion is drawn in Section 5 . 2 Related Work Recent advancements in deep learning have led to the development of diverse models leveraging convolutional neural networks (CNNs) and transformers architecture where each addressing specific challenges of segmentation accuracy and computational efficiency. 2.1 CNN Based Approaches CNNs have historically been the backbone of medical image segmentation due to their ability to learn spatial features hierarchically. U-Net [ 4 ] revolutionized the field with its encoder-decoder structure and skip connections. Building on U-Net, several advancements introduced novel components to address specific challenges and enhance segmentation performance. Attention UNet [ 7 ] integrated attention gates to focus on relevant regions and suppress irrelevant background information which improved segmentation accuracy. R2UNet [ 22 ] incorporated recurrent residual connections to capture temporal dependencies and refine feature representation iteratively. UNet++ [ 5 ] utilized nested dense skip pathways to reduce semantic gaps between encoder and decoder feature maps which enhanced feature integration across scales. nnUNet [ 6 ] introduced automatic configuration of hyper-parameters to adapt the model to dataset-specific characteristics that eliminated manual tuning and improving generalization. MultiResUNet [ 23 ] improved feature representation by incorporating residual connections, enabling more efficient gradient flow and better convergence during training. Uncertainty-aware segmentation networks, such as UDBANet [ 9 ] , extract uncertainty information to generate attention maps that guide the model to focus on areas of high confidence, while UDBRNet [ 10 ] refines segmentation masks by leveraging uncertainty to reduce errors in boundary predictions. Though these CNN based network have achieved remarkable success, transformer based methods outperform due to its capacity to capture global relationships. 2.2 Transformer Based Models Transformer-based models have revolutionized the field of image segmentation by leveraging their ability to capture global relationships between image pixels. Originally intended for natural language processing (NLP) tasks

Read the complete text