MSA 2 -Net: Utilizing Self-Adaptive Convolution Module to Extract Multi-Scale Information in Medical Image Segmentation

CHAO DENG 1, XIAOSEN LI 2 , AND XIAO QIN,. 1 · 2025

Read MSA 2 -Net: Utilizing Self-Adaptive Convolution Module to Extract Multi-Scale Information in Medical Image Segmentation by CHAO DENG 1, XIAOSEN LI 2 , AND XIAO QIN,. 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01498.txt.

Introduction

Medical image segmentation networks often need hand tuning for each new data set, and the popular nnU-Net framework automates most settings but not those inside the network itself. Chao Deng, Xiaosen Li, and Xiao Qin present MSA2-Net, a network whose convolution kernels resize themselves to suit each data set's fingerprint. That self-adaptive module is the core of their design.

The module sits in two places: a multi-scale convolution bridge that refines features passed across the network, cleaning out redundant data, and a multi-scale amalgamation decoder that rebuilds the segmentation map. By capturing both global and local features in the feature maps, the network aims to generalize better across scans. Deng and the co-authors argue that internal self-tuning, not just outer settings, is the missing step for robust medical segmentation.

Catalog record

CREATORCHAO DENG 1, XIAOSEN LI 2 , AND XIAO QIN,. 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-01498

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MSA 2 -Net: Utilizing Self-Adaptive Convolution Module to Extract Multi-Scale Information in Medical Image Segmentation CHAO DENG 1, XIAOSEN LI 2 , AND XIAO QIN,. 1 Abstract The nnUNet segmentation framework adeptly adjusts most hyperparameters in training scripts automatically, but it overlooks the tuning of internal hyperparameters within the segmentation network itself, which constrains the model’s ability to generalize. Addressing this limitation, this study presents a novel Self-Adaptive Convolution Module that dynamically adjusts the size of the convolution kernels depending on the unique fingerprints of different datasets. This adjustment enables the MSA 2 -Net, when equipped with this module, to proficiently capture both global and local features within the feature maps. Self-Adaptive Convolution Module is strategically integrated into two key components of the MSA 2 -Net: the Multi-Scale Convolution Bridge and the Multi-Scale Amalgamation Decoder. In the MSConvBridge, the module enhances the ability to refine outputs from various stages of the CSWin Transformer during the skip connections, effectively eliminating redundant data that could potentially impair the decoder’s performance. Simultaneously, the MSADecoder, utilizing the module, excels in capturing detailed information of organs varying in size during the decoding phase. This capability ensures that the decoder’s output closely reproduces the intricate details within the feature maps, thus yielding highly accurate segmentation images. MSA 2 -Net, bolstered by this advanced architecture, has demonstrated exceptional performance, achieving Dice coefficient scores of 86.49%, 92.56%, 93.37%, and 92.98% on the Synapse, ACDC, Kvasir, and Skin Lesion Segmentation (ISIC2017) datasets, respectively. This underscores MSA 2 -Net’s robustness and precision in medical image segmentation tasks across various datasets. † † history: Date of publication xxxx 00, 0000, date of current version xxxx 00, 0000. † † doi: 10.1109/ACCESS.2017.DOI † † address: School of Artificial Intelligence, Nanning Normal University, Nanning, Guangxi, 530100, People’s Republic of China (e-mail: [email protected](Chao Deng); [email protected](Xiao Qin)) † † address: School of Artificial Intelligence, Guangxi Minzu University, Nanning, Guangxi, 530300, People’s Republic of China (e-mail: [email protected](Xiaosen Li)) † † titlenote: This study was financially supported by STI2030-Major Projects (2021ZD0201900),Guangxi Key R&D Project (Grant no.AA22068057). † † corresponding: Corresponding author: Xiao Qin (e-mail: [email protected]). I Introduction Medical image segmentation occupies a crucial role in medical diagnostics by enabling physicians to swiftly pinpoint pathogens [ 1 , 2 , 3 ] . This process involves extracting and delineating specific anatomical structures or pathological lesions from varied medical imaging modalities, including computed tomography (CT), magnetic resonance imaging (MRI), and X-rays. Essentially, the aim of medical image segmentation is to assign a specific classification to each pixel or voxel in the image, which could represent distinct organs, tissues, lesions, and other relevant anatomical features. Since the emergence of Convolutional Neural Networks (CNNs) [ 4 ] , they have been widely applied in various image analysis tasks and have gradually become the dominant technological framework in medical image semantic segmentation. They are capable of efficiently extracting edges, textures, and structural information of organs through the mechanisms of local receptive fields and parameter sharing, making them particularly suitable for medical image processing scenarios with strong spatial local features. U-Net, as a typical representative, is the most popular solution in medical segmentation tasks. The U-Net architecture consists of an encoder, skip connections, and a decoder. The encoder conducts feature extraction through convolution operations and downsamples the feature maps; the decoder is responsible for restoring the detail of the feature maps through upsampling operations; to complete the feature map details lost during the feature extraction by the encoder, U-Net introduces skip connections between the encoder and decoder. U-Net has demonstrated exceptional performance in semantic segmentation tasks, significantly advancing the precision and generalization capabilities of these applications. However, CNN is fundamentally a method focusing on local modeling [ 5 , 6 , 7 ] . It is limited by the size of the convolutional kernels, which makes it challenging to capture multi-scale information in medical images. This limitation is particularly evident when dealing with multi-organ semantic segmentation tasks. Such constraints weaken the model’s ability to integrate global contextual information, thereby affecting segmentation accuracy. To enhance the model’s capability to capture multi-scale information, researchers have proposed various improvement strategies. For instance, MISSFormer [ 8 ] introduces an Enhanced Transformer Context Bridge in different stages of the encoder outputs to capture multi-scale information; Dilated [ 9 ] Convolution enlarges the receptive field by increasing the dilation rate, effectively capturing large-scale context information without the need for significantly increasing the number of parameters or computational complexity; Spatial Transformer Networks (STN) [ 10 ] incorporate a learnable geometric transformation module, allowing the model to adaptively adjust spatial representations based on input features, thus enhancing its structural perception capabilities; Adaptive Spatial Feature Fusion (ASFF) [ 11 ] strategy proposes the use of a spatial filtering mechanism to integrate features of different scales, effectively mitigating information conflicts between different resolutions, and enhancing the consistency of semantic representations. Although these methods have improved CNN’s ability to process multi-scale information to some extent, the size of convolutional kernels—a hyperparameter determining the model’s receptive field—usually needs to be preset and cannot dynamically adjust according to the dataset trained on, which limits the model’s generalization capabilities. nnUNet [ 12 ] adopts a method based on data fingerprints and pipeline fingerprints to represent key attributes of datasets and networks, enabling it to automatically adjust hyperparameters without human intervention. However, the hyperparameters adjusted by nnUNet are mainly focused on dataset processing aspects (such as voxel size, spacing, and batch size), and do not fully consider the adjustments of hyperparameters within the network structure (such as convolutional kernel size and padding). To address this challenge, this study introduces a Multi-Scale Adaptive Attention Network (MSA 2 -Net), aimed at achieving precise segmentation of multi-organ medical images. MSA 2 -Net employs an encoder-decoder architecture, with the Cross-Shape Window Transformer (CSWin) [ 13 ] at the core of its encoder, utilizing a cross-window mechanism to effectively jointly simulate the local details and global semantics of the segmentation targets; in the skip connections, a Multi-Scale Convolution Bridge (MSConvBridge) is designed to alleviate the semantic gap between the encoder and decoder, enhancing the consistency and discriminability of the features; for the decoder part, a Multi-Scale Adaptive Decoder (MSADecoder) is adopted, which enhances the model’s capability to capture multi-scale information through recursively nested adaptive convolution groups. The main contributions of this study can be summarized as follows: 1. Proposed adaptive convolution module that generates corresponding data fingerprints for different segmentation datasets and automatically adjusts the receptive field of convolutions based on these fingerprints, enhancing the model’s generalizability. 2. An innovative Multi-Scale Convolution Bridge (MSConvBridge) is proposed based on adaptive convolution modules. This architecture utilizes a combination of multi-scale adaptive convolutions to delicately process the feature maps output by CSWin. Through this multi-layer approach, the MSConvBridge efficiently eliminates redundant striated textures between image features while maximally preserving the information within the feature maps, thereby significantly enhancing overall semantic consistency. This method not only optimizes feature representation but also strengthens the model’s capability to handle complex scenes. 3. Multi-Scale Amalgamation Decoder (MSADecoder) employs recursive nested adaptive convolution groups, enabling the decoder to replenish information about small organs in the image while upscaling, and simultaneously preserving information about large organs in the image. II RELATE WORK

Read the complete text