Cross-Stage Attention Multi-Expert Network for Radiologist-Inspired Breast Ultrasound Diagnosis

Xinyang Zhai, Chong Yang*, Ruizhi Zhang · 2026

Read Cross-Stage Attention Multi-Expert Network for Radiologist-Inspired Breast Ultrasound Diagnosis by Xinyang Zhai, Chong Yang*, Ruizhi Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25518.txt.

Introduction

Xinyang Zhai, Chong Yang, and Ruizhi Zhang build a radiologist-inspired network for benign versus malignant breast ultrasound classification. A cross-stage attention ResNet-18 backbone recalibrates multi-level features to highlight key tumor traits and suppress redundancy. A three-branch mixture-of-experts block learns complementary features from whole-tumor, core, and boundary views, fused by an adaptive gating network. On 2,129 images the model reaches accuracy of 96.33 percent and AUC of 99.50 percent on average, beating the ResNet-18 baseline by several points on every metric.

Catalog record

CREATORXinyang Zhai, Chong Yang*, Ruizhi Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51243
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25518

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Cross-Stage Attention Multi-Expert Network for Radiologist-Inspired Breast Ultrasound Diagnosis Thanks: Xinyang Zhai, Chong Yang*, Ruizhi Zhang Abstract Breast ultrasound imaging is an important noninvasive method for early breast cancer diagnosis, but automatic benign/malignant classification remains challenging due to tumor heterogeneity, blurred boundaries, and data imbalance. To improve feature representation and classification accuracy, this paper proposes the Cross-Stage Attention Mixture-of-Experts Network (CSA-MoE-Net). It adopts a Cross-Stage Attention-enhanced ResNet-18 as the backbone, in which the Cross-Stage Attention module adaptively recalibrates multi-level features, thereby enhancing key tumor features and suppressing redundancy. A three-branch Mixture of Experts (MoE) Block learns complementary features from the Whole Tumor Image, Tumor Core, and Boundary, and an Adaptive Gating Network fuses them to capture morphological, textural, and contextual information. The fused features are denoted as Fused Expert Feature (FEF) in the architecture. Experiments on a balanced dataset of 2,129 breast ultrasound images show that, averaged over 20 independent runs, the model achieves an accuracy of 96.33%, precision of 94.09%, recall of 98.53%, F1-score of 96.25%, and AUC of 99.50%. Compared to the baseline ResNet-18, these metrics improve by 3.01, 0.70, 5.37, 2.98, and 5.42 percentage points, respectively. The proposed mechanism requires no invasive modification and can be seamlessly embedded into VGG-16, DenseNet-121, etc., yielding stable performance gains, thus providing reliable support for computer-aided diagnosis. *Corresponding author I Introduction B reast Cancer has become the most common malignant tumor among women worldwide. According to the latest 2025 statistics from the International Agency for Research on Cancer (IARC) of the World Health Organization, new cases have surpassed lung cancer, making it the leading global malignant tumor. This poses a serious threat to human life and health and has become a major public health issue requiring urgent attention [1]. Due to the insidious onset and atypical clinical manifestations of early breast cancer, accurate benign-malignant differentiation of tiny lesions, blurred-boundary lesions, and highly heterogeneous tumors in ultrasound imaging remains a key challenge in clinical and medical imaging fields [2]. Deep learning-based intelligent diagnosis technology for breast ultrasound has evolved over more than twenty years, gradually moving from laboratory research to clinical application, with four distinct stages [2]. From 2000 to 2012, the traditional machine learning stage relied on manually designed feature extraction operators to capture texture, morphology, gray level, and boundary features of lesions. Combined with models like support vector machines, random forests, and logistic regression, these methods were highly dependent on radiologists’ expertise, had poor generalization, and struggled to capture complex nonlinear lesion features [3]. From 2012 to 2017, the deep learning initiation stage saw convolutional neural networks (AlexNet, VGG, ResNet) enable end-to-end automatic feature extraction [4]. Transfer learning migrated pre-trained weights from natural images to breast ultrasound datasets, alleviating sample scarcity and achieving classification accuracy significantly better than traditional methods [5]. From 2018 to 2020, the field entered rapid development: segmentation models (U-Net) and detection algorithms (Faster R-CNN, YOLO) were widely applied, enabling integrated modeling of lesion detection, segmentation, and classification [6]. Multi-scale feature fusion and attention mechanisms enhanced the focus on key areas, with some models achieving diagnostic performance comparable to that of experienced radiologists on single-center datasets [7]. Since 2021, focus has shifted to clinical implementation and refinement, expanding beyond classification accuracy to clinical utility (BI-RADS grading, axillary lymph node metastasis assessment, neoadjuvant chemotherapy efficacy prediction, molecular subtyping) [8]. Explainable AI, few-shot learning, weakly supervised learning, and federated learning have addressed medical data privacy, scarcity, and model “black-box” issues [9], with multiple AI-assisted diagnostic products approved by China’s NMPA [10]. Despite significant progress, three core clinical bottlenecks remain. First, architectural design is disconnected from clinical logic: early single-branch, whole-image input networks achieved end-to-end classification but failed to fully mine discriminative lesion information [11]. Later studies improved local features by manually cropping lesions and combining with global images, but manual intervention caused cumbersome processes and inconsistent results [12]. Second, complex lesion recognition is inadequate: mainstream CNNs achieve only 82.3%–86.7% average accuracy and 0.85–0.89 AUC on public datasets like BUSI [13]. For poorly defined infiltrating lesions, accuracy is generally below 70% [14], and recall for lesions \leq 5mm is only 0.65 [15], highlighting shortcomings of traditional single-branch global CNNs in extracting features from blurry and tiny lesions. Third, technical mechanisms have inherent limitations: while Mixture of Experts (MoE) architectures alleviate single-network adaptability issues via multi-expert collaboration, existing work divides experts by abstract feature types rather than anatomical regions, reducing model interpretability [16]. In CNN optimization, residual connections in ResNet solved deep network degradation but did not address differentiated channel importance allocation [4]. SENet introduced channel attention to enhance feature weighting and adaptive recalibration, but only worked at single layers without cross-layer connections [17]. DenseNet proposed cross-layer connections but forced the concatenation of all shallow features with fixed patterns and high redundancy [18]. Recent Layer Attention methods dynamically weight multi-layer features, reducing training loss by 15%–30% and improving downstream accuracy by 2%–5% in large language models, which provides valuable insights and good inspiration for this study [19,20]. To address these shortcomings—insufficient single-branch feature expression, unreasonable MoE expert division, and limitations of traditional attention—this paper proposes the Cross-Stage Attention Mixture-of-Experts Network (CSA-MoE-Net), with two targeted improvements. • First, inspired by the Attention Residual architecture’s cross-layer information interaction [21], a Cross-Stage Attention-enhanced ResNet-18 backbone is designed, breaking the limitations of single-layer attention, establishing dynamic feature associations across four residual stages, and using learnable query vectors for hierarchical importance evaluation to integrate shallow details and deep semantic features. • Second, a clinically driven three-expert MoE architecture is constructed, aligning model decisions with radiologists’ “Whole Tumor Image – Tumor Core – Boundary analysis” logic via three complementary branches: Expert-Img, Expert-Tumor, and Expert-Boundary. • Third, the proposed CSA-MoE-Net achieves excellent performance in intelligent breast ultrasound diagnosis, with high diagnostic accuracy and strong generalization ability that meet clinical application requirements. In conclusion, this model aims to build a multi-branch, specialized architecture consistent with clinical thinking, enhance generalization and clinical utility, and provide a new technical solution for intelligent breast ultrasound diagnosis. Fig. 1: Overall architecture of the proposed CSA-MoE-Net. It comprises a Mixture of Experts Block with three dedicated expert branches, a Cross-Stage Attention ResNet-18 backbone, and an Adaptive Gating Network for feature fusion and classification. The final fused feature is denoted as Fused Expert Feature (FEF). II Methodology The breast ultrasound classification model proposed in this paper adopts Cross-Stage Attention ResNet-18 as the backbone network and constructs a clinically driven three-branch MoE Block. The overall model follows the technical route of “Multi-View Feature extraction — Cross-Stage Attention enhancement — Dynamic Gating Fusion — Classification Decision.” Based on the clinical assessment logic of radiologists for “Whole Tumor Image – Tumor Core – Boundary assessment,” three complementary expert branches are designed: Expert-Img, Expert-Tumor, and Expert-Boundary, which independently extract multidimensional features. Each branch fuses multi-level semantic information through the Cross-Stage Attention mechanism to strengthen the expression of key features. Finally, an Adaptive Gating Network dynamically weights and fuses the outputs of the three branches, enabling comprehensive capture of lesion morphology, texture, and contextual information. This architecture deeply integrates clinical diagnostic priors with deep learning techniques, effectively enhancing feature discriminability and classification accuracy. The overall model architecture is shown in Fig.1. II-A Image Preprocessing and Multi-view Data Generation Due to

Read the complete text