Multi-Attention Stacked Ensemble for Lung Cancer Detection in CT Scans

Uzzal Saha, Surya Prakash · 2025

Read Multi-Attention Stacked Ensemble for Lung Cancer Detection in CT Scans by Uzzal Saha, Surya Prakash (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20221.txt.

Introduction

Uzzal Saha and Surya Prakash combine three deep learning networks into one system for telling harmless lung nodules from cancerous ones in CT scans. Each network first learned from general images and was then adapted to scan patches. Writing in twenty twenty-five, the authors add a two-stage attention step that learns how much to trust each network overall and for each class. A small final learner polishes the verdict. Training tricks include a loss focused on hard cases, blended-image augmentation, and repeated test-time views of each scan.

On a standard public lung scan data set, the combined system scored accuracy and discrimination near the top of the reported range. It cut errors well below prior best methods by their count. Sensitivity and specificity were both high and balanced, including cases where radiologists had disagreed. The authors offer the system as a screening aid for radiologists.

Catalog record

CREATORUzzal Saha, Surya Prakash
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-20221

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multi-Attention Stacked Ensemble for Lung Cancer Detection in CT Scans Uzzal Saha, Surya Prakash Abstract In this work, we address the challenge of binary lung nodule classification (benign vs. malignant) using CT images by proposing a multi‐level attention stacked ensemble of deep neural networks. Three pretrained backbones: EfficientNet V2 S, MobileViT XXS, and DenseNet201 are each adapted with a custom classification head tailored to 96 x 96 pixel inputs. A two‐stage attention mechanism learns both model‐wise and class‐wise importance scores from concatenated logits, and a lightweight meta‐learner refines the final prediction. To mitigate class imbalance and improve generalization, we employ Dynamic Focal Loss with empirically calculated class weights, MixUp augmentation during training, and Test‐Time Augmentation at inference. Experiments on the LIDC-IDRI dataset demonstrate exceptional performance, achieving 98.09% accuracy and 0.9961 AUC, representing a 35% reduction in error rate compared to state-of-the-art methods. The model exhibits balanced performance across sensitivity which is 98.73% and specificity which is 98.96% with particularly strong results on challenging cases where radiologist disagreement was high. Statistical significance testing confirms the robustness of these improvements across multiple experimental runs. Our approach can serve as a robust, automated aid for radiologists in lung cancer screening. keywords Stacking Ensemble Learning, Attention Mechanism, Dynamic Focal Loss, MixUp, Test‐Time Augmentation 1 Introduction Lung cancer remains the leading cause of cancer‐related mortality worldwide, yet early detection via low‐dose CT screening can drastically improve patient outcomes Siegel et al. 2023 . Within CT images, pulmonary nodules exhibit a wide range of shapes, textures, and intensities, making it difficult to distinguish benign from malignant lesions. Moreover, publicly available datasets such as LIDC-IDRI are heavily skewed toward benign cases, and variations in scanner protocols and slice thickness further aggravate heterogeneity Armato et al. 2011 . Traditional machine‐learning pipelines relying on handcrafted features struggle to generalize across these variations, while single‐backbone convolutional neural networks though powerful—often overfit to dominant patterns and fail to capture complementary characteristics of subtle nodules. Simple ensemble techniques (e.g., majority voting or uniform averaging of logits) attempt to combine multiple CNN predictions but treat each model’s output equally, ignoring that certain architectures may excel at recognizing specific visual attributes (e.g., fine texture vs. global shape). As a result, existing approaches typically plateau around mid-90s in overall accuracy, often at the cost of lower sensitivity for malignant nodules. To overcome these limitations, we propose a Multi-Attention Stacked Ensemble (MASE) that dynamically weights both entire models and individual class predictions. Specifically, three state-of-the-art backbones—DenseNet-201, EfficientNet V2 S, and MobileViT XXS are each adapted with a lightweight classification head optimized for 96 × 96 CT patches. During inference, concatenated logits from all three are first passed through a “model-level” attention layer, which learns to emphasize more reliable network outputs; a subsequent “class-level” attention layer highlights discriminative features for benign versus malignant classes. A small meta-learner then fuses these attended representations into a final prediction. To further improve robustness against class imbalance and overfitting, the MASE framework integrates Dynamic Focal Loss (with empirically computed class weights), MixUp augmentation during training, and Test-Time Augmentation at inference. In extensive experiments on LIDC-IDRI, MASE consistently surpasses each standalone backbone and uniform ensembling, achieving higher sensitivity for malignant nodules while maintaining strong specificity. These results suggest that dynamically attending to model and class cues can significantly bolster automated lung cancer screening systems, offering a reliable second-reader tool to reduce inter-observer variability. The remainder of this paper is organized as follows. Section 2 reviews related work; Section 3 describes the dataset and preprocessing; Section 4 details model architectures and loss functions; Section 5 outlines training and evaluation protocols; Section 6 presents experimental results and analysis; Section 7 discusses findings and limitations; and Section 8 concludes. 2 Related work Early computer‐aided diagnosis (CAD) pipelines for lung nodules followed a multi‐stage workflow: lung segmentation (often via Hounsfield‐unit thresholding and morphological operations), candidate detection (gray‐level thresholding, shape analysis), handcrafted feature extraction, and classical classification (SVM, Random Forest, k‐NN) El-Baz et al. 2013 ; Kostis et al. 2013 . Handcrafted descriptors included intensity statistics (mean, variance, skewness), shape attributes (sphericity, elongation, perimeter‐to‐area ratio), and texture features such as Gray Level Co‐occurrence Matrix (GLCM) and Local Binary Patterns (LBP) Way et al. 2012 ; Zhao et al. 2010 ; Murphy et al. 2009 . Although some hybrid approaches e.g., Froz et al.’s artificial crawler and rose‐diagram method reached up to 94.4 % accuracy on small cohorts Froz et al. 2017 , these methods failed to generalize to large, heterogeneous datasets like LIDC‐IDRI, due to scanner variability and limited capacity to learn complex visual patterns. The emergence of convolutional neural networks (CNNs) shifted focus to end‐to‐end learning from raw CT data. Early 2D CNN models applied patch‐based classification on axial slices. Shen et al. Shen et al. 2015 achieved 90 % accuracy on a subset of LIDC‐IDRI using a multi‐scale 2D CNN. Subsequent work fine‐tuned deeper architectures (ResNet‐50, DenseNet‐121, Inception‐V3) pretrained on ImageNet, reporting 92 %–94 % accuracy with focal loss or weighted cross‐entropy Nam et al. 2019 . Three‐dimensional CNNs (e.g., 32³‐voxel cubes) further improved context modeling: Liao et al. Liao et al. 2020 combined a 3D ResNet backbone with a recurrent network to achieve 94 % accuracy on LIDC‐IDRI. More recently, transformer‐inspired models (e.g., Vision Transformer variants) have been applied to volumetric patches; Li et al. Li et al. 2022 reported 95 % accuracy by integrating self‐attention over 3D nodule volumes. Despite these strides, single‐backbone approaches frequently plateau in the mid‐90s, especially under severe class imbalance. Ensembling multiple deep networks via averaging logits or majority voting has become a common strategy to boost classification robustness. Sagi et al. Sagi and Rokach 2018 combined three distinct 2D CNNs on LIDC‐IDRI patches, reporting a 95 % overall accuracy. Antolović et al. Antolović et al. 2019 introduced a gated ensemble where a trainable weighting module assigns per input model importance, yielding a 1–2 % improvement on lung nodule cohorts. Zhang et al. Zhang et al. 2021 extended this by applying a single‐level attention mechanism over concatenated logits, achieving 96 % accuracy. However, most existing ensembles (even attention‐based) treat each model’s output as a monolithic vector neglecting the possibility that certain models may be more reliable for specific classes. Very few studies incorporate both model‐level and class‐level attention within a unified framework. Attention modules originally popularized by transformers allows network to focus on diagnostically relevant regions or feature channels. In lung nodule analysis, attention gates have highlighted subtle nodule boundaries without explicit supervision Li et al. 2019 ; Schlemper et al. 2018 . Focal Loss Lin et al. 2017 mitigates class imbalance by down weighting easy examples, and Dynamic Focal Loss Zhang et al. 2021 further adjusts the \alpha parameter per class during training. MixUp augmentation Zhang et al. 2018 creates interpolated samples that improve generalization. Test‐Time Augmentation (TTA) Wang et al. 2018 aggregates predictions over random flips and rotations, reducing inference variance; Chen et al. Chen et al. 2020 reported a 1 % AUC improvement with TTA. While these techniques have become widespread, few studies combine attention‐based ensembling with dynamic loss and augmentation strategies in a single pipeline for lung nodule classification. Traditional methods reliant on handcrafted features struggle to generalize across diverse CT protocols, and single CNNs

Read the complete text