Dynamic Contextual Attention Network: Transforming Spatial Representations into Adaptive Insights for Endoscopic Polyp Diagnosis

Teja Krishna Cherukuri, Nagur Shareef Shaik, Sribhuvan Reddy Yellu, Jun-Won Chung, Dong Hye Ye · 2025

Read Dynamic Contextual Attention Network: Transforming Spatial Representations into Adaptive Insights for Endoscopic Polyp Diagnosis by Teja Krishna Cherukuri, Nagur Shareef Shaik, Sribhuvan Reddy Yellu, Jun-Won Chung, Dong Hye Ye (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20306.txt.

Introduction

Teja Krishna Cherukuri and co-authors present a vision model for spotting colon polyps in a 2025 paper. Polyps are early warning signs of colorectal cancer, but scope images can miss them or leave doctors unsure where the growth sits. Their network adds a dynamic attention system that shifts focus toward the most telling regions of each image.

Rather than bolting on a separate locator, the model folds context into the classification step itself. That makes its verdicts easier to explain, since the focus map shows what drove the call. The catalog title carries footnote clutter, but the work is the attention network described here. Clearer, better-flagged images could raise early cancer detection.

Catalog record

CREATORTeja Krishna Cherukuri, Nagur Shareef Shaik, Sribhuvan Reddy Yellu, Jun-Won Chung, Dong Hye Ye
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-20306

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Dynamic Contextual Attention Network: Transforming Spatial Representations into Adaptive Insights for Endoscopic Polyp Diagnosis Thanks: * Equal Contribution Thanks: Corresponding Author: [email protected] Teja Krishna Cherukuri, Nagur Shareef Shaik, Sribhuvan Reddy Yellu, Jun-Won Chung, Dong Hye Ye Abstract Colorectal polyps are key indicators for early detection of colorectal cancer. However, traditional endoscopic imaging often struggles with accurate polyp localization and lacks comprehensive contextual awareness, which can limit the explainability of diagnoses. To address these issues, we propose the Dynamic Contextual Attention Network (DCAN). This novel approach transforms spatial representations into adaptive contextual insights, using an attention mechanism that enhances focus on critical polyp regions without explicit localization modules. By integrating contextual awareness into the classification process, DCAN improves decision interpretability and overall diagnostic performance. This advancement in imaging could lead to more reliable colorectal cancer detection, enabling better patient outcomes. I Introduction Colorectal cancer poses a significant global health challenge, with colorectal polyps serving as critical precursors that necessitate timely identification and intervention [ 1 ] . Despite advancements in medical imaging and diagnostics, current endoscopic techniques often struggle to accurately localize and classify polyps while providing sufficient explainability [ 2 ] . The inherent variability in polyp appearance, including differences in size, shape, texture, and illumination noise, complicates detection efforts, often resulting in missed diagnoses and delays in treatment [ 3 ] . This drives the need for enhanced diagnostic tools that assist clinicians in making informed decisions while minimizing the risk of human error during colonoscopy procedures. Recent studies have explored various deep learning methods to improve polyp detection and classification [ 4 ] . For instance, the Tiny Polyp detection method leverages Vision Transformers to enhance feature extraction while maintaining computational efficiency, significantly improving recall and precision compared to traditional models like YOLOv5 [ 5 ] . Similarly, the YOLO-V8 network has demonstrated remarkable results in achieving high precision and recall rates in polyp detection through a robust AI-driven approach, indicating the potential for integrating advanced neural networks into clinical workflows [ 6 ] . Other methods, such as deep convolutional neural networks (CNNs), have focused on addressing challenges posed by polyp variability, employing innovative techniques for feature extraction and data augmentation to enhance model performance [ 7 ] . However, despite these advancements, existing methods exhibit notable drawbacks. Many traditional models struggle with explainability and the integration of contextual information, leading to difficulties in clinical acceptance [ 8 ] . Attention mechanisms, including Spatial, Squeeze & Excitation, Non-local, Global Context, Gated, Self-Attention, Triplet Attention, and Guided Context Gating, are designed to enhance model performance by prioritizing relevant features. However, they frequently exhibit limitations in polyp diagnosis from endoscopic images, which may hinder their effectiveness in clinical applications. For example, Spatial Attention may overlook critical local relationships between anatomical structures, leading to misinterpretations [ 9 ] , while Squeeze & Excitation improves feature representation but fails to capture nuanced interactions essential for accuracy [ 10 ] . Non-local [ 11 ] and Global Context [ 12 ] attention mechanisms can introduce noise, complicating the extraction of clinically relevant insights. Gated [ 13 ] and Self-Attention [ 14 ] mechanisms dynamically adjust feature importance but lack robustness in managing polyp variability, which is crucial in clinical settings. Triplet Attention [ 15 ] , which leverages cross-dimensional interactions to capture spatial and channel-wise dependencies, offers a more comprehensive feature representation compared to Self-Attention. However, it may still struggle with the inherent variability and noise in endoscopic images, particularly under challenging illumination conditions. Furthermore, Guided Context Gating [ 16 ] , while enhancing localized lesion context, may be biased towards induced light illuminations, distorting attention to significant anatomical features. These limitations underscore the necessity for an attention framework that not only enhances focus on relevant features but also refines illumination noise, providing clear and interpretable insights to support reliable medical decision-making. In response to these challenges, we propose the Dynamic Contextual Attention Network (DCAN), which aims to bridge the gap between detection performance and explainability in polyp classification. Our proposed attention mechanism effectively transforms spatial representations into adaptive contextual insights, allowing the model to enhance its focus on potential polyp regions without relying on explicit localization modules. This approach enables the dynamic adaptation of diagnostically relevant regions, thereby improving the explainability of the model’s decisions. Fig. 1: Architecture of the Proposed Dynamic Contextual Attention Network (DCAN). Pre-processing applies CLAHE to enhance contrast. EfficientNet V_{2}B_{0} extracts spatial features, while the Dynamic Contextual Attention mechanism boosts diagnosis accuracy and explainability by focusing on relevant anatomical regions and filtering out noise. The Regularized Classification Head categorizes images as Normal or Abnormal, and GradCAM++ visually explains the DCAN’s decisions. II Methodology The primary objective of this research is to design a colorectal polyp detection framework that significantly enhances both detection accuracy and explainability by dynamically targeting relevant anatomical regions while effectively filtering out noise from inconsistent illumination and irrelevant structures - common challenges in endoscopic images. To achieve this, we develop and evaluate the Dynamic Contextual Attention Network (DCAN), an advanced attention-based approach for colorectal polyp detection. Our focus is on improving polyp localization without relying on explicit localization modules through the multi-stage attention process of DCA, which employs spatial, gated, and adaptive attention refinement mechanisms to dynamically concentrate on diagnostically relevant regions. This approach aims to reduce miss detections caused by variations in polyp size, shape, and texture. The following subsections details the components of the proposed method. II-A Representation Learning Representation learning is crucial for effectively capturing complex patterns from medical images. For polyp detection, leveraging pre-trained models allows us to build upon existing knowledge and enhance the performance of our framework. In this study, we employ the pre-trained EfficientNet V_{2}B_{0} model to extract initial feature representations from the pre-processed endoscopic images, leveraging its efficient architecture and robust performance to minimize computational overhead [ 17 ] . Given an image I , fine-tuning the EfficientNet V_{2}B_{0} model on our curated dataset of endoscopic images yields feature maps of dimensions (16\times 16\times 1280) , represented as F=\text{EfficientNet}{V_{2}B_{0}}(I) . This results in a compact representation that captures 1280 distinct features distributed across a 16\times 16 grid, effectively encapsulating vital information necessary for precise polyp detection and localization in subsequent processing stages. II-B Dynamic Contextual Attention The goal of the Dynamic Contextual Attention (DCA) is to enhance feature representation in convolutional neural networks (CNNs) by dynamically focusing on relevant spatial regions while filtering out irrelevant or noisy features. Traditional attention mechanisms often highlight coarse regions without considering finer distinctions or contextual dependencies between spatial locations. The DCA mechanism overcomes these limitations by combining spatial, gating, and adaptive attention refinement mechanisms to capture more refined, contextually aware attention maps. This approach is designed to improve tasks that require fine-grained feature localization in endoscopic imaging, where precise attention to detail is critical. II-B 1 Spatial Attention The spatial attention focuses on relevant spatial locations within the input feature map and highlights regions of interest. Given an input feature map F\in\mathbb{R}^{H\times W\times D} , where H , W , and D denote the height, width, and number of features respectively, we first apply a convolutional layer with kernel size k\times k , number of filters F , and stride

Read the complete text