Breast Cancer Classification in Deep Ultraviolet Fluorescence Images Using a Patch-Level Vision Transformer Framework
Pouya Afshin, David Helminiak, Tongtong Lu, Tina Yen, Julie M. Jorns, Mollie Patton, Bing Yu, Dong Hye Ye · 2025
Read Breast Cancer Classification in Deep Ultraviolet Fluorescence Images Using a Patch-Level Vision Transformer Framework by Pouya Afshin, David Helminiak, Tongtong Lu, Tina Yen, Julie M. Jorns, Mollie Patton, Bing Yu, Dong Hye Ye (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-07654.txt.
Introduction
Pouya Afshin and seven co-authors present a study from twenty twenty-five on sorting breast tissue as cancer or not from special scan images. In breast saving surgery, the aim is to cut out all bad tissue and keep sound tissue. A deep ultraviolet scope can image the whole cut face fast, with clear contrast. But the images are huge and their traits are complex.
Their frame uses a vision transformer that works patch by patch. It catches both local and broad traits in the image. A heat map tool weights the key zones, which makes the calls more clear to read. In five fold tests, the method beat standard deep tools by a wide gap, with high truth rates.
Catalog record
| CREATOR | Pouya Afshin, David Helminiak, Tongtong Lu, Tina Yen, Julie M. Jorns, Mollie Patton, Bing Yu, Dong Hye Ye |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-07654
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Breast Cancer Classification in Deep Ultraviolet Fluorescence Images Using a Patch-Level Vision Transformer Framework Thanks: Corresponding Author: [email protected] Pouya Afshin, David Helminiak, Tongtong Lu, Tina Yen, Julie M. Jorns, Mollie Patton, Bing Yu, Dong Hye Ye Abstract Breast-conserving surgery (BCS) aims to completely remove malignant lesions while maximizing healthy tissue preservation. Intraoperative margin assessment is essential to achieve a balance between thorough cancer resection and tissue conservation. A deep ultraviolet fluorescence scanning microscope (DUV-FSM) enables rapid acquisition of whole surface images (WSIs) for excised tissue, providing contrast between malignant and normal tissues. However, breast cancer classification with DUV WSIs is challenged by high resolutions and complex histopathological features. This study introduces a DUV WSI classification framework using a patch-level vision transformer (ViT) model, capturing local and global features. Grad-CAM++ saliency weighting highlights relevant spatial regions, enhances result interpretability, and improves diagnostic accuracy for benign and malignant tissue classification. A comprehensive 5-fold cross-validation demonstrates the proposed approach significantly outperforms conventional deep learning methods, achieving a classification accuracy of 98.33%. I INTRODUCTION Breast cancer continues to be one of the most significant health challenges in the United States, with an estimated 319,750 new cases in 2025, including 316,950 in women and 2,800 in men. Statistics for 2025 also estimate that the disease will cause 42,170 deaths, disproportionately affecting women [ 6 ] . Given that, on average, breast cancer affects approximately one in eight women within the United States, there exists an urgent need for faster, more efficient diagnostic tools, approaches, and treatments [ 1 , 7 , 8 ] . Breast-conserving surgery (BCS) or lumpectomy is the preferred treatment option for many patients, as it aims to remove tumors while saving healthy tissue. However, the presence of malignant cells at the surgical margins increases the risk of cancer recurrence. Traditionally, intraoperative margin assessment relies on radiographic imaging and postoperative examination of tissue histology, using hematoxylin and eosin (H&E) staining. Being a postoperative method, while accurate, a positive margin finding can lead to additional surgeries, causing further significant physical discomfort and emotional distress. Novel technological solutions to reduce these conditions and risks are highly desired [ 1 , 7 , 8 ] . Deep ultraviolet fluorescence scanning microscopy (DUV-FSM) has emerged as a groundbreaking technology for dealing with these challenges. Utilizing ultraviolet surface excitation, DUV-FSM enables real-time, high-resolution imaging of entire tissue surfaces without destructive sectioning. This modern technique offers exceptional visual clarity, allowing clear differentiation of textures and colors distinguishing cancerous and healthy tissues, making it particularly effective in delineating tumor margins [ 1 , 7 , 8 ] . Integration of DUV-FSM imaging with automated breast cancer classification techniques offers improved intraoperative margin assessments and minimization of surgical involvement [ 1 ] . Convolutional neural networks (CNNs) are widely used for medical image analysis, including breast cancer classification. However, the high resolution of DUV whole surface images (WSIs) requires excessive GPU memory for deep learning models, rendering direct processing impractical. Existing works have explored patch-based strategies, dividing WSIs into smaller, manageable portions. For example, [ 1 ] had ResNet-50 extract features, classifying with XGBoost, and focusing attention using Grad-CAM++ saliency maps, while [ 2 ] trained a support vector machine on patch-level features, applying weighted voting for final classification. Despite advancements in CNN-based architectures, they are generally limited by a reliance on small receptive fields, preventing the capture of global contextual information [ 25 ] . Since each patch contains interrelated cellular structures and/or cancerous cells, understanding long-range inter-spatial relationships can improve classification accuracy. This study alternately employs a vision transformer (ViT) [ 9 ] , which excels through the use of self-attention mechanisms to capture local and global structural dependencies, enhancing feature learning and providing resilience to noise [ 28 ] . Fig. 1: System Model for DUV WSI Classification: A WSI is divided into non-overlapping patches individually processed by the vision transformer (ViT). Each patch is further divided into sub-patches, transformed into learnable position and class embeddings, and passed through the transformer encoder. The updated class embedding is then classified via the MLP head. Simultaneously, Grad-CAM++ maps, generated using a fine-tuned CNN, provide patch-level importance weights. Finally, patch-level predictions and Grad-CAM++ weights are fused for the WSI-level classification. In order to improve the interpretability of ViT outputs, Grad-CAM++ [ 21 ] was integrated into a unified decision fusion framework to enhance model transparency and guide WSI-level classification in relevant spatial regions, where CAM [ 19 ] requires retraining per class, and Grad-CAM [ 20 ] assumes equal gradient weights, Grad-CAM++ isolates positive contributions to class predictions. This assigns more accurate per-pixel weights and improves saliency map precision. Guiding patch-level predictions with Grad-CAM++ enhances WSI classification performance. Summarily, this study makes the following contributions: • Patch-Based Processing for Deep Learning of WSI Improves classification performance and efficiency using patch-based processing of high-resolution WSIs. • Adoption of ViT Model for Patch Classification Implements ViT architecture to utilize local and global structural relationships for improved tissue assessments. • Integration of Grad-CAM++ for Interpretability Enhances interpretability of ViT results and guides patch-level predictions for improved WSI classification. II Method This study proposes a new approach for the classification of breast cancer in DUV WSIs. To address the challenge of limited data and enhance tumor localization, each WSI is preprocessed and segmented into smaller, non-overlapping patches. Using a transfer learning strategy, a pre-trained ViT model is fine-tuned to perform patch classification, learning discriminative features from available DUV data [ 9 ] . Following the methodology in [ 1 ] , an approach was adopted to enhance the interpretability of the classifier. Fine-tuning a pre-trained DenseNet-169 [ 16 ] network on DUV WSI data and applying Grad-CAM++ [ 21 ] generates regional saliency maps. These visually represent the model decision-making process and highlight spatial regions important to the classification task. To obtain the WSI-level classification, patch-level predictions are multiplied by their corresponding saliency map scores to compute a weighted combination. Thresholding the results through a sign function then yields a final binary determination. II-A Patch-Level Classification with ViT Leveraging transfer learning with a pre-trained ViT model, where common features are already understood, reduces the risk of overfitting and accelerates training [ 11 ] . After fine-tuning with DUV data, the model can extract fine-grained features and classify patches as malignant or benign. Let x_{i} represent the i -th sample from the DUV WSI dataset, where i\in\{1,\dots,M\} . Partitioning each x_{i} into smaller, non-overlapping patches of 400\times 400 pixels allows computational efficiency while providing sufficient detail of tissue morphology and cellular structures to make effective margin assessments. Patches containing more than 80\% background are excluded, as outlined in [ 1 ] . Each remaining patch \mathbf{p}_{i}^{j} becomes an individual input, being downsampled to a height H and width W required to pass into the ViT-Base architecture ( 224\times 224 pixels herein). When subsequently sent through the ViT, each input \mathbf{p}_{i}^{j} gets divided into N smaller, non-overlapping sub-patches \mathbf{s}_{i}^{jk}\in\mathbb{R}^{P\times P\times C} , where k\in\{1,\dots,N\} indexes the sub-patches, P\times P is the sub-patch size, and C indicates the number of channels. The total number of sub-patches is given by N=\frac{H\times W}{P^{2}} [ 9 ] . Each sub-patch \mathbf{s}_{i}^{jk} then gets flattened into a vector \text{vec}(\mathbf{s}_{i}^{jk})\in\mathbb{R}^{1\times(P^{2}\cdot C)} and