MamT 4 : Multi-view Attention Networks for Mammography Cancer Classification

Alisher Ibragimov, Sofya Senotrusova, Arsenii Litvinov, Egor Ushakov, Evgeny Karpulevich, Yury Markin · 2024

Read MamT 4 : Multi-view Attention Networks for Mammography Cancer Classification by Alisher Ibragimov, Sofya Senotrusova, Arsenii Litvinov, Egor Ushakov, Evgeny Karpulevich, Yury Markin (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-01669.txt.

Description

Abstract In this study, we introduce a novel method, called MamT 4 , which is used for simultaneous analysis of four mammography images. A decision is made based on one image of a breast, with attention also devoted to three additional images: another view of the same breast and two images of the other breast.

Catalog record

CREATORAlisher Ibragimov, Sofya Senotrusova, Arsenii Litvinov, Egor Ushakov, Evgeny Karpulevich, Yury Markin
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-01669

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MamT 4 : Multi-view Attention Networks for Mammography Cancer Classification Alisher Ibragimov, Sofya Senotrusova, Arsenii Litvinov, Egor Ushakov, Evgeny Karpulevich, Yury Markin Abstract In this study, we introduce a novel method, called MamT 4 , which is used for simultaneous analysis of four mammography images. A decision is made based on one image of a breast, with attention also devoted to three additional images: another view of the same breast and two images of the other breast. This approach enables the algorithm to closely replicate the practice of a radiologist who reviews the entire set of mammograms for a patient. Furthermore, this paper emphasizes the preprocessing of images, specifically proposing a cropping model (U-Net based on ResNet-34) to help the method remove image artifacts and focus on the breast region. To the best of our knowledge, this study is the first to achieve a ROC-AUC of 84.0 ± 1.7 and an F1 score of 56.0 ± 1.3 on an independent test dataset of Vietnam digital mammography (VinDr-Mammo), which is preprocessed with the cropping model. I Introduction Breast cancer is a leading cause of cancer-related deaths among women [ 1 ] . Regular screening is essential for early detection, with mammography being the primary screening tool [ 2 ] . Mammography utilizes low-dose X-rays to detect tissue changes in the breast, making it effective in detecting malignancies like microcalcifications and clusters of calcifications [ 3 ] . Radiologists interpret mammograms based on standard terminology and the BI-RADS classification system, facilitating standardized reporting and risk assessment [ 4 ] . Although mammography is effective, it can result in false positives or negatives, requiring additional tests like biopsies [ 5 ] . To improve the efficiency of early screening, automated approaches in mammography, such as computer-aided diagnosis (CAD) systems, as well as solutions using machine learning and deep learning (DL) technologies, are being actively developed, assisting radiologists in interpreting mammogram [ 6 ] . Deep Learning has emerged as a highly effective method for image classification [ 7 ] . Furthermore, DL has become one of the popular methods for detection of cancer pathologies, particularly, on mammograms [ 8 ] . A key aspect of mammographic examinations is the acquisition of images in different projections for each breast, requiring four images in total – two for each breast (MLO and CC). Radiologists analyze the symmetry of lesions [ 9 ] . This unique feature affects the training of DL models and the use of multi-view, a novel approach based on learning four projections at once, presented in this study. Given the widespread significance of breast cancer diagnosis, this research on utilizing deep learning methods offers a valuable chance to enhance the automation of breast pathology detection and streamline the tasks of radiologists. To sum up, the contributions of our paper are: 1. We propose MamT 4 : a novel classification framework based on Transformer Encoder that utilizes feature vector representations from four views of mammography studies and outperforms single-view methods in classifying cancer status. 2. To the best of our knowledge, this paper is the first to achieve ROC-AUC of 84.0\pm 1.7 and F1 of 56.0\pm 1.3 on the VinDr-Mammo dataset (test subset). 3. As a preprocessing, we propose the following method: cropping the breast along its border using U-Net to increase the quality of classification. II Background and Preliminaries Fig. 1: An overview of the training process of the CNN and classification layer applied to a binary classification problem using a single view. Subsequently, the trained CNN block is employed to derive a feature vector ( z_{i} ) from the mammography image ( x_{i} ). II-A U-Net U-Net [ 10 ] , introduced in 2015, is an encoder-decoder network tailored for semantic segmentation, which excels in medical image segmentation. The architecture efficiently maps low-resolution encoder features to high-resolution inputs through a decoder that uses pooling indices from the encoder for precise pixelwise classification. This setup enables U-Net to accurately delineate detailed features in medical images, crucial for identifying and segmenting various anatomical structures and abnormalities [ 11 ] . Its ability to handle small datasets effectively and its adaptability to various medical imaging modalities have made U-Net a standard choice in medical image analysis, enhancing diagnostic accuracy and aiding in clinical decision-making. II-B Transformer Encoder Our approach draws inspiration from the ViT (Vision Transformer) framework [ 12 ] . Transformer Encoder (TE) block consists of layer norm, multi-head self-attention (MSA) and multi-layer perceptron (MLP). Also, as shown in Figure 2 the TE block accepts combined embeddings as input. For all subsequent blocks, the inputs are the outputs from the previous block of the TE. There is a total of L such TE blocks. Inside the TE, the inputs are first passed through a layer norm, and then fed to MSA layer with N heads. Once we get the outputs from the MSA layer, these are added to the inputs (with skip connection) to get the outputs that again get passed to layer norm before being fed to the MLP block. The MLP consists of two linear layers and a GELU non-linearity. The outputs from the MLP block are again added to the inputs to get the final output from one TE block. II-C Loss Function We use the focal loss (FL) function was selected to achieve a greater stability when training on both frequent (normal cases) and rare (cancer cases) images [ 13 ] . For the case of a binary classification, the focal loss can be written in the following form [ 14 ] : \mathrm{FL}\left(p_{\mathrm{t}}\right)=-\alpha_{\mathrm{t}}\left(1-p_{\mathrm{t}}\right)^{\gamma}\log\left(p_{\mathrm{t}}\right), (1) where \gamma\geq 0 is a tunable focusing parameter, and \alpha_{t} is a weighting factor for different classes to balance the importance for positive and negative examples. Namely, \alpha_{1}=1-\frac{N_{c}}{N} for class {cancer} and \alpha_{0}=1-\alpha_{1} for class {normal}, where N_{c} is the number of images marked as {cancer} and N is the total number of images in dataset. For notational convenience, p_{t} was defined as: p_{\mathrm{t}}=\begin{cases}p&\text{ if }y=\mathrm{cancer}\\ 1-p&\text{ otherwise. }\end{cases} (2) In the above, y specifies the ground-truth class and p\in[0,1] is the model’s estimated probability for the class with label y=\mathrm{cancer} . This approach improved the performance of the small number of cancer images due to the modulating factor (1-p_{t})^{\gamma} . Fig. 2: A summary of the MamT 4 framework that is used for cancer classification on x_{i}^{0} images. Here, x_{i}^{0} represents the primary view, while x_{i}^{1} is the corresponding ipsilateral view to the primary one. Similarly, x_{i}^{2} depicts the corresponding bilateral view to the main view, whereas x_{i}^{3} illustrates the ipsilateral view of x_{i}^{2} . The CNN block, which gives the features vectors ( z_{i}^{0} , z_{i}^{1} , z_{i}^{2} , z_{i}^{3} ) with fixed length 1536 per each one, are untrainable during this stage. Each vector is divided into fixed-size patches, each of which is linearly embedded. After adding position embeddings, the resulting sequence of vectors is fed to a Transformer Encoder. In order to perform classification, we use the standard approach of adding an extra learnable [class] token to the sequence. The illustration of the Transformer Encoder was inspired by Dosovitskiy et al. [ 12 ] III Methodology In this paper, we propose a novel method to achieve a better quality to

Read the complete text