DiffuPT: Class Imbalance Mitigation for Glaucoma Detection via Diffusion Based Generation and Model Pretraining
Youssof Nawar, Nouran Soliman, Moustafa Wassel, Mohamed ElHabebe, Noha Adly, Marwan Torki, Ahmed Elmassry, Islam Ahmed · 2024
Read DiffuPT: Class Imbalance Mitigation for Glaucoma Detection via Diffusion Based Generation and Model Pretraining by Youssof Nawar, Nouran Soliman, Moustafa Wassel, Mohamed ElHabebe, Noha Adly, Marwan Torki, Ahmed Elmassry, Islam Ahmed (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-03629.txt.
Introduction
Youssof Nawar and co-authors present a 2024 method to spot glaucoma, an eye disease that slowly harms the optic nerve and can end sight. Early spotting is key, yet medical image sets often hold far more healthy eyes than sick ones. Classifiers trained on such lopsided data tend to miss the sick cases that matter most.
Their frame, called DiffuPT, makes synthetic images with a diffusion model to even out the classes. It also pretrains the model, so the final classifier starts from stronger features. The team gathered what they call the largest national dataset for this task to back the study. The combined route trained a sturdier classifier, they report, with a better balance between catching sick eyes and not flagging healthy ones. The aim is a tool that holds up in real screening.
Catalog record
| CREATOR | Youssof Nawar, Nouran Soliman, Moustafa Wassel, Mohamed ElHabebe, Noha Adly, Marwan Torki, Ahmed Elmassry, Islam Ahmed |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-03629
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DiffuPT: Class Imbalance Mitigation for Glaucoma Detection via Diffusion Based Generation and Model Pretraining Youssof Nawar, Nouran Soliman, Moustafa Wassel, Mohamed ElHabebe, Noha Adly, Marwan Torki, Ahmed Elmassry, Islam Ahmed Abstract Glaucoma is a progressive optic neuropathy characterized by structural damage to the optic nerve head and functional changes in the visual field. Detecting glaucoma early is crucial to preventing loss of eyesight. However, medical datasets often suffer from class imbalances, making detection more difficult for deep-learning algorithms. We use a generative-based framework to enhance glaucoma diagnosis, specifically addressing class imbalance through synthetic data generation. In addition, we collected the largest national dataset for glaucoma detection to support our study. The imbalance between normal and glaucomatous cases leads to performance degradation of classifier models. We created a more robust classifier training process by combining our proposed framework leveraging diffusion models with a pretraining approach. This training process results in a better-performing classifier. The proposed approach shows promising results in improving the harmonic mean “sensitivity and specificity” and AUC for the roc for the glaucoma classifier. We report an improvement in the harmonic mean metric from 89.09% to 92.59% on the test set of our Egyptian dataset. We examine our method against other methods to overcome imbalance through extensive experiments. We report similar improvements on the AIROGS dataset. This study highlights that diffusion-based generation can be important in tackling class imbalances in medical datasets to improve diagnostic performance. 1 Introduction Glaucoma condition is an eye disease primarily affecting peripheral vision. If left untreated, it can lead to blindness [ 15 ] . Therefore, regular examinations targeting specific age groups and health conditions are crucial for early detection and intervention to prevent further eye damage [ 40 ] . Recent advancements in computer vision, particularly deep learning algorithms, have been employed to facilitate the detection of glaucomatous eyes. In this study, we explore various approaches to address glaucoma’s low prevalence, estimated to be approximately 3.54% according to Tham et al. [ 42 ] . This prevalence is also evident in all the available datasets. Class imbalance is a persistent issue in datasets, especially in medical datasets, where data collection and annotation can be costly and diseases may be underrepresented. Data sampling techniques can be employed [ 45 ] where classes are oversampled or undersampled accordingly. Cost-sensitive learning employs a penalty matrix to penalize minority classes loss more [ 19 , 38 , 41 ] . Another technique is decoupled representation learning, where feature extraction is decoupled from classifier training [ 17 ] . Standard image augmentation employs simple transformations like rotations, flips, and brightness adjustments, providing computational efficiency and ease of implementation. This simplicity facilitates widespread applicability across diverse datasets and models, improving robustness and generalization. However, these basic techniques may fail to capture the intricate patterns present in some datasets. Diagnostic tasks demand a deeper understanding of higher-level semantics. These tasks require more sophisticated augmentation strategies involving domain-specific knowledge to optimize model performance. In recent works, generative vision models [ 10 , 13 , 30 ] have emerged generating high-quality images however, the use of these models in other computer vision tasks was quite unclear. Several attempts to generate synthetic images to be used in dataset augmentation [ 34 , 29 ] . These attempts were either on simple datasets or didn’t improve the performance against other techniques. This work aims to introduce a clearer study of generative models in a more intricate domain such as eye fundus. We aim to utilize these generated images for the glaucoma classification task. We propose a new training scheme that can outperform all mentioned techniques in addressing the class imbalance problem. In addition, we introduce our Egyptian dataset for Glaucoma Detection ( GlaucomaEgy ). While existing datasets are available for glaucoma detection like AIROGS [ 5 ] , LAG [ 22 ] , and REFUGE [ 28 ] . There exists ethnic variation in fundus images which refers to differences in the appearance of the retina among individuals of different ethnic backgrounds [ 16 , 23 ] . These variations significantly affect glaucoma detection [ 23 , 43 ] . To overcome these variations, we collected more than 37K samples, with roughly 10 percent having glaucomatous eyes. That was through a countrywide effort that targeted local hospitals from all over the nation. In section 3 , we will go over the dataset in details. Our proposed framework aims to leverage the generative model’s ability to capture the complex distribution of the data. In addition to its ability to clearly distinguish the class-specific attributes to generate data that can be used in a pre-training methodology to improve the classifier results. This can be broken down into several steps. Initially, we train a generative model to generate high-quality images for both glaucomatous and non-glaucomatous fundus images without any additional annotation. Next, we use the newly generated data as a pretraining for our desired classifier based on baseline experiments. Finally, we Fine-tune the classifier on the real dataset to improve the classification results. More details on experimental results and the final framework will be discussed in sections 4 and 5 . To summarize, our main contributions are: • We introduce the largest national dataset for glaucoma detection ( GlaucomaEgy ), which has helped us bridge the gap between available open-source data and our national data. • Introducing a framework that utilizes a generative model for enhancing other computer vision tasks i.e. glaucoma classification. Our framework requires no additional annotations for the generated data. • Comparison between diffusion-based and GAN-based generation specifically between conditional diffusion models and image-to-image translation GANs. • Comparison between our proposed framework for training and current techniques used for mitigating class imbalances through extensive experiments. 2 Related Work Figure 1 : Analysis of the embeddings on different training techniques. Normal Training shows high variance and low bias (less overlap between glaucoma and non-glaucoma classes. Pre-training alone shows much more stability with lower variance but with higher overlap. The fine-tuned model shows the best of both worlds, a robust classifier with lower variance and lower bias. 2.1 Deep Learning in Glaucoma Deep learning methods have demonstrated remarkable results across various tasks in fundus imaging analysis [ 8 ] . Multiple CNN architectures, such as those discussed in [ 24 , 6 , 20 ] , have been employed for the early detection of Glaucomatous eyes and the segmentation of fundus images [ 49 ] . These architectures have shown excellent performance in extracting relevant features for classification. In recent developments, Transformers [ 46 ] have been introduced into vision tasks, achieving impressive results. The Vision Transformer (ViT) [ 7 ] is a deep learning architecture that utilizes self-attention mechanisms to capture global characteristics in images. Various Vision Transformer architectures, as highlighted in [ 47 ] , have been applied to glaucoma detection surpassing the performance of CNNs. 2.2 Generative Models 2.2.1 Generative Adversarial Networks (GANs) GANs [ 10 ] represented a breakthrough in the field of synthetic data generation and especially image generation. The evolution of GAN-based generators depends on adversarial training, where a discriminator is trained to differentiate between real and fake data minimizing a discrimination loss while the generator tries to maximize it.