Federated Learning for Diabetic Retinopathy Diagnosis: Enhancing Accuracy and Generalizability in Under-Resourced Regions
1 st Gajan Mohan Raj, 2 nd Michael G. Morley, 3 rd Mohammad Eslami · 2024
Read Federated Learning for Diabetic Retinopathy Diagnosis: Enhancing Accuracy and Generalizability in Under-Resourced Regions by 1 st Gajan Mohan Raj, 2 nd Michael G. Morley, 3 rd Mohammad Eslami (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-00869.txt.
Description
A 2024 arXiv research paper by 1 st Gajan Mohan Raj, 2 nd Michael G. Morley, 3 rd Mohammad Eslami. Diabetic retinopathy is the leading cause of vision loss in working-age adults worldwide, yet under-resourced regions lack ophthalmologists. Current state-of-the-art deep-learning systems struggle at these institutions due to limited generalizability. This paper explores a novel federated learning system for diabetic retinopathy diagnosis with the EfficientNetB0 architecture to leverage fundus data from multiple institutions to improve diagnostic generalizability at under-resourced hospitals while preserving patient-privacy.
Catalog record
| CREATOR | 1 st Gajan Mohan Raj, 2 nd Michael G. Morley, 3 rd Mohammad Eslami |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-00869
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Federated Learning for Diabetic Retinopathy Diagnosis: Enhancing Accuracy and Generalizability in Under-Resourced Regions 1 st Gajan Mohan Raj, 2 nd Michael G. Morley, 3 rd Mohammad Eslami Abstract Diabetic retinopathy is the leading cause of vision loss in working-age adults worldwide, yet under-resourced regions lack ophthalmologists. Current state-of-the-art deep-learning systems struggle at these institutions due to limited generalizability. This paper explores a novel federated learning system for diabetic retinopathy diagnosis with the EfficientNetB0 architecture to leverage fundus data from multiple institutions to improve diagnostic generalizability at under-resourced hospitals while preserving patient-privacy. The federated model achieved 93.21% accuracy in five-category classification on an unseen dataset and 91.05% on lower-quality images from a simulated under-resourced institution. The model was deployed onto two apps for quick and accurate diagnosis. I Introduction Diabetes mellitus often leads to diabetic retinopathy (DR), a condition that damages retinal blood vessels and can cause severe vision loss or blindness. Currently, 103 million people worldwide are affected by DR, with this number expected to rise to 161 million by 2045. Projections indicate that DR prevalence in under-resourced regions like the Middle East and Africa could increase by 20.6% to 47.2% by 2030, outpacing growth in high-income areas like the United States [ 1 ] . I-A Motivations I-A 1 Ophthalmologists Shortage Early detection of DR is crucial to prevent vision loss, yet many regions worldwide face a shortage of ophthalmologists required for diagnosis. In Sub-Saharan Africa countries, there is an average of approximately 2.5 ophthalmologists per a million population, compared with a ratio of 56.8 ophthalmologists per a million population in the United States [ 2 , 3 ] . This limited access to ophthalmologists leads to delayed diagnosis and increased risk of blindness for people in these under-resourced regions. Thus, there is a need for alternative diagnosis methods. I-A 2 Current Challenges of AI in DR Diagnosis While advances in AI have improved DR diagnosis, current AI-diagnostic systems struggle to be effective in real-world settings, due to over-fitting to a specific institution’s data and poor generalization across diverse populations. For instance, Google’s 2020 DR detection model, despite its 90% proposed accuracy, failed in real-world testing due to poor generalization and long screening times [ 4 ] . I-A 3 Resource Constraints in DR Imaging In addition to having a lack of trained ophthalmologists, many under-resourced healthcare institutions are located in sparse, remote regions. The retinal images collected in under-resourced regions are also of lower quality due to a lack of adequate imaging devices. Deep learning algorithms require large datasets of high-quality images to perform reliably and accurately. The inadequacy in both the amount and quality of retinal images at medical institutions of under-resourced regions makes it difficult for these institutions to build accurate DR-diagnosis deep learning systems. Thus, it is crucial for medical institutions in under-resourced regions to have access to high-quality DR data to improve their diagnosis models. I-B Solutions One approach is to gather fundus data from various global medical institutions and train a centralized DR diagnosis model on this combined dataset (Fig. 1A). However, centralized data-sharing faces significant challenges due to patient privacy, intellectual property, and data ownership concerns. Regulations like Europe’s GDPR and the U.S.’s HIPAA [ 5 , 6 ] restrict sharing patient data across institutions, making international implementation of a centralized data-sharing model difficult. Federated learning (FL) enables collaborative, decentralized training of models across multiple clients without transferring data between them. Instead of gathering data from various locations, FL trains a shared model on a central server while keeping the data at its origin by learning from CNN architectures. This approach allows medical institutions to contribute to AI-driven systems for diagnosis, treatment, and disease monitoring without compromising patient privacy [ 7 ] . This approach can be valuable in regions like Sub-Saharan Africa, where quality data and trained ophthalmologists are scarce. In this work, we explore the use of federated learning for DR diagnosis and severity assessment, demonstrating with experiments how federated learning can also be a solution for under-resourced regions. Figure 1 : Centralized data-sharing system (a) vs Federated learning-driven system (b) II Materials and Methodology II-A Background II-A 1 Federated learning-driven system framework Patient privacy, confidentiality, and data ownership concerns prevent the development of a centralized data-sharing system in which data would be shared to a central server (depicted in Fig. 1A). Therefore, a federated learning-driven system is proposed. Fig. 1 depicts the federated learning system as compared to the centralized data-sharing system. As depicted in Fig. 1B, the medical institutions send updates of model parameters to the central server after training a local copy of a diagnosis model on local data. The central server compiles the updates for the federated model and distributes the revised model parameters to all participating institutions for continued training or deployment. As can be observed through this process, patient privacy, confidentiality, and data-ownership concerns are significantly protected in the federated learning-driven system since raw image data is not shared. The federated learning-driven system implemented in this work uses the FederatedAveraging (FedAvg) algorithm (Fig. 2). FederatedAveraging Algorithm. The K institutions are indexed by k , B is the size of local minibatch b , E is the number of local epochs in each round of institution update, \eta is the learning rate, and \ell(\omega,b) is the local loss function. Central Server executes: • Initialize \omega_{0} • For each round t=1,2,\dots do – For each institution k=1,2,\dots,K in parallel do * \omega_{t+1}^{k}\leftarrow\text{InstitutionUpdate}(k,\omega_{t}) – \omega_{t+1}\leftarrow\sum_{k=1}^{K}\frac{n_{k}}{N}\omega_{t+1}^{k} InstitutionUpdate (k,\omega) : • For each local epoch i from 1 to E do – For each minibatch b do * \omega\leftarrow\omega-\eta\nabla\ell(\omega;b) • Return \omega to central server Figure 2 : FederatedAveraging Algorithm [ 8 ] The process begins with the central server initializing the model parameters \omega_{0} , which are then distributed to each participating institution. Training proceeds in multiple rounds, indexed by t . In each round, the central server sends the current global model \omega_{t} to all K institutions. Each institution k then executes the InstitutionUpdate process, wherein it trains the model locally using its data for E epochs. During each epoch, the model parameters \omega are updated using the SGD optimizer to minimize the local loss function \ell(\omega,b) for each minibatch b . After local training, institutions send their updated models \omega_{t+1}^{k} to a central server, which aggregates them into a new global model \omega_{t+1} by computing a weighted average based on the sizes of the local datasets n_{k} . This process repeats across multiple rounds t until model convergence. The FedAvg algorithm was implemented using TensorFlow Federated (TFF). II-A 2 Convolutional Neural Networks (CNNs) CNNs are a type of neural network, often utilized for image classification and computer vision. Local CNNs located at each medical institution serve as the basis for the federated learning-driven system. The four CNN architectures included in our study are EfficientNetB0, MobileNetV2, InceptionResnetV2, and Xception. These four CNN architectures were pre-trained on the ImageNet dataset which contains over 14 million labeled images. II-B Dataset Three publicly available datasets from different regions of the world were used to develop and evaluate our framework: the DDR dataset (12,256 fundus photos, China) [ 9 ] , the EyePACS dataset (11,673 fundus photos, California, USA) [ 10