Domain Adaptive Diabetic Retinopathy Grading with Model Absence and Flowing Data

Wenxin Su, Song Tang, Xiaofeng Liu, Xiaojing Yi, Mao Ye, Chunxiao Zu, Jiahao Li, Xiatian Zhu · 2024

Read Domain Adaptive Diabetic Retinopathy Grading with Model Absence and Flowing Data by Wenxin Su, Song Tang, Xiaofeng Liu, Xiaojing Yi, Mao Ye, Chunxiao Zu, Jiahao Li, Xiatian Zhu (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01203.txt.

Introduction

Wenxin Su and co-authors address a hard setting for grading diabetic eye disease from retinal images. In their 2024 paper, the grading model itself is absent and new images arrive as a stream. Standard transfer methods center on the model and can leak private source data or invite attacks. Their method, called GUES, adapts from the data side instead.

The idea reworks how small input changes are computed: a generator learns to produce them, built with a variational autoencoder. Saliency maps, which highlight likely lesions, serve as stand-in labels for those changes. Tests on standard eye-disease benchmarks beat rival methods, even with tiny batches. The approach held up with both frozen and trainable models.

Catalog record

CREATORWenxin Su, Song Tang, Xiaofeng Liu, Xiaojing Yi, Mao Ye, Chunxiao Zu, Jiahao Li, Xiatian Zhu
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-01203

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Domain Adaptive Diabetic Retinopathy Grading with Model Absence and Flowing Data Wenxin Su, Song Tang, Xiaofeng Liu, Xiaojing Yi, Mao Ye, Chunxiao Zu, Jiahao Li, Xiatian Zhu Abstract Domain shift (the difference between source and target domains) poses a significant challenge in clinical applications, e.g., Diabetic Retinopathy (DR) grading. Despite considering certain clinical requirements, like source data privacy, conventional transfer methods are predominantly model-centered and often struggle to prevent model-targeted attacks. In this paper, we address a challenging O nline M odel-a G nostic D omain A daptation ( OMG-DA ) setting, driven by the demands of clinical environments. This setting is characterized by the absence of the model and the flow of target data. To tackle the new challenge, we propose a novel approach, G enerative U nadversarial E xample S ( GUES ), which enables adaptation from a data-centric perspective. Specifically, we first theoretically reformulate conventional perturbation optimization in a generative way—learning a perturbation generation function with a latent input variable. During model instantiation, we leverage a Variational AutoEncoder to express this function. The encoder with the reparameterization trick predicts the latent input, whilst the decoder is responsible for the generation. Furthermore, the saliency map is selected as pseudo-perturbation labels. Because it not only captures potential lesions but also theoretically provides an upper bound on the function input, enabling the identification of the latent variable. Extensive comparative experiments on DR benchmarks with both frozen pre-trained models and trainable models demonstrate the superiority of GUES, showing robustness even with small batch size. 1 Introduction Diabetic Retinopathy (DR) is a significant health concern, ranking among the leading causes of blindness and affecting millions of people worldwide [ 3 ] . Early-stage intervention for DR is crucial to preserve vision, highlighting the importance of timely diagnosis [ 27 ] . Although deep learning (DL) has demonstrated promising results in automating the grading of DR [ 37 , 8 , 6 ] , deploying DL models in real-world clinical settings remains challenging. For example, DL models often struggle to generalize effectively to complex scenarios, such as variations in imaging equipment, ethnic groups, or temporal factors, leading to different data distributions, a challenge known as domain shift [ 11 ] . This issue significantly hampers the widespread adoption and success of DL-based diagnostic tools in clinical practice [ 14 ] . Figure 1 : Comparison between the OMG-DA and SFDA settings. (a) In SFDA, adaptation builds upon the accumulated data, which demands significant storage resources in the hospital. Additionally, the models’ architecture and parameters are accessible, exposing them to potential attacks. (b) OMG-DA provides a practical scenario: Flowing data mimic the patients’ arrival in a stream way, and the models are unseen (strictly controlled) before using them, avoiding attacks like membership inference attacks [ 26 ] . Table 1 : Comparison between different transfer settings. Notation: source (s), target (t), data \boldsymbol{x} , label \boldsymbol{y} , loss function {L}\left(\cdot\right) . Setting name Model availability Data flow Source data privacy Source data Target data Train loss Test loss Fine-tuning (FT) ✗ ✗ ✓ – \boldsymbol{x}_{t},\boldsymbol{y}_{t} {L}\left(\boldsymbol{x}_{t},\boldsymbol{y}_{t}\right) – Domain generalization (DG) ✗ ✓ ✗ \boldsymbol{x}_{s},\boldsymbol{y}_{s} - {L}\left(\boldsymbol{x}_{s},\boldsymbol{y}_{s}\right) - Unsupervised domain adaptation (UDA) ✗ ✗ ✗ \boldsymbol{x}_{s} , \boldsymbol{y}_{s} \boldsymbol{x}_{t} {L}\left(\boldsymbol{x}_{s},\boldsymbol{y}_{s}\right)+{L}\left(\boldsymbol{x}_{t}\right) – Source-free domain adaptation (SFDA) ✗ ✗ ✓ – \boldsymbol{x}_{t} {L}\left(\boldsymbol{x}_{t}\right) – Test-time adaptation (TTA) ✗ ✓ ✓ – \boldsymbol{x}_{t} – {L}\left(\boldsymbol{x}_{t}\right) Online model-agnostic domain adaptation (OMG-DA) ✓ ✓ ✓ – \boldsymbol{x}_{t} – – Recently, many adaptation methods for grading diabetic retinopathy (DR) have focused on addressing the issue of domain shift [ 41 , 20 , 23 , 5 ] . The initial focus on classic transfer learning strategies, including Unsupervised Domain Adaptation (UDA) [ 20 ] and Domain Generalization (DG) [ 5 , 4 ] , necessitated the availability of well-annotated source data. Nevertheless, the growing emphasis on privacy protection has shifted research toward the Source-Free Domain Adaptation (SFDA) framework [ 23 , 41 ] . SFDA involves adapting a source model—pre-trained on the source domain—to the target domain in a self-supervised manner, thereby ensuring the protection of source patient data. In recent developments, specific needs have emerged in the clinical field. The introduction of model weight-based techniques for reconstructing training data has created a demand for model privacy [ 40 , 26 ] , which goes beyond traditional source data protection. In addition, there is a growing requirement for models capable of handling incoming patient data in a flowing fashion, referred to as a flowing data constraint [ 33 , 35 ] . Unfortunately, existing SFDA methods cannot effectively address this challenge, as they rely on full access to the model and require offline training on a pre-collected dataset. Fig. 1 provides an intuitive illustration of this issue. In this paper, we consider a clinically motivated setting, called O nline M odel-a G nostic D omain A daptation ( OMG-DA ) and propose a novel G enerative U nadversarial E xample S ( GUES ) approach for the DR grading problem in this new setting. Specifically, OMG-DA presents an extreme safety scenario: The available target data is unlabeled and arrives in a flowing format, with no prior information about the pre-trained source model and data. Tab. 1 provides a detailed comparison with previous adaptation settings. In GUES, we address the absence of source data and pre-trained models by producing generalized unadversarial examples [ 24 ] for unlabeled target data. To this end, we introduce generative unadversarial learning, which theoretically reformulates conventional iterative perturbation optimization. This new method aims to learn a generative function for perturbations and involves addressing two key tasks: (1) Identifying the latent function input, which is the derivative of initial random noise w.r.t. image data, and (2) selecting a self-supervised property to serve as pseudo-perturbation labels. In practice, we leverage a Variational Autoencoder (VAE) [ 10 ] based approach to facilitate this learning process. In terms of function representation, we model the latent input using the encoder along with the reparameterization trick, whilst the decoder accomplishes the generation of individual-perturbation. Additionally, we choose the saliency map as the pseudo-perturbation label for two reasons: (1) It helps discover potential lesions, and (2) it aids in identifying the latent input by providing an upper bound. Our contributions are summarized as follows: • Pioneering a novel transfer setting OMG-DA, which is closer to real-world clinical scenarios and meets three typical requirements at the same time, including (1) model absence, (2) flowing data, and (3) source data privacy. • Developing a new OMG-DA approach GUES in the context of DR grading, grounded on the generative unadversarial examples theory, where we learn an individual-perturbation generative function under saliency map supervision, removing relying on labels and models. • Extensive evaluations on four DR benchmarks, indicating that GUES can largely promote the source model’s performance in the target domain, as well as trainable test-time adaptation models, even at small batch size. 2 Related work Adaptation methods for DR grading. Driven by real-world medical requirements, domain adaptation has been an attractive topic in this DR grading issue. For instance, Nguyen et al. [ 20 ] introduce a UDA approach that enables the model to focus on vessel structures that remain invariant to domain shifts via image reconstruction

Read the complete text