GrInAdapt: Scaling Retinal Vessel Structural Map Segmentation Through Grounding, Integrating and Adapting Multi-device, Multi-site, and Multi-modal Fundus Domains

Zixuan Liu *, Aaron Honjaya *, Yuekai Xu *, Yi Zhang, Hefu Pan, Xin Wang, Linda G. Shapiro, Sheng Wang, Ruikang K. Wang · 2025

Read GrInAdapt: Scaling Retinal Vessel Structural Map Segmentation Through Grounding, Integrating and Adapting Multi-device, Multi-site, and Multi-modal Fundus Domains by Zixuan Liu *, Aaron Honjaya *, Yuekai Xu *, Yi Zhang, Hefu Pan, Xin Wang, Linda G. Shapiro, Sheng Wang, Ruikang K. Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-05991.txt.

Introduction

Zixuan Liu and a team of co-authors present GrInAdapt, a method to map blood vessels in images of the eye. Their twenty twenty-five paper deals with scans of the fundus, the back of the eye, taken by a method called OCTA. Vessel maps help doctors spot eye disease, but models trained in one clinic often fail on scans from other devices or sites.

GrInAdapt works in three steps. It grounds all images in one shared space, merges guesses from many views into agreed labels, and adapts the model to each new domain, with no labeled target data. It can also borrow cues from color photos of the fundus. Tests across devices and sites beat past methods.

Catalog record

CREATORZixuan Liu *, Aaron Honjaya *, Yuekai Xu *, Yi Zhang, Hefu Pan, Xin Wang, Linda G. Shapiro, Sheng Wang, Ruikang K. Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE178 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-05991

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GrInAdapt: Scaling Retinal Vessel Structural Map Segmentation Through Grounding, Integrating and Adapting Multi-device, Multi-site, and Multi-modal Fundus Domains Zixuan Liu *, Aaron Honjaya *, Yuekai Xu *, Yi Zhang, Hefu Pan, Xin Wang, Linda G. Shapiro, Sheng Wang, Ruikang K. Wang Abstract Retinal vessel segmentation is critical for diagnosing ocular conditions, yet current deep learning methods are limited by modality-specific challenges and significant distribution shifts across imaging devices, resolutions, and anatomical regions. In this paper, we propose GrInAdapt, a novel framework for source-free multi-target domain adaptation that leverages multi-view images to refine segmentation labels and enhance model generalizability for optical coherence tomography angiography (OCTA) of the fundus of the eye. GrInAdapt follows an intuitive three-step approach: (i) grounding images to a common anchor space via registration, (ii) integrating predictions from multiple views to achieve improved label consensus, and (iii) adapting the source model to diverse target domains. Furthermore, GrInAdapt is flexible enough to incorporate auxiliary modalities—such as color fundus photography—to provide complementary cues for robust vessel segmentation. Extensive experiments on a multi-device, multi-site, and multi-modal retinal dataset demonstrate that GrInAdapt significantly outperforms existing domain adaptation methods, achieving higher segmentation accuracy and robustness across multiple domains. These results highlight the potential of GrInAdapt to advance automated retinal vessel analysis and support robust clinical decision-making. * * footnotetext: Equal contribution. 1 Introduction Figure 1: Overview of GrInAdapt. a . Paired en face images from different domains. b . Predicted vessel masks used for registration. c . Prediction from souce models used for integration. d . Three regions on retina - macula, optic disc and other. e . Different predictions are integrated based on the region. f . Refined integrated labels for adapatation. g . Adaptation process with student-teacher and adaptive label merging. Retinal vessel segmentation [ 10 ] and quantification [ 17 ] are critical for early diagnosis and management of ocular diseases such as retinal vascular changes [ 3 ] and diabetic retinopathy [ 28 ] . Accurate delineation of arteries and veins [ 18 ] facilitates disease detection and monitoring of disease progression [ 6 ] . Various imaging modalities—including color fundus photography (CFP) [ 31 ] , and optical coherence tomography angiography (OCTA) [ 18 ] —offer complementary views of the retinal vasculature [ 5 ] . However, each modality has inherent trade-offs: CFP provides a wide field-of-view but often misses fine capillary details, while OCTA delivers high-resolution, three-dimensional information at the cost of being more sensitive to noise and artifacts. Despite advances in deep learning for segmenting major vessels from CFP [ 31 , 26 ] and extracting fine-grained capillary structures from OCTA [ 12 ] , current methods remain limited by two factors. First, single-modality approaches are constrained by modality-specific shortcomings—for example, CFP’s limited sensitivity to capillaries and OCTA’s vulnerability to imaging artifacts [ 8 , 13 ] . Second, models trained on a single source domain struggle to generalize to new devices, fields-of-view, and clinical settings, leading to performance degradation due to distribution shifts [ 9 , 16 ] . While prior work has explored domain adaptation [ 27 , 4 , 15 ] and multi-modal integration [ 19 , 30 , 20 ] , these approaches typically address non-vessel structure, low-resource, or single-domain scenarios [ 1 , 23 ] . In this work, we go one step forward to explore a higher-resource but more ambitious setting: how to widely generalize a source model to multiple target domains through a dataset with multi-view images from each target domain. We propose a powerful framework, GrInAdapt, with the key idea to leverage multi-view images to obtain better labels and refine the model across multiple target domains. Specifically, GrInAdapt follows an intuitive three-step approach: first, all images are grounded to an anchor space through registration; second, the labels are refined by integrating predictions from multiple views; and finally, the model is adapted to the target domains. GrInAdapt is simple and robust—even a basic registration applied to imperfect vessel mask predictions can be effective. It demonstrates superiority in achieving label consensus and reducing noise caused by imaging artifacts and low imaging quality. Moreover, GrInAdapt is flexible: it can be easily equipped with ensemble learning and extended to a multi-modal, multi-view setting to further reinforce label robustness via auxiliary modalities. Extensive experiments on the AI-READI dataset [ 1 ] with multi-device, multi-site, and multi-modal retinal images demonstrate that GrInAdapt consistently improves the source model by on average a 4% Dice score increase and a 0.42 ASSD reduction Ablation studies confirm that each component of our three-step approach—registration, label integration, and adaptation—are robust and contributes significantly to the observed performance improvements. Further evaluations reveal robust generalization across sites, unseen locations, and different resolutions, with quantitative gains of 4% and 4.6% in Dice score. These findings underscore GrInAdapt’s potential to enhance automated retinal analysis. 2 Preliminaries of Multi-target Domain Adaptation Although the setting described here applies to various medical imaging modalities, in this work we focus on fundus OCTA and CAVF segmentation - Capillaries, Artery, Vein and Foveal avascular zone (FAZ) [ 18 ] . Let \mathcal{S}=\{(x^{s}_{i},y^{s}_{i})\}_{i=1}^{N_{s}} denote the C-class segmentation labeled source domain, and let there be M unlabeled target domains \mathbf{T}^{M}=\{\mathcal{T}_{j}\}_{j=1}^{M}, where each \mathcal{T}_{j} is defined as \mathcal{T}_{j}=\{x^{t_{j}}_{i}\}_{i=1}^{N_{t_{j}}} . In the source-free adaptation setting, only the pre-trained source model f_{\theta_{S}} is available during adaptation. The objective of multi-target domain adaptation (MDA) is to adapt f_{\theta_{S}}:\mathcal{X}\rightarrow\mathcal{Y} so that it performs well across all target domains \{\mathcal{T}_{j}\}^{M}_{j=1} . Adapting to multiple target domains is more challenging because the distribution shift is larger and more diverse. For example, in OCTA imaging, when taking macula-centered 6\times 6 scans from certain device as the source domain, target domain shifts can arise from several factors (Fig. 1 a): imaging quality shift (different devices, D1-D3), location shift (D4), resolution shift (D5), and possible shift caused by the variance of clinicians’ skill across different sites. Subject-level multi-target image pair assumption. Previous DA methods usually focus on a single domain. A naive baseline for MDA is thus to simply treat \mathbf{T}^{M} as a larger single target domain [ 9 , 16 ] . However, downgrading adaptation performance is expected as the number and diversity of target domains increase. We thus relax data availability, allowing subject-level data pairs across multiple domains, e.g., an eye being imaged from multiple devices, resolutions, and locations. Specifically, given a subject set \{s_{k}\}^{V}_{k=1} , for each subject s_{k} , an image is acquired in every target domain j , i.e., \{x^{t_{j}}_{s_{k}}\}_{j=1}^{M},x^{t_{j}}_{s_{k}}\in\mathcal{T}_{j}. This cross-target paired information is essential for aligning representations across domains and mitigating the effects of the aforementioned shifts. Optionally, paired data from auxiliary modalities \mathcal{A} such as color fundus photography (CFP) can also be incorporated (D6, Fig. 1 a). We assume that \forall s_{k}\in V , paired data z_{s_{k}}\in\mathcal{A} and a source-free model f_{\theta_{A}}:\mathcal{Z}\rightarrow\mathcal{W} that can generate a C_{W} -class auxiliary segmentation label w\in\mathcal{W} are available. Here, the primary and auxiliary label space \mathcal{Y} and \mathcal{W} share common semantic classes, i.e., \mathcal{Y}\cap\mathcal{W}\supseteq\{\text{Artery, Vein}\} , allowing the auxiliary information to provide complementary cues for predicting the primary segmentation label y\in\mathcal{Y} . 3 GrInAdapt: Grounding, Integrating and Adapting multiple domains In this section, we introduce GrInAdapt, our framework designed to robustly generalize a pre-trained source model

Read the complete text