XOCT: Enhancing OCT to OCTA Translation via Cross-Dimensional Supervised Multi-Scale Feature Learning

Pooya Khosravi * †, Kun Han *, Anthony T. Wu, Arghavan Rezvani, Zexin Feng, Xiaohui Xie · 2025

Read XOCT: Enhancing OCT to OCTA Translation via Cross-Dimensional Supervised Multi-Scale Feature Learning by Pooya Khosravi * †, Kun Han *, Anthony T. Wu, Arghavan Rezvani, Zexin Feng, Xiaohui Xie (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07455.txt.

Introduction

Detailed images of retinal blood vessels help doctors diagnose eye disease early, but the best imaging method is costly and motion-sensitive. Pooya Khosravi and 5 co-authors present XOCT in a 2025 research paper. XOCT is a deep learning system that translates ordinary retinal scans into angiography-style images, which show blood flow vessel by vessel. Earlier translators often blurred the fine, dense vessel details doctors need.

The system learns from layer-by-layer projections of the retina, so each layer gets its own supervision signal. A multi-scale fusion module then rebuilds vessels at several sizes at once. On a public dataset of five hundred eyes, XOCT improved the translated projections most used in clinical review. Better translation could widen access to vessel imaging on cheaper, common scanners.

Catalog record

CREATORPooya Khosravi * †, Kun Han *, Anthony T. Wu, Arghavan Rezvani, Zexin Feng, Xiaohui Xie
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-07455

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

XOCT: Enhancing OCT to OCTA Translation via Cross-Dimensional Supervised Multi-Scale Feature Learning Pooya Khosravi * †, Kun Han *, Anthony T. Wu, Arghavan Rezvani, Zexin Feng, Xiaohui Xie Abstract Optical Coherence Tomography Angiography (OCTA) and its derived en-face projections provide high-resolution visualization of the retinal and choroidal vasculature, which is critical for the rapid and accurate diagnosis of retinal diseases. However, acquiring high-quality OCTA images is challenging due to motion sensitivity and the high costs associated with software modifications for conventional OCT devices. Moreover, current deep learning methods for OCT-to-OCTA translation often overlook the vascular differences across retinal layers and struggle to reconstruct the intricate, dense vascular details necessary for reliable diagnosis. To overcome these limitations, we propose XOCT, a novel deep learning framework that integrates Cross-Dimensional Supervision (CDS) with a Multi-Scale Feature Fusion (MSFF) network for layer-aware vascular reconstruction. Our CDS module leverages 2D layer-wise en-face projections, generated via segmentation-weighted z-axis averaging, as supervisory signals to compel the network to learn distinct representations for each retinal layer through fine-grained, targeted guidance. Meanwhile, the MSFF module enhances vessel delineation through multi-scale feature extraction combined with a channel reweighting strategy, effectively capturing vascular details at multiple spatial scales. Our experiments on the OCTA-500 dataset demonstrate XOCT’s improvements, especially for the en-face projections which are significant for clinical evaluation of retinal pathologies, underscoring its potential to enhance OCTA accessibility, reliability, and diagnostic value for ophthalmic disease detection and monitoring. The code is available at https://github.com/uci-cbcl/XOCT. † † footnotetext: * These authors contributed equally to this work. † † footnotetext: † Corresponding author. 1 Introduction Optical Coherence Tomography Angiography (OCTA) has transformed retinal imaging by enabling high-resolution, dye-free visualization of retinal and choroidal microvasculature. The en-face OCTA projections shown in Fig. 1 , provide intuitive, top-down views of the vascular network, facilitating rapid assessment of retinal pathologies. This non-invasive modality is crucial for early detection and monitoring of conditions such as diabetic retinopathy, age-related macular degeneration (AMD), and glaucoma [ 12 ] . However, acquiring high-quality OCTA images remains challenging due to motion artifacts and the high costs of software modifications required for OCTA-enabled devices [ 7 , 4 , 23 , 1 ] . Figure 1: OCT/OCTA volumes with retinal layer segmentation and en-face projections. The differences between \text{Proj}_{\text{ILM-OPL}} and \text{Proj}_{\text{OPL-BM}} highlight heterogeneous imaging properties due to different cellular and vascular distributions across retinal layers. Recent deep learning–based OCT-to-OCTA translation methods show promise but face key limitations for clinical adoption. 2D B-scan-based approaches [ 13 , 26 , 16 , 19 , 10 , 20 ] fail to preserve 3D vascular continuity, leading to fragmented reconstructions that compromise network integrity. Projection-based methods [ 21 ] reduce volumetric data to a single 2D plane (Fig. 1 ), obscuring fine vascular details and reducing angiogram fidelity. Meanwhile, 3D-based models [ 8 , 17 ] rely on conventional feature extraction, failing to leverage layer-specific retinal properties needed to capture subtle microvascular structures for clinical interpretation. To address these challenges, we propose XOCT , a novel framework that combines 2D and 3D insights to preserve fine vascular details across heterogeneous retinal layers. XOCT integrates two key components: Cross-Dimensional Supervision ( CDS ) and a Multi-Scale Feature Fusion ( MSFF ) network. The CDS module leverages the heterogeneous imaging properties of retinal layers by integrating volumetric and layer-wise constraints. As shown in Fig. 1 , variations in tissue composition and vascular distribution cause each layer to interact differently with light, producing unique structural patterns [ 2 ] . CDS generates 2D en-face projections via segmentation-weighted z-axis averaging, aligning them with ground-truth maps using a composite loss: L_{1} loss for pixel-wise accuracy, adversarial loss for anatomical realism, and perceptual loss [ 11 ] for high-level structural fidelity. By providing fine-grained, layer-specific supervision, CDS encourages the network to learn distinct feature representations for each retinal layer, enforcing intra-layer consistency, preserving vessel coherence, and capturing subtle microvascular details that conventional methods often miss. The MSFF module is designed to refine vessel delineation by capturing vascular details across multiple spatial scales. Recognizing that OCTA images feature extremely thin and intricate vascular structures, MSFF employs a combination of isotropic kernels for balanced local feature extraction and anisotropic kernels tailored to detect the elongated patterns of retinal vessels. Additionally, depth-wise large-kernel convolutions are incorporated to broaden the receptive field, ensuring that global vessel connectivity is effectively captured. To optimize computational efficiency, the output channels of each convolutional block are halved, and the resulting multi-scale features are subsequently fused via point-wise convolution coupled with a channel reweighting mechanism. This adaptive fusion process emphasizes critical vascular details, thereby enhancing the overall fidelity of OCT-to-OCTA translation by preserving both fine local structures and the broader vascular network. The main contributions of our work are: (1) XOCT , a deep learning framework that integrates CDS and MSFF for OCT-to-OCTA translation. (2) CDS , the first method to incorporate retinal layer characteristics during training, preserving vessel coherence and structural integrity. (3) MSFF , an efficient module that enhances fine vascular detail capture via multi-scale feature fusion. (4) Extensive evaluation on the OCTA-500 dataset [ 15 ] , demonstrating superior vascular clarity, continuity, and translation performance in both 3D OCTA volumes and layer-wise en-face projections with direct clinical relevance. 2 Related Works 2D B-scan-Based Approaches : Early OCT-to-OCTA translation methods focused on individual 2D B-scans. Lee et al. [ 13 ] proposed an encoder-decoder-based framework for mapping paired OCT B-scans to OCTA images. Zhang et al. [ 26 ] improved vascular detail preservation with texture-guided down-sampling, while Li et al. [ 16 ] incorporated adversarial loss to enhance image fidelity. Despite these advancements, the lack of volumetric modeling limited their ability to accurately reconstruct retinal vasculature. Projection-Based Approaches : These methods convert OCT and OCTA volumes into 2D en face representations before translation. Pan et al. [ 21 ] proposed MultiGAN, an unsupervised multi-domain framework that generated OCTA projection maps from OCT projections, enforcing anatomical consistency through domain-specific loss functions. However, the projection process inherently discards depth information, leading to the loss of fine vascular structures. 3D-Based Approaches : Recent studies have adopted volumetric OCT-to-OCTA translation to address 2D-based limitations. Huang et al. [ 8 ] introduced a patch-based 3D model with a context-enhanced encoder, while Li et al. [ 17 ] developed TransPro, a 3D Pix2Pix framework refined via supervision from pretrained 2D models. However, these methods overlook retinal layer-specific imaging characteristics and depend on standard convolutional operations, which struggle to capture intricate vessel structures present in OCTA images. Figure 2: Overview of XOCT. 3 Methods We propose XOCT (Fig. 2 ), a novel deep learning framework for OCT-to-OCTA translation that builds on a 3D encoder-decoder architecture enhanced by two key components: Cross-Dimensional Supervision (CDS) and a Multi-Scale Feature Fusion (MSFF) module. XOCT accepts a volumetric OCT scan \mathbf{X}\in\mathbb{R}^{D\times H\times W} as input and outputs a reconstructed OCTA volume \widehat{\mathbf{Y}}\in\mathbb{R}^{D\times H\times W} . We then implement an end-to-end training with a composite loss function combining volumetric and projection-based objectives to ensure both global structural consistency and precise vessel delineation. 3.1 Cross-Dimensional Supervision Conventional volumetric supervision treats the OCTA volume as homogeneous, overlooking the retina’s intrinsic heterogeneity. In reality, the retina consists of multiple layers, each with distinct tissue

Read the complete text