A General Framework for Self-Supervised Denoising with Patch Aggregation
Huy Minh Nhat Nguyen, Triet Hoang Minh Dao, Chau Vinh Hoang Truong, Cuong Tuan Nguyen · 2025
Read A General Framework for Self-Supervised Denoising with Patch Aggregation by Huy Minh Nhat Nguyen, Triet Hoang Minh Dao, Chau Vinh Hoang Truong, Cuong Tuan Nguyen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16702.txt.
Introduction
Huy Minh Nhat Nguyen and three co-authors present SDPA plus plus, a self-supervised method for cleaning noisy eye scans. The scans come from optical coherence tomography, a non-invasive imaging method that shows detailed three-dimensional views of the retina. Clean training pairs are hard to collect because real scans carry speckle noise.
The method learns from noisy scans alone. It first builds cleaner target images by fusing and denoising the scans themselves. Those targets then train a group of denoising models that work patch by patch. The team checks image quality with contrast and texture measures. The goal is clearer retinal images for earlier and more accurate diagnosis of eye disease.
Catalog record
| CREATOR | Huy Minh Nhat Nguyen, Triet Hoang Minh Dao, Chau Vinh Hoang Truong, Cuong Tuan Nguyen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-16702
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A General Framework for Self-Supervised Denoising with Patch Aggregation Huy Minh Nhat Nguyen, Triet Hoang Minh Dao, Chau Vinh Hoang Truong, Cuong Tuan Nguyen Abstract Optical Coherence Tomography (OCT) is a widely used non-invasive imaging technique that provides detailed three-dimensional views of the retina, which are essential for the early and accurate diagnosis of ocular diseases. Consequently, OCT image analysis and processing have emerged as key research areas in biomedical imaging. However, acquiring paired datasets of clean and real-world noisy OCT images for supervised denoising models remains a formidable challenge due to intrinsic speckle noise and practical constraints in clinical imaging environments. To address these issues, we propose SDPA++: A General Framework for Self-Supervised Denoising with Patch Aggregation. Our novel approach leverages only noisy OCT images by first generating pseudo-ground-truth images through self-fusion and self-supervised denoising. These refined images then serve as targets to train an ensemble of denoising models using a patch-based strategy that effectively enhances image clarity. Performance improvements are validated via metrics such as Contrast-to-Noise Ratio (CNR), Mean Square Ratio (MSR), Texture Preservation (TP), and Edge Preservation (EP) on the real-world dataset from the IEEE SPS Video and Image Processing Cup. Notably, the VIP Cup dataset contains only real-world noisy OCT images without clean references, highlighting our method’s potential for improving image quality and diagnostic outcomes in clinical practice. I Introduction I- 1 Background Optical Coherence Tomography (OCT) is a pivotal imaging technology in ophthalmology, enabling detailed cross-sectional visualization of the retina. This technique is critical for diagnosing and managing conditions such as Age-related Macular Degeneration (AMD), Diabetic Retinopathy (DR), and Diabetic Macular Edema (DME). However, OCT images are frequently affected by speckle noise and other imaging artifacts, which complicate interpretation and may lead to inaccuracies in diagnosis. I- 2 Dataset Description The Signal Processing Society’s 2024 Video and Image Processing Cup (VIP Cup) [ 1 ] challenges participants to enhance OCT image quality using a dataset composed of noisy OCT B-scan images. These scans are divided into three classes: • Normal/healthy (42 subjects) • Diabetic patients with DME (30 subjects) • Non-diabetic patients with ocular diseases such as AMD, CNV, or Macular Hole (MH) Each subject has between 30 to 300 grayscale B-scan images at 300 \times 300 resolution. Combining images from all subjects yields about 18,000 noisy OCT scans for the denoising challenge. No clean “ground truth” scans are available, highlighting the need for self-supervised or unsupervised methods. I- 3 Motivation Traditional denoising algorithms such as non-local means [ 2 ] , wavelet-based techniques [ 3 ] , and median filtering [ 4 ] have been applied to enhance OCT image quality. While computationally straightforward, these conventional approaches often struggle to remove heavy speckle noise while preserving fine anatomical structures. Further, supervised learning-based algorithms typically require paired noisy and clean images, which are difficult to obtain in medical settings. To overcome this limitation, self-supervised and unsupervised strategies have garnered attention. Techniques like self-fusion [ 5 ] , Blind-Spot networks [ 6 ] , Noise2Noise [ 7 ] , Noise2Void [ 8 ] , and Noise2Self [ 9 ] aim to learn denoising directly from noisy data. However, simply applying blind-spot or neighbor-based methods to extremely noisy data can still yield suboptimal results, particularly if the noise level is high. I- 4 Contribution We propose a novel two-stage pipeline that creates a pseudo-clean reference from noisy images alone, then uses multiple self-supervised and supervised denoising models to refine the results further. Our main contributions are: (i) Self-fusion pre-processing: We exploit the 3D volume nature of OCT data by fusing neighboring B-scans to remove noise. (ii) Self-supervised refinement: We apply a neighbor-based self-supervised method to generate pseudo-ground-truth images without requiring any clean references. (iii) Patch-ensemble of multiple models: We train advanced denoising models (e.g., Restormer, NAFNet, CGNET and diffusion-based models) using pseudo-clean targets, then fuse their outputs via a patch-based ensemble to achieve superior denoising quality. Figure 1 illustrates an overview of our self-supervised and ensemble-based denoising framework for OCT images. II Related Works II-A Traditional Denoising Methods Conventional denoising techniques typically rely on mathematical/statistical modeling. Non-local means [ 2 ] identifies and averages similar patches across an image, effectively removing noise but sometimes blurring features if the patch similarity criteria are not carefully tuned. Wavelet thresholding [ 3 ] decomposes images into multiple scales/frequencies, selectively attenuating noise but risking loss of fine details when thresholding is severe. Median filtering [ 4 ] replaces each pixel’s intensity with the median in a local neighborhood, effectively removing outliers but often sacrificing edge sharpness. Although these methods are simple and interpretable, their performance can degrade significantly in OCT scans with heavy speckle noise or complex structures. II-B Supervised Denoising Methods Supervised deep learning approaches rely on paired noisy-clean datasets. U-Net [ 11 ] introduced skip connections to preserve high-resolution spatial information in medical image segmentation, and by extension, denoising. Restormer [ 12 ] uses a transformer-based architecture that captures long-range dependencies, improving restoration quality. NAFNet [ 13 ] refines network design to handle a wide range of image restoration tasks with fewer parameters. CascadedGaze (CGNet) [ 17 ] , an efficient encoder-decoder architecture with a novel Global Context Extractor that captures global information without self-attention. Though these methods are powerful, they presume the availability of clean reference images, which is often unrealistic in clinical OCT data acquisition. II-C Self-Supervised and Unsupervised Denoising Methods In the absence of clean references, self-supervised paradigms remove the need for paired data. Blind-spot methods—Noise2Void [ 8 ] and Noise2Self [ 9 ] —mask input pixels and train the network to predict them from surrounding context, preventing identity shortcuts and forgoing ground truth. Noise2Noise [ 7 ] instead learns from paired noisy realizations of the same scene, while Neighbor2Neighbor [ 10 ] relaxes this further by pairing randomly subsampled patches within a single image volume. Self-fusion [ 5 ] aggregates adjacent slices/frames to form a cleaner proxy. Blind2Unblind [ 14 ] and AP-BSN [ 15 ] refine blind-spot training and account for spatially correlated noise. Generative approaches based on Denoising Diffusion Probabilistic Models (DDPMs) [ 16 ] learn a reverse noising process, enabling flexible modeling of complex noise distributions for high-quality restoration. quality restoration. III Methodology Our denoising framework consists of two main phases (see Fig. 1 ). In Phase 1 , we generate pseudo-clean images from the original noisy dataset using two steps: self-fusion and self-supervised denoising. In Phase 2 , these pseudo-clean outputs become the training targets for multiple denoising models, whose results are then combined via patch-based ensemble. Fig. 1: Overview of proposed denoising method III-A Phase 1: Self-Fusion and Self-Supervised Refinement Self-Fusion Preprocessing. For each B-scan B_{i} in an OCT volume, we collect its six nearest neighboring B-scans B_{i-3},\dots,B_{i+3} (excluding B_{i} itself). We register them to B_{i} if necessary (some volumes might be pre-aligned) and calculate a weighted fusion: \tilde{B}_{i}(x,y)=\sum_{j=i-3}^{i+3}w_{j}(x,y)\cdot B_{j}(x,y), where w_{j}(x,y) is proportional to the patch similarity between B_{j} and B_{i} . This produces an intermediate self-fused image that reduces random speckle noise. Neighbor2Neighbor. Next, we apply the neighbor-based self-supervised training scheme proposed in [ 10 ] to refine \tilde{B}_{i} . By sampling random patches within \tilde{B}_{i} to form noisy pairs, the network learns to predict one patch from