Zero-shot denoising via neural compression: Theoretical and algorithmic framework
Ali Zafari, Xi Chen, Shirin Jalali · 2025
Read Zero-shot denoising via neural compression: Theoretical and algorithmic framework by Ali Zafari, Xi Chen, Shirin Jalali (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-12693.txt.
Introduction
Ali Zafari, Xi Chen, and Shirin Jalali wrote a 2025 paper on cleaning noise from images when no training data exist. Many denoisers learn from thousands of clean examples, which fields like medical imaging cannot supply. Their method learns from the single noisy image itself, using a neural compression network that is trained on that image's own patches.
Compression networks resist overfitting by their design, so no early stopping or hand tuning is needed. The cleaned image is assembled from overlapping patch outputs. Tests showed top results among zero-shot methods for two common noise types, on both photos and scientific images. The team also prove bounds on the error such a method can reach.
Catalog record
| CREATOR | Ali Zafari, Xi Chen, Shirin Jalali |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 107 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-12693
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Zero-shot denoising via neural compression: Theoretical and algorithmic framework Ali Zafari, Xi Chen, Shirin Jalali Abstract Zero-shot denoising aims to denoise observations without access to training samples or clean reference images. This setting is particularly relevant in practical imaging scenarios involving specialized domains such as medical imaging or biology. In this work, we propose the Zero-Shot Neural Compression Denoiser (ZS-NCD), a novel denoising framework based on neural compression. ZS-NCD treats a neural compression network as an untrained model, optimized directly on patches extracted from a single noisy image. The final reconstruction is then obtained by aggregating the outputs of the trained model over overlapping patches. Thanks to the built-in entropy constraints of compression architectures, our method naturally avoids overfitting and does not require manual regularization or early stopping. Through extensive experiments, we show that ZS-NCD achieves state-of-the-art performance among zero-shot denoisers for both Gaussian and Poisson noise, and generalizes well to both natural and non-natural images. Additionally, we provide new finite-sample theoretical results that characterize upper bounds on the achievable reconstruction error of general maximum-likelihood compression-based denoisers. These results further establish the theoretical foundations of compression-based denoising. Our code is available at: https://github.com/Computational-Imaging-RU/ZS-NCDenoiser . 1 Introduction Background and motivation Denoising is a fundamental problem in classical signal processing and has recently gained renewed attention from the machine learning community. Let {\bm{x}}=(x_{1},\ldots,x_{n})\in\R_{+}^{n} denote a non-negative signal of length n , where signal {\bm{x}} is not observable in many systems. Instead, we observe a noisy version {\bm{y}}=(y_{1},\ldots,y_{n}) , where the observations are conditionally independent given {\bm{x}} , and each entry is distributed according to a common conditional distribution: \textstyle{\bm{y}}\sim\prod_{i=1}^{n}p(y_{i}\mid x_{i}). We assume that the noise mechanism is memoryless (independent across coordinates) and homogeneous (identical across entries). The goal of a denoising algorithm is to estimate {\bm{x}} from the noisy observations {\bm{y}} . Given its prevalence in imaging and data acquisition systems, denoising has been a central topic in signal processing for decades. Classical denoising methods rely on explicit structural assumptions about the underlying signal {\bm{x}} , often hand-crafted by domain experts [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 ] . In contrast, recent advances in machine learning have enabled a new class of data-driven denoising algorithms. These methods learn the optimal denoising function from data, leveraging statistical patterns directly from signal and noise distributions. While learning-based approaches achieve state-of-the-art performance and often outperform classical methods in controlled settings, they face significant challenges in practice: 1. Supervision requirement: Most learning-based methods require training set of paired samples \{({\bm{y}}_{i},{\bm{x}}_{i})\}_{i=1}^{m} , where {\bm{x}}_{i} is clean signal and {\bm{y}}_{i} is its noisy counterpart. In practical scenarios such as medical imaging, \{{\bm{x}}_{i}\}_{i=1}^{m} are unavailable or prohibitively expensive to obtain. 2. Data efficiency: These methods usually need lots of training data. Acquiring sufficient samples is difficult or costly, particularly in domains with strict data acquisition constraints. To mitigate the reliance on paired clean and noisy samples, several self-supervised denoising methods have been developed that learn directly from noisy observations, without access to clean ground truth signals [ 9 , 10 , 11 , 12 , 13 ] . While these approaches alleviate the supervision requirement, they typically depend on access to large collections of noisy data and often yield suboptimal performance compared to methods trained with clean targets. Moreover, the absence of clean supervision necessitates the use of complex neural architectures and training schemes, which can make these methods computationally demanding and difficult to optimize in practice. These challenges have sparked growing interest in zero-shot denoisers , which aim to recover clean signals from noisy observations without access to paired data or extensive noisy training data. Such methods are particularly appealing in domains where acquiring clean data is infeasible, and they offer the potential for deployable denoisers that adapt to individual inputs with general purpose. Figure 1 : Zero-Shot Neural Compression Denoiser (ZS-NCD). Learning phase: a neural compression model (architecture shown in Fig. 5 of the supplementary material) is trained on overlapping patches extracted from a single noisy image. Denoising phase: each pixel is reconstructed by averaging predictions across neighboring patches processed by the trained model. From neural compression to zero-shot denoising Denoising algorithms—ranging from classical signal processing techniques to deep learning methods—fundamentally rely on the assumption that real-world signals are highly structured. Compression-based denoising leverages this same principle, but rather than directly solving the inverse problem, it instead performs lossy compression on the noisy observation {\bm{y}} , under the hypothesis that the clean signal {\bm{x}} lies in a lower-complexity subspace and is therefore more compressible. In lossy compression, the goal is to represent signals from a target class using discrete encodings with minimal distortion. When applied to noisy data, the intuition is that a lossy compressor—operating at a distortion level matched to the noise—will favor reconstructions close to the original clean signal. While this approach has a strong theoretical foundation [ 14 , 15 ] , classical compression-based denoisers have shown limited empirical success, particularly for natural image denoising. In this work, we revisit this idea in light of recent progress in neural compression , where learned encoders and decoders have demonstrated strong rate-distortion performance across a variety of image domains [ 16 , 17 ] . Building on this foundation, we propose a zero-shot denoising method that we call the Zero-Shot Neural Compression Denoiser (ZS-NCD) . Unlike traditional neural compression models that are trained on large corpora of clean high-resolution images, ZS-NCD learns directly from a single noisy input image. Specifically, we extract overlapping patches from the noisy image, and train a neural compression network on those patches alone—without any clean supervision or prior dataset. Once trained, the denoiser is applied to all patches from the same image, and the final output is obtained by averaging the predictions in overlapping regions. This approach is illustrated in Figure 1 . Despite relying solely on the noisy input and operating without supervision, ZS-NCD achieves state-of-the-art performance among zero-shot denoising methods across diverse noise models, and remains robust even on inputs that lie outside the natural image distribution. We compare it against the baselines in Figure 2 , ZS-NCD shows superior performance in denoising and training stability. Figure 2 : Zero-shot denoising of Kodim05 with AWGN ( \sigma=25 ). Left : PSNR versus training iterations for zero-shot denoisers. Performance of BM3D [ 18 ] and Restormer [ 19 ] are included as a classical baseline and as a supervised empirical upper bound, respectively. Right : Visual reconstructions with PSNR/SSIM above each image. Compression-based denoising based on JPEG-2K [ 20 ] achieves inferior performance. Learning-based zero-shot denoisers often struggle with either overfitting or high bias. DIP [ 21 ] and DD [ 22 ] require early stopping to avoid overfitting. ZS-N2S [ 12 ] and S2S [ 23 ] struggle with high-resolution color images, and ZS-N2N [ 24 ] often produces noisy outputs with potential overfitting. BM3D tends to oversmooth the denoised image. In contrast, ZS-NCD avoids these issues. Paper contributions This paper introduces a zero-shot image denoising framework based on neural compression. Our main contributions are: \bullet A zero-shot denoising algorithm using neural compression. We propose a fully unsupervised method that trains a neural compression network on image patches of