A Simple Combination of Diffusion Models for Better Quality Trade-Offs in Image Denoising
Jonas Dornbusch, Emanuel Pfarr, Florin-Alexandru Vasluianu, Frank Werner, Radu Timofte · 2025
Read A Simple Combination of Diffusion Models for Better Quality Trade-Offs in Image Denoising by Jonas Dornbusch, Emanuel Pfarr, Florin-Alexandru Vasluianu, Frank Werner, Radu Timofte (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14654.txt.
Introduction
Jonas Dornbusch, Emanuel Pfarr, Florin-Alexandru Vasluianu, Frank Werner, and Radu Timofte blend two diffusion model runs to clean noisy images better, in a 2025 paper. Diffusion models make sharp, realistic images. Classic denoisers instead keep signals faithful but softer. For removing Gaussian noise, neither side wins both goals. The authors first show a simple way to use pretrained diffusion models for the task. Then they propose their combined denoiser.
One run leans on the model's generative power. The other locks onto faithful signal recovery. A weighted blend joins the two paths. A single dial steers the trade-off smoothly. The method reached top performance on the benchmark task. Its behavior stayed controlled as the dial moved. The trick exploits structure inside the denoising samples themselves. The work suits photo tools that must balance beauty and truth. It also suggests a pattern for other restoration jobs.
Catalog record
| CREATOR | Jonas Dornbusch, Emanuel Pfarr, Florin-Alexandru Vasluianu, Frank Werner, Radu Timofte |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-14654
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Simple Combination of Diffusion Models for Better Quality Trade-Offs in Image Denoising Jonas Dornbusch, Emanuel Pfarr, Florin-Alexandru Vasluianu, Frank Werner, Radu Timofte Abstract Diffusion models have garnered considerable interest in computer vision, owing both to their capacity to synthesize photorealistic images and to their proven effectiveness in image reconstruction tasks. However, existing approaches fail to efficiently balance the high visual quality of diffusion models with the low distortion achieved by previous image reconstruction methods. Specifically, for the fundamental task of additive Gaussian noise removal, we first illustrate an intuitive method for leveraging pretrained diffusion models. Further, we introduce our proposed Linear Combination Diffusion Denoiser (LCDD), which unifies two complementary inference procedures—one that leverages the model’s generative potential and another that ensures faithful signal recovery. By exploiting the inherent structure of the denoising samples, LCDD achieves state-of-the-art performance and offers controlled, well-behaved trade-offs through a simple scalar hyperparameter adjustment. 1 Introduction The advances in camera technology over the past decades have enabled a large number of people worldwide to carry a camera at all times, leading to an uncountable number of images being taken every day. Unfortunately, several factors can limit the ability of digital imaging to accurately capture reality, such as rapid camera movement and imperfect or damaged sensors. These flaws are addressed by the field of image reconstruction, which aims to recover the true image from a corrupted source and encompasses tasks such as super-resolution [ 31 , 32 ] , inpainting [ 23 ] , and deblurring [ 40 ] . A particularly important example of image reconstruction is denoising, which aims to remove random noise present in an image [ 11 ] . Classical Diffusion unused Input \cdot\hat{\alpha} scaling Insert in step \hat{k} High Visual Quality Low Distortion controllable by \lambda Initial Prediction linear combination Output Diffusion Update Figure 1 : Overwiev of our proposed LCDD method. A noisy image is scaled, such that it closely resembles an intermediate step in the inference process of a classical DM, and denoised using the structure of DMs. The denoised image is then linearly combined with the initial prediction of the first diffusion step, allowing us to achieve favorable distortion-perception trade-offs. The performance of image reconstruction methods is commonly measured in two different metrics: One metric measures the similarity of the reconstruction to the ground truth, often referred to as distortion , while another quantifies how natural the image appears to the human eye, often termed perception . Blau and Michaeli [ 2 ] proved theoretical limits on optimizing both performance measures simultaneously, introducing the distortion-perception trade-off. Further theoretical work on this trade-off was done by Freirich et al . [ 13 ] , who argued that a simple linear combination of the outputs from a reconstruction method optimized for distortion and another optimized for perception should yield a prediction with an optimal trade-off between the two measures. However, practical explorations of the trade-off, such as [ 1 , 29 , 40 , 41 ] reveal discrepancies from the theoretical predictions, i.e . they do not show optimal or even advantageous trade-offs. In the past, various approaches have been proposed to address the denoising problem, ranging from mathematical techniques [ 3 ] to machine and deep learning-based methods [ 10 , 45 , 22 , 6 , 15 , 43 , 46 ] . Traditionally, machine learning-based denoising methods aim to minimize distortion, leading to strong performance in this aspect. However, they often struggle with perceptual quality, producing images that appear overly smoothed and unnatural. Recently, the success of diffusion models (DMs) [ 16 , 35 ] has led to their adoption in image denoising. Given their ability to generate high-quality images, they are particularly appealing when maintaining a natural appearance is a priority. Denoising methods utilizing DMs include the work of Xie et al . [ 42 ] , who expensively train a specially designed diffusion model, and Wu et al . [ 41 ] , who apply the computationally expensive full inference process of a diffusion model in the residual space. While both approaches achieve strong perceptual quality, they exhibit weaker performance in terms of distortion. To bridge the gap between distortion and perception, we propose the Linear Combination Diffusion Denoiser (LCDD), a denoising scheme that leverages the inherent iterative denoising structure of diffusion models. Our approach involves inserting a noisy image at an appropriate step in the inference process of pretrained diffusion models and linearly combining two different inference outputs to achieve a controlled and advantageous distortion-perception trade-off. For our proposed linear combination, we use the fact that our way of using DMs for denoising naturally exhibits a distortion-perception trade-off when varying the length of the inference schedule, where we achieve strong distortion results for shorter schedules, while longer schedules sacrifice distortion in favor of improved perception. By linearly combining a distortion-focused one-step schedule with a perception-focused multi-step schedule, we obtain a distortion-perception trade-off that is consistently advantageous, i.e . it is strictly better than a linear trade-off ( cf . Fig. 2 ), regardless of the combination factor. Moreover, our approach not only outperforms the natural trade-off but even surpasses the original reconstructions in both distortion and perception in some cases. Additionally, it capitalizes on the expressiveness of pretrained diffusion models, avoiding the need for further training while enabling denoising across all noise levels with a single model. Interestingly, this also serves as a further practical study into the theory of Friedrich et al . [ 13 ] . Distortion↑ Perception↓ Method 1 Method 2 Figure 2 : The trajectories of three methods compared to two reference methods. The distortion measure is designed such that higher scores are better, while for the perception measure lower scores are better. The method that describes the green trajectory has consistently advantageous trade-offs, while the methods describing either of the red trajectories do not. 2 Related work Denoising: The field of denoising is well explored and dacedes old [ 11 ] . Initial methods for suppressing or estimating noise in images were of mathematical nature, such as Buades et al . [ 3 ] , or Dette et al . [ 8 ] and Gasser et al . [ 14 ] . After Chatterjee and Milanfar [ 4 ] famously declared that ”Denoising is Dead”, the success of machine and deep learning across various fields led to their adoption in denoising, revitalizing progress in the field. The first competitive machine learning-based denoising algorithm was the K-SVD algorithm, introduced by Elad and Aharon [ 10 ] . Notable advancements followed, including the DnCNN network by Zhang et al . [ 45 , 46 ] , SwinIR by Liang et al . [ 22 ] , and BM3D by Dabov et al . [ 6 ] , all of which significantly surpassed traditional approaches. Methods currently representing the state of the art in denoising include the Restormer network by Zamir et al . [ 43 ] , and MambaIR by Guo et al . [ 15 ] . Diffusion models: After their first appearance in the work of Sohl-Dickstein et al . [ 34 ] , DMs gainend considerable traction with the work of Ho et al . [ 16 ]