Quaternion Wavelet-Conditioned Diffusion Models for Image Super-Resolution

Luigi Sigillo, Christian Bianchi, Aurelio Uncini, and Danilo Comminiello, Dept. Information Engineering, Electronics and Telecommunications (DIET), Sapienza University of Rome, Italy · 2025

Read Quaternion Wavelet-Conditioned Diffusion Models for Image Super-Resolution by Luigi Sigillo, Christian Bianchi, Aurelio Uncini, and Danilo Comminiello, Dept. Information Engineering, Electronics and Telecommunications (DIET), Sapienza University of Rome, Italy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00334.txt.

Introduction

Blowing a small photo up large without mush takes more than a good guess at the missing grain. Luigi Sigillo, Christian Bianchi, Aurelio Uncini, and Danilo Comminiello build such a blower in 2025 on a diffusion model, the kind that clears noise step by step into a picture. Their twist is the guide fed to the clearer: a quaternion wavelet read of the small photo, rich in edge and texture marks.

The guide is woven in at many steps of the clearing, not just at the door. A big public image model lends its learned sense of what pictures look like. The catalog title drags a funding thanks line behind it; the head title is clean. On their test sets the blower beat past tools on looks and on the standard scores. The code is posted in the open.

Catalog record

CREATORLuigi Sigillo, Christian Bianchi, Aurelio Uncini, and Danilo Comminiello, Dept. Information Engineering, Electronics and Telecommunications (DIET), Sapienza University of Rome, Italy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-00334

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Quaternion Wavelet-Conditioned Diffusion Models for Image Super-Resolution Thanks: This work was partly supported by “Ricerca e innovazione nel Lazio - incentivi per i dottorati di innovazione per le imprese e per la PA - L.R. 13/2008” of Regione Lazio, Project “Deep Learning Generativo nel Dominio Ipercomplesso per Applicazioni di Intelligenza Artificiale ad Alta Efficienza Energetica”, under grant number 21027NP000000136, and by the European Union under the Italian National Recovery and Resilience Plan (NRRP) of NextGenerationEU, “Rome Technopole” (CUP B83C22002820006)—Flagship Project 5: “Digital Transition through AESA radar technology, quantum cryptography and quantum communications”. Luigi Sigillo, Christian Bianchi, Aurelio Uncini, and Danilo Comminiello, Dept. Information Engineering, Electronics and Telecommunications (DIET), Sapienza University of Rome, Italy Abstract Image Super-Resolution is a fundamental problem in computer vision with broad applications spacing from medical imaging to satellite analysis. The ability to reconstruct high-resolution images from low-resolution inputs is crucial for enhancing downstream tasks such as object detection and segmentation. While deep learning has significantly advanced SR, achieving high-quality reconstructions with fine-grained details and realistic textures remains challenging, particularly at high upscaling factors. Recent approaches leveraging diffusion models have demonstrated promising results, yet they often struggle to balance perceptual quality with structural fidelity. In this work, we introduce ResQu a novel SR framework that integrates a quaternion wavelet preprocessing framework with latent diffusion models, incorporating a new quaternion wavelet- and time-aware encoder. Unlike prior methods that simply apply wavelet transforms within diffusion models, our approach enhances the conditioning process by exploiting quaternion wavelet embeddings, which are dynamically integrated at different stages of denoising. Furthermore, we also leverage the generative priors of foundation models such as Stable Diffusion. Extensive experiments on domain-specific datasets demonstrate that our method achieves outstanding SR results, outperforming in many cases existing approaches in perceptual quality and standard evaluation metrics. The code will be available after the revision process. Email: [email protected]. I Introduction Fig. 1: Qualitative comparisons on real-world images, upscaled from 128 to 512 pixels, we compare StableSR [ 1 ] , and the ground truth with our results displayed in the final column. The visual evaluations underscore differences in image quality, clarity, and the enhancement of fine details achieved by our model during the super-resolution process. Noticeable to see that the background on StableSR results is plain while in the ground truth it is coarse, like in the output of our model. Image Super-Resolution (SR) is a cornerstone problem in computer vision, with far-reaching implications for applications ranging from medical imaging to satellite analysis and beyond [ 2 , 3 ] . The ability to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts is not only a technical challenge but also a practical necessity. Indeed, LR images often hinder the performance of downstream tasks such as object detection, segmentation, and classification [ 4 ] . Despite decades of research, achieving SR that preserves fine-grained details and realistic textures, especially at high upscaling factors, remains an open problem. Traditional SR methods, such as interpolation, frequency-domain transformations, and filtering-based techniques, have provided foundational solutions but often fall short of generating perceptually convincing results. These approaches typically struggle to recover high-frequency details, leading to artifacts and blurring that degrade image quality [ 5 ] . The field of super-resolution (SR) has undergone a transformative shift with the advent of deep learning. Convolutional neural networks (CNNs), Vision Transformers (ViT), and more recently, generative models have all set new benchmarks for SR performance. Among these advancements, diffusion models have emerged as a particularly promising paradigm for image generation. Studies have demonstrated their unparalleled capabilities in generating coherent images by iteratively refining noise into structured outputs [ 6 , 7 , 8 , 9 ] . Building upon this progress, there have been many recent advances in the application of diffusion models to super-resolution tasks [ 10 , 11 , 12 , 13 , 14 ] . Contemporary research in diffusion-based super-resolution has increasingly focused on exploring the synergistic potential of integrating wavelet-based techniques, leveraging their complementary strengths in multi-resolution analysis and feature decomposition [ 15 ] . For instance, [ 16 ] introduced a wavelet-based diffusion framework that bridges the speed gap in generative models by adaptively handling low- and high-frequency components through wavelet decomposition. Building on this, other works [ 17 , 18 ] have further explored wavelet diffusion approaches tailored specifically for SR tasks, establishing a strong foundation for integrating wavelet transforms with generative models. These works highlight the importance of multi-scale feature extraction and adaptive processing in achieving state-of-the-art SR performance. Motivated by these recent progresses in the field, we propose a novel SR framework that integrates a quaternion wavelet preprocessing framework [ 19 ] with latent diffusion models. Unlike prior works that simply combine wavelet transforms with diffusion models, our approach introduces a quaternion wavelet- and time-aware encoder that significantly enhances the conditioning process during the denoising steps. This encoder exploits quaternion wavelet embeddings, which are dynamically integrated at different stages of the denoising process, enabling fine-grained control over the generation of SR images. By leveraging the latent representations learned by state-of-the-art text-to-image generative models such as Stable Diffusion (SD) [ 20 ] , our framework not only advances existing SR methodologies but also establishes a novel architectural paradigm that synthesizes generative priors with super-resolution techniques. The quaternion wavelet embeddings capture both low-frequency approximations and high-frequency details, which are weighted and conditioned at multiple scales during denoising by our encoder. This multi-scale conditioning mechanism, combined with the generative priors of SD, allows our framework to achieve superior performance in quantitative metrics, and also competitive results in qualitative assessments. To validate our approach, we conduct extensive experiments with additional ablation studies on diverse datasets, demonstrating the robustness and versatility of our method in real-world scenarios. The primary contributions of this work are as follows: 1. We introduce a latent diffusion model for image SR that integrates quaternion wavelet features, and generative priors. 2. We propose a novel quaternion wavelet- and time-aware encoder that enhances the conditioning process at multiple scales during denoising, significantly improving the performance of pre-trained foundation models like SD. 3. We demonstrate through extensive experiments that our approach outperforms existing methods in both perceptual quality and quantitative metrics. 4. We perform ablation studies on architecture design and also on domain-specific datasets. This paper is organized as follows. In Section II , we provide the theoretical background and discuss the challenges and applications of SR. In Section III we introduce our proposed method, StableShip-SR, detailing its architecture and key innovations. In Section IV we present our experimental results and comparisons with state-of-the-art methods. Finally, Section V concludes the paper with a discussion of our findings and potential directions for future research. II Background Image SR is a fundamental task in computer vision, aimed at restoring high-resolution (HR) images from degraded low-resolution (LR) observations. Given an LR image \tilde{\mathbf{x}} , the goal is to reconstruct an HR image \mathbf{x} , where the relationship between the two is modeled as: \tilde{\mathbf{x}}=(\mathbf{x}\otimes k)+n, (1) where k represents the degradation matrix, \otimes denotes a convolution-like operation, and n is a noise term. This task is inherently ill-posed, as multiple HR solutions can correspond to the same LR input, making reconstruction highly ambiguous and challenging

Read the complete text