Efficient Burst Super-Resolution with One-step Diffusion
Kento Kawai Takeru Oba Kyotaro Tokoro Kazutoshi Akita Norimichi Ukita · 2025
Read Efficient Burst Super-Resolution with One-step Diffusion by Kento Kawai Takeru Oba Kyotaro Tokoro Kazutoshi Akita Norimichi Ukita (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-13607.txt.
Introduction
Kento Kawai and co-authors tackle a common phone-camera problem: how to turn a quick burst of small, low-detail photos into one sharp, larger image. Older burst methods often produce results that look blurry. The team instead uses a diffusion model, a kind of image generator known for sharp output.
Their method makes the generator much faster in two ways. A smart sampling step cuts the work, and a training trick called knowledge distillation shrinks the process to a single step. Tests show the new method runs in a small share of the time of its base model, while keeping image quality high on both detail and look.
Catalog record
| CREATOR | Kento Kawai Takeru Oba Kyotaro Tokoro Kazutoshi Akita Norimichi Ukita |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-13607
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Efficient Burst Super-Resolution with One-step Diffusion Kento Kawai Takeru Oba Kyotaro Tokoro Kazutoshi Akita Norimichi Ukita Abstract While burst Low-Resolution (LR) images are useful for improving their Super Resolution (SR) image compared to a single LR image, prior burst SR methods are trained in a deterministic manner, which produces a blurry SR image. Since such blurry images are perceptually degraded, we aim to reconstruct sharp and high-fidelity SR images by a diffusion model. Our method improves the efficiency of the diffusion model with a stochastic sampler with a high-order ODE as well as one-step diffusion using knowledge distillation. Our experimental results demonstrate that our method can reduce the runtime to 1.6 % of its baseline while maintaining the SR quality measured based on image distortion and perceptual quality. 1 Introduction Super-Resolution (SR) is a task for super-resolving Low-Resolution (LR) images to their High-Resolution (HR) images. Among various SR methods, SR for super-resolving an LR image is called Single-Image Super-Resolution (SISR) Dong et al. 2016 ; Timofte et al. 2018 ; Haris et al. 2018 ; Gu et al. 2019 ; Haris et al. 2021 . However, SISR is not an easy task due to its ill-posed nature. That is, there are multiple appropriate HR images of each LR image. In addition to this ill-posed nature, various image degradations make SISR more difficult. (a) SR using diffusion from random noise (b) BSRD Tokoro et al. 2024 (c) Our E-BSRD (Sec. 3 ) Figure 1 : Comparison between prior SR model and our burst SR models. To improve the SR quality, SR methods can take multiple differently-degraded LR images instead of a single LR image to compensate for the degradations between these LR images. Such differently-degraded images can be easily captured by the burst shot mode of a smartphone. Burst SR Bhat et al. 2021b ; Bhat et al. 2022 ; Bhat et al. 2021a ; Luo et al. 2021 ; Guo et al. 2022 ; Luo et al. 2022 ; Dudhane et al. 2022 ; Mehta et al. 2022 ; Dudhane et al. 2023 integrates these burst images into a single SR image. Previous burst SR methods Bhat et al. 2021a ; Luo et al. 2021 ; Guo et al. 2022 ; Luo et al. 2022 ; Dudhane et al. 2022 ; Mehta et al. 2022 ; Dudhane et al. 2023 are trained in a deterministic manner based mainly on a difference between the SR image and its ground truth HR image, such as L1 and L2 losses. However, such reconstruction losses lead to blurred SR images because these losses can be minimized by the average of HR images Ledig et al. 2017 , each of which is an appropriate HR image of the input LR image. To avoid this problem, this paper aims to improve the burst SR quality by probabilistic modeling. Probabilistic modeling allows us to represent the probabilistic distribution of sharp SR images of each LR image. Among such probabilistic models, diffusion models Ho et al. 2020 are used by the recent burst SR method Tokoro et al. 2024 , as shown in (Fig. 1 (b)), because of their performance validated in various computer vision tasks. To employ the diffusion models for burst SR, this paper focuses on the following two issues: How to efficiently achieve burst SR. In diffusion models proposed earlier Ho et al. 2020 , a huge number of iterations (e.g., around 1,000) are required to generate realistic data such as natural images. Since such a huge number of iterations are computationally expensive, several approaches are proposed to reduce the iterative steps (e.g., model minimization using distillation Song et al. 2023 ; Kim et al. 2024 and efficient sampling and training processes Karras et al. 2022 ). While these approaches are applied to SISR Chung et al. 2022b ; Wang et al. 2024 ; Yue et al. 2023 , they are not optimized for burst SR. How to integrate differently-degraded LR images. Unlike random image generation Ho et al. 2020 , image enhancement and restoration, including SR, must condition a diffusion model for generating an image that fits with input images. For example, for diffusion-based SISR Saharia et al. 2023 ; Wang et al. 2023 , an LR image is used for conditioning the reverse diffusion process. Unlike SISR, however, burst SR takes multiple LR images with different degradations, including blur, noise, and displacement. If such differently-degraded images are directly fed into the diffusion model, the reverse process may reconstruct a blurry SR image by averaging these degraded images. To cope with these two issues, CCDF Chung et al. 2022b and BSRD Tokoro et al. 2024 efficiently uses a diffusion model by skipping early diffusion steps. This skip is achieved by feeding an initial burst SR image reconstructed by a simple deterministic burst SR method into the intermediate step of a probabilistic diffusion model, as shown in Fig. 1 (b). Furthermore, unlike previous diffusion-based SISR methods Chung et al. 2022b ; Wang et al. 2024 ; Yue et al. 2023 , BSRD employs spatially-aligned multi-scale features extracted from input burst LR images for conditioning the diffusion model. Our paper extends BSRD Tokoro et al. 2024 by incorporating the following advancements: • Instead of diffusion models using first-order differential equations used in Chung et al. 2022b and Tokoro et al. 2024 , such as DDPM Ho et al. 2020 , DDIM Song et al. 2021a , iDDPM (variance scheduling) Nichol and Dhariwal 2021 , and VP/VE Song et al. 2021b , a second-order differential equation-based model (i.e., Elucidating the Design Space of Diffusion-Based Generative Model (EDM) Karras et al. 2022 ) is used to reduce the number of diffusion steps as well as to improve the SR quality. While the original EDM removes a large amount of noise per step from random noise to reduce the number of diffusion steps, each step in our method removes only a small amount of noise by appropriately decreasing the noise given to an initial SR image, enabling fine-grained SR reconstruction even through a smaller number of diffusion steps. • For further reducing the number of diffusion steps for efficient burst SR (i.e., between 5 and 100 in Chung et al. 2022b and Tokoro et al. 2024 to one step in our method), a distillation-based teacher-student model Song et al. 2023 ; Kim et al. 2024 is employed. Since this distillation-based model degrades the quality of image synthesis if it begins from random noise, our method avoids this degradation by feeding a properly initialized SR image, which is reconstructed by simple deterministic Burst SR in our method, into the diffusion model. • Several important parameters for EDM and the distillation model are optimized for our burst SR model. • With the aforementioned contributions, the SR reconstruction time is reduced to 1.6 % of the baseline, i.e., BSRD Tokoro et al. 2024 . 2 Related Work 2.1 Burst SR While a RAW image consisting of RGGB channels (4 channels) with high bits per pixel resolution (e.g., 14 bits, 16 bits) is captured by a standard digital camera, it is converted by an Image Signal Processing (ISP) to its 8-bit RGB image. General burst SR methods take a set of unprocessed RAW