OSCAR: One-Step Diffusion Codec for Image Compression Across Multiple Bit-rates
Jinpei Guo, Yifei Ji, Zheng Chen, Kai Liu, Min Liu, Wang Rao, Wenbo Li, Yong Guo, Yulun Zhang · 2025
Read OSCAR: One-Step Diffusion Codec for Image Compression Across Multiple Bit-rates by Jinpei Guo, Yifei Ji, Zheng Chen, Kai Liu, Min Liu, Wang Rao, Wenbo Li, Yong Guo, Yulun Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-16091.txt.
Introduction
Jinpei Guo and colleagues build an image compression system that rebuilds pictures in a single diffusion step at any chosen file size. Diffusion models restore images superbly but usually need many slow passes from pure noise, and a separate model per bit rate. Writing in twenty twenty-five, the team reframes the job. A compressed image code is treated as a partly noised version of the original code, with the noise level set by the chosen bit rate. One trained model then maps that state back to a clean image in one pass.
Linking bit rate to a matching step on the diffusion path lets one model serve all rates. Because the compressed code keeps much of the picture structure, a single cleanup pass is enough. In extensive tests the system led on both measured quality and visual quality, the authors report.
Catalog record
| CREATOR | Jinpei Guo, Yifei Ji, Zheng Chen, Kai Liu, Min Liu, Wang Rao, Wenbo Li, Yong Guo, Yulun Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-16091
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OSCAR: One-Step Diffusion Codec for Image Compression Across Multiple Bit-rates Jinpei Guo, Yifei Ji, Zheng Chen, Kai Liu, Min Liu, Wang Rao, Wenbo Li, Yong Guo, Yulun Zhang Abstract Pretrained latent diffusion models have shown strong potential for lossy image compression, owing to their powerful generative priors. Most existing diffusion-based methods reconstruct images by iteratively denoising from random noise, guided by compressed latent representations. While these approaches have achieved high reconstruction quality, their multi-step sampling process incurs substantial computational overhead. Moreover, they typically require training separate models for different compression bit-rates, leading to significant training and storage costs. To address these challenges, we propose a o ne- s tep diffusion c odec a cross multiple bit- r ates. termed OSCAR . Specifically, our method views compressed latents as noisy variants of the original latents, where the level of distortion depends on the bit-rate. This perspective allows them to be modeled as intermediate states along a diffusion trajectory. By establishing a mapping from the compression bit-rate to a pseudo diffusion timestep, we condition a single generative model to support reconstructions at multiple bit-rates. Meanwhile, we argue that the compressed latents retain rich structural information, thereby making one-step denoising feasible. Thus, OSCAR replaces iterative sampling with a single denoising pass, significantly improving inference efficiency. Extensive experiments demonstrate that OSCAR achieves superior performance in both quantitative and visual quality metrics. The code and models will be released at https://github.com/jp-guo/OSCAR . 1 Introduction With the explosive growth of multimedia content, the need for efficient transmission and storage of high-resolution images has become increasingly critical. Traditional image compression has long relied on manually crafted codecs [ 50 , 6 , 10 ] , which tend to falter at very low bit rates ( \leq 0.2 bpp), where blocking and ringing artifacts severely degrade perceptual quality. Recent research has shifted towards learning-based transform-coding systems [ 5 , 13 , 21 ] that jointly optimize an end-to-end rate–distortion (R–D) objective [ 42 ] . Although these neural codecs generally outperform the hand-crafted compression algorithms, the focus on minimizing R–D inevitably sacrifices fine-grained realism at extreme compression bit-rates [ 8 ] , producing images that appear synthetic or over-smoothed. In addition, supporting multiple compression bit-rates generally means training multiple models, each optimized with a rate–distortion loss weighted by a different Lagrange multiplier ( \lambda ). Maintaining one model per \lambda dramatically inflates both training time and storage requirements. Recent breakthroughs in diffusion models [ 23 , 43 ] , most notably large-scale text-to-image latent diffusion models (LDMs) [ 39 ] , have revealed powerful generative priors that can be repurposed for a wide range of downstream vision tasks [ 56 , 9 , 19 ] . Building on this insight, diffusion-based codecs [ 44 , 30 , 32 ] have been proposed for image compression. These models typically perform quantization in the latent space to enable compression, achieving lower distortion at a given rate than conventional CNN- or Transformer-based methods. Some works [ 11 ] further integrate pretrained LDMs with a vector-quantization mechanism [ 48 , 16 ] , allowing the compression rate to be predetermined via a fixed hyper-encoder. Their practicality, however, is still hindered by two issues: (i) the multiple denoising iterations are required at inference time, which impose substantial inference computational overhead; and (ii) achieving multiple bit-rates still requires training separate diffusion networks. Since diffusion models typically have a larger model size than conventional learned codecs, this one-model-per-rate strategy further amplifies both training and storage costs. These constraints limit real-world deployment, particularly in resource-constrained scenarios. Figure 1 : Qualitative comparison between HiFiC [ 35 ] , MS-ILLM [ 37 ] , CDC [ 54 ] , PerCo [ 11 ] , and our OSCAR. OSCAR is capable of reconstructing complex textures with high realism. OSCAR effectively reconstructs complex textures with high realism. In contrast, HiFiC, MS-ILLM, and PerCo exhibit noticeable loss of fine structures and introduce visible artifacts, while CDC suffers from significant color shifts. Please zoom in for a better view. To address the aforementioned challenges, we propose OSCAR , a o ne- s tep diffusion c odec a cross multiple bit- r ates. Unlike previous approaches [ 54 , 32 , 11 ] that start from Gaussian noise, we introduce the concept of pseudo diffusion timestep , bridging the quantization process and the forward diffusion. This idea is inspired by a classical signal processing result that quantization noise, especially at higher bit-rates, can be approximated as additive Gaussian noise [ 7 ] . Formally, we posit that the quantized latents \tilde{\mathbf{z}} can be decomposed as \tilde{\mathbf{z}}=\sqrt{\bar{\alpha}_{t}}\mathbf{z}_{0}+\sqrt{1-\bar{\alpha}_{t}}\boldsymbol{\epsilon} , where \boldsymbol{\epsilon} is approximately Gaussian noise and statistically independent of \mathbf{z}_{0} , \bar{\alpha}_{t} is the diffusion noise schedule, and t is the pseudo diffusion timestep that depends on the bit-rate. Under the assumption that \boldsymbol{\epsilon} is orthogonal to \mathbf{z}_{0} in expectation, the expected cosine similarity between \tilde{\mathbf{z}} and \mathbf{z}_{0} satisfies \mathbb{E}[\operatorname{sim(\tilde{\mathbf{z}},\mathbf{z}_{0})}]\approx\sqrt{\bar{\alpha}_{t}} (Please refer to Appendix for a full derivation). To make this relationship more consistent, we adopt a representation alignment training between \tilde{\mathbf{z}} and \mathbf{z}_{0} . We empirically observe that this training paradigm enables their cosine similarity to converge to a fixed value for each bit-rate. Thus, by matching measured cosine similarities to the theoretical form, each bit-rate r can be directly mapped to a pseudo diffusion timestep t . Our experiments provide strong support for this modeling, as the measured distribution of \boldsymbol{\epsilon} closely follows the assumed Gaussian distribution. We further illustrate this perspective in Fig. 2 (a), where the quantized latent features can be interpreted as the intermediate diffusion states along diffusion trajectories. Remarkably, even under extreme compression, the cosine similarity between \tilde{\mathbf{z}} and \mathbf{z}_{0} stabilizes to a high value once representation alignment is applied. This suggests that the \tilde{\mathbf{z}} retains rich structural information and is amenable to one-step denoising. Since each bit-rate corresponds to a distinct pseudo timestep, the reconstruction process can be unified: A single diffusion model can denoise quantized latents at different compression bit-rates in one pass, conditioned on their respective pseudo diffusion timesteps. As shown in Fig. 2 (b), OSCAR achieves a strong quality–efficiency tradeoff. Furthermore, Fig. 1 shows that OSCAR can faithfully restore fine textures and perceptually coherent details at low bit-rates. (a) Illustration of mapping between bit-rates and timesteps (b) BD-Rate comparison on Kodak dataset. Figure 2 : Left: Our method bridges quantization and diffusion by mapping bit-rates to pseudo diffusion timesteps. Right: BD-rates measured by DISTS [ 15 ] , with circle radius indicating multiply-accumulate operations (MACs). OSCAR achieves a favorable quality-efficiency tradeoff. Our main contributions are summarized as follows: • We propose a novel and efficient one-step diffusion codec OSCAR, which reconstructs compressed latents into high-quality images in a single denoising step. Unlike existing diffusion codecs that require multiple iterative steps, our approach enables rapid and high-fidelity decoding. To the best of our knowledge, this is the first work to explore one-step diffusion for image compression. • We propose a unified network design that supports compression at multiple bit-rates. By bridging quantization and forward diffusion, our approach enables a single generative model to handle diverse bit-rates without the need to train separate models. This unified design reduces storage requirements and simplifies training. • Through extensive experiments,