Inverting the Generation Process of Denoising Diffusion Implicit Models: Empirical Evaluation and a Novel Method

Yan Zeng Masanori Suganuma Takayuki Okatani · 2026

Read Inverting the Generation Process of Denoising Diffusion Implicit Models: Empirical Evaluation and a Novel Method by Yan Zeng Masanori Suganuma Takayuki Okatani (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03111.txt.

Introduction

Zeng, Suganuma, and Okatani study how to run a diffusion image model in reverse. Denoising Diffusion Implicit Models make images from a noise map. Inversion seeks the latent values, above all the first noise map, behind a made image.

The team mixes two tools. Gradient descent handles the first step directly. A fixed-point method then handles the later steps. Tests on three datasets show sharp gains in finding the true first latent values, plus better rebuild accuracy. The authors add a new test, called self-interpolation. It grades images made from points between the true and found latent maps. Past methods did fine at rebuilds but failed this test, which shows their latent maps were off. The new method beat all rivals on all measures.

Catalog record

CREATORYan Zeng Masanori Suganuma Takayuki Okatani
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03111

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Inverting the Generation Process of Denoising Diffusion Implicit Models: Empirical Evaluation and a Novel Method Yan Zeng Masanori Suganuma Takayuki Okatani Abstract This paper studies the problem of inverting the DDIM image generation process to recover latent variables, particularly the initial noise map, from a generated image. Existing methods often struggle with accuracy in this task. We propose a novel hybrid approach that combines direct inversion via gradient descent for the first step, followed by a fixed-point method for subsequent steps. Empirical evaluations across three datasets demonstrate that our method significantly improves the prediction of initial latent variables while achieving superior reconstruction accuracy. Additionally, we introduce a new evaluation, called the self-interpolation test, which assesses the quality of images generated from interpolated points between the true and predicted latent maps, offering deeper insights into performance. Our results reveal that while existing methods perform reasonably well in reconstruction, they consistently fail to accurately predict the initial latent variables, resulting in poor performance on the self-interpolation test. In contrast, our method outperforms all others across all metrics, providing valuable insights into diffusion models and enhancing their applications in image generation and editing. 1 Introduction Recent advancements in image generation using diffusion models have been substantial. In a diffusion process, noise is incrementally added to an image at each step, x_{t-1}\rightarrow x_{t} . When this process is applied to a clean image, such as a natural image x_{0} , and repeated over many steps ( t=1,2,\ldots,T ), it ultimately transforms the image into a fully noisy map x_{T} as T becomes large. Diffusion models reverse this process, gradually recovering x_{0} from x_{T} . Typically, denoising from x_{t} to x_{t-1} is carried out by a deep network, often a U-Net. This network is trained on a set of target images \{x\} , allowing it to generate images that follow the distribution p(x) of that set. Using the trained U-Net (or a similar model), an image x_{0}\sim p(x) can be generated from any sampled noise image x_{T} . The noisy images x_{t} (for t\neq 0 ) in the intermediate steps of the denoising process affect the final generated image x_{0} and can be considered its latent variables. Understanding the relationship between these latent variables and the generated image is essential, not only for applications such as image editing [ 10 ] but also for a deeper understanding of the behavior of diffusion models. Despite this, there is currently no method to accurately infer the latent variables x_{t} from x_{0} , whether x_{0} is a generated image or a natural image. Figure 1 : DDIM generation process ( F:x_{T}\rightarrow x_{0} ) and its inversion ( \mathcal{F}:x_{0}\rightarrow\hat{x}_{T} ). In DDPM [ 5 ] , the generation process is stochastic, so the latent variables cannot be uniquely identified. However, in DDIM [ 16 ] , where the generation is deterministic, the latent variables are directly tied to the final generated image, suggesting that they could be uniquely determined, as shown in Fig. 1 . As discussed later, several studies focused on image editing have explored and applied this approach, yielding promising results [ 2 ] [ 11 ] [ 14 ] . Building on the above, this paper addresses the problem of inverting the DDIM image generation process to recover its latent variables, particularly the initial latent x_{T} , which is expected to be a complete noise map, from a generated image x_{0} or even an image that was not generated by DDIM. Extensive research has been conducted on reversing the image generation process in diffusion models. Early efforts focused on methods that added noise to replicate the standard diffusion process, as seen in works such as SDEdit [ 10 ] and Blended Diffusion [ 1 ] . Later, a technique known as DDIM inversion [ 16 ] was developed by drawing parallels between the DDIM process and the Euler method for solving ordinary differential equations, enabling the reverse computation. This approach has since been applied in various image editing techniques, including DDIB [ 17 ] , DiffusionCLIP [ 6 ] , and Prompt-to-Prompt [ 4 ] . However, DDIM inversion relies on a rough approximation, and it is known that the accuracy remains low unless the number of generation steps, T , is sufficiently large. To overcome this limitation, several extensions and improvements have been introduced. Parmar et al. [ 14 ] noted that the noise estimated by the U-Net in DDIM inversion deviates from the expected Gaussian distribution. They proposed a method to refine the predicted latent variables, making them more Gaussian by applying techniques such as autocorrelation loss and KL loss to adjust the latent variables in a way that minimizes these discrepancies. In contrast, Pan et al. [ 13 ] and Meiri et al. [ 9 ] introduced an alternative approach that iteratively estimates the latent variables using a fixed-point method derived from the one-step DDIM computation. Additionally, hybrid methods that combine elements from both of these approaches have also been proposed [ 3 ] . In this study, we empirically evaluate existing methods under the same experimental settings and introduce a novel approach that demonstrates superior performance. Our method, though intuitive, has not been reported in previous literature: it directly inverts one-step DDIM generation through gradient descent optimization. More specifically, we employ this direct inversion technique only in the first step of the inversion process and apply the existing fixed-point method for all subsequent steps, creating a hybrid approach. Our experiments show that this method outperforms all existing techniques. In this paper, unlike the aforementioned studies, we focus on the simplest DDIM image generation setting, i.e., unconditional DDIM in the image space. This is motivated by our primary interest in determining how to achieve high-precision DDIM inversion, starting with the most fundamental form of DDIM. In contrast, many previous studies were concerned with image editing in text-to-image synthesis, targeting conditional DDIM in latent diffusion models (LDMs) [ 15 ] . Instead of operating in the image space, these studies first map the images into a smaller latent variable space using a VAE, where conditional DDIM, guided by text input, is applied for inversion. In the experiments, we evaluated both the existing methods and the proposed method using three datasets. We used three evaluation metrics: the accuracy of the estimated latent variable \hat{x}_{T} , the accuracy of the image generated (i.e., reconstructed) from it using DDIM, and the accuracy of the image generated from the interpolated points between latent variables. The last metric, based on interpolation, involves generating an image starting from an interpolated point between the latent variable x_{T} of a given image and its estimate \hat{x}_{T} , and then assessing the accuracy and quality of the resulting image. This approach leverages the property that proper interpolation between legitimate latent variables should itself result in a valid latent variable. While a similar idea has been used to test generative models before, interpolating between the latent variables of the same image is novel. Although simple because it does not require two different images, this metric is highly effective in quantifying the performance differences between inversion methods. Several insights were gained. First, methods based on DDIM inversion have low accuracy in reconstruction but perform well

Read the complete text