Quantum Latent Diffusion Models

Francesca De Falco, Andrea Ceschini, Alessandro Sebastianelli, Bertrand Le Saux, Massimo Panella · 2025

Read Quantum Latent Diffusion Models by Francesca De Falco, Andrea Ceschini, Alessandro Sebastianelli, Bertrand Le Saux, Massimo Panella (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11174.txt.

Introduction

Francesca De Falco and co-authors build a diffusion image generator that does its creative work on a quantum circuit, in a 2025 paper. Quantum versions of image generators exist for adversarial models, but diffusion models had resisted the treatment. Their design borrows the classical latent diffusion recipe: an ordinary autoencoder shrinks images to a compact code, then variational quantum circuits run the diffusion steps in that small space. A matched classical model with similar size served as the control.

By standard image quality metrics, the quantum version produced better images. The edge held even when trained on small slices of the dataset, a few-shot regime where quantum feature extraction seemed to help most. The authors present the result as early evidence that quantum latent spaces can earn their keep in generative modeling.

Catalog record

CREATORFrancesca De Falco, Andrea Ceschini, Alessandro Sebastianelli, Bertrand Le Saux, Massimo Panella
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-11174

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Quantum Latent Diffusion Models Francesca De Falco, Andrea Ceschini, Alessandro Sebastianelli, Bertrand Le Saux, Massimo Panella Abstract The introduction of quantum concepts is increasingly making its way into generative machine learning models. However, while there are various implementations of quantum Generative Adversarial Networks, the integration of quantum elements into diffusion models remains an open and challenging task. In this work, we propose a potential version of a quantum diffusion model that leverages the established idea of classical latent diffusion models. This involves using a traditional autoencoder to reduce images, followed by operations with variational circuits in the latent space. To effectively assess the benefits brought by quantum computing, the images generated by the quantum latent diffusion model have been compared to those generated by a classical model with a similar number of parameters, evaluated in terms of quantitative metrics. The results demonstrate an advantage in using a quantum version, as evidenced by obtaining better metrics for the images generated by the quantum version compared to those obtained by the classical version. Furthermore, quantum models continue to outperform even when considering small percentages of the dataset for training, demonstrating the quantum’s ability to extract features more effectively even in a few shot learning scenario. keywords Quantum Latent Diffusion, Generative Adversarial Network, Quantum Variational Circuit, Quantum Machine Learning. 1 Introduction Within the framework of classical Artificial Intelligence (AI), Diffusion Models (DMs) have emerged as top contenders for generating data and images, as evidenced by Sohl-Dickstein et al. (2015) ; Ho et al. (2020) ; Rombach et al. (2021) . DMs employ an iterative diffusion process, progressively enhancing the representation of complex distributions by refining the data distribution through a sequence of diffusion steps. They exhibit superior quality and training stability compared to state-of-the-art Generative Adversarial Networks (GANs) Goodfellow et al. (2014) . In particular, latent DMs Rombach et al. (2021) have gained prominence as they enable operation in a computationally more suitable space, transitioning from pixel space to latent space. The advantage is evident, facilitating the efficient processing of even large-scale images. Additionally, there is a substantial improvement in terms of computation time and conservation of energy resources. Meanwhile, various proposals have been made in the introduction of quantum computing architectures into generative models, as over the years, the search for supervised Farhi and Neven (2018) ; Johri et al. (2021) ; Schuld et al. (2017) and unsupervised Aïmeur et al. (2013) ; Benedetti et al. (2019) machine learning algorithms has highlighted how quantum can bring various benefits Bravyi et al. (2018) ; Bravyi et al. (2020) ; Abbas et al. (2021) . In particular, concerning Quantum Generative Adversarial Networks (QGANs), there have been various implementations Huang et al. (2021) ; Chang et al. (2024) ; Tsang et al. (2022) ; Heusel et al. (2017) that have highlighted how even just making the generator quantum can bring benefits, resulting in the generation of better images compared to those generated by a classical GAN. Moreover, a quantum GAN can achieve better performance than its classical counterpart even when the total number of trainable parameters is fewer in the quantum case. Specifically, in Chang et al. (2024) a quantum GAN is presented, which is formed solely by the quantum generator while the discriminator remains classic, operating in the latent space. In other words, both the generator and the discriminator work not in the pixel space but in the latent space, which is reached through the use of a pre-trained autoencoder on the referenced dataset. The advantages highlighted by this architecture include superior image quality generated by the quantum GAN, evaluated in terms of predefined metrics such as Fréchet Inception Distance (FID) and Jensen-Shannon Divergence (JSD). Additionally, it is noteworthy that the quantum GAN demonstrates superior performance even when trained for a reduced number of epochs or with a limited portion of the dataset. This underscores how the introduction of quantum elements can enhance the model’s ability to extract features even with limited training epochs or a restricted dataset. As for DMs, there have only been recent attempts to explore their quantum adoption Cacioppo et al. (2023) ; Parigi et al. (2023) . While a theoretical discussion of a potential quantum generalization of diffusion models is proposed only in Parigi et al. (2023) , with results tied only to very basic and simplified scenarios, two different architectures are proposed in Cacioppo et al. (2023) : the first one works on downsized images from the MNIST dataset; the second model suggests operating on a latent space using a pre-trained autoencoder. Our idea, instead, aims at always working in a latent space in order to operate in a computationally more suitable space. Accordingly, in this paper we propose a quantum latent diffusion model (QLDM), which is characterized by the use of three different variational quantum circuits (VQCs), allowing us to work not only on image-related information but also on temporal information of the diffusion process. Moreover, because we work in the latent space, it is possible to use angle encoding as data encoding, which can be more efficient than amplitude encoding since the latter requires an exponential number of circuit runs to obtain the output distribution. In order to evaluate the actual efficiency of our QLDM approach, various analyses were conducted always comparing the results obtained from our model with an equivalent classical one. Precisely, from the results obtained on MNIST and Fashion MNIST datasets, we will demonstrate how our model achieves better or comparable performances to the ones of the classical model, with the additional advantage of achieving them with a lower number of epochs and especially with a lower amount of training data compared to the classical counterpart. Additionally, the analysis of the loss obtained during training also demonstrates once again how the QLDM converges with a lower number of iterations compared to the classical case. The paper is organized as follows. In Sect. 2 , a background is provided on variational circuits and classical diffusion models; the adopted methodology is explained in Sect. 3 , while the obtained results are discussed in Sect. 4 . Finally, our conclusions are drawn in Sect. 5 . 2 Theoretical Background 2.1 Classical diffusion models In recent years, DMs have proven to be an important class of generative models. A standard mathematical formulation for diffusion models is the one presented by Ho et al. (2020) , which is summarized in the following in order to provide readers with a general overview of its foundations. DMs mainly consist of two distinct phases as shown in Fig. 1 . The first one is the forward process, also called diffusion, involving a transformation that gradually converts the original data distribution {\mathbf{x}_{0}\sim q} , where q is a probability distribution to be learned, by repeatedly adding Gaussian noise: \mathbf{x}_{t}=\sqrt{1-\beta_{t}}\mathbf{x}_{t-1}+\sqrt{\beta_{t}}\bm{\epsilon}_{t},\,\,t=1\dots T\,, (1) where {\bm{\epsilon}_{1},\dots,\bm{\epsilon}_{T}} are IID samples drawn from a zero-mean, unit variance Gaussian (normal) distribution \mathcal{N}(\mathbf{0},\mathbf{I}) , and \beta_{t} determines the variance scale for the t -th step. This progression is underpinned by a Markov chain that can be represented as follows: \displaystyle q(\mathbf{x}_{0:T})=q(\mathbf{x}_{0})\prod_{t=1}^{T}q(\mathbf{x}_{t}|\mathbf{x}_{t-1})\,, (2) \displaystyle q(\mathbf{x}_{t}|\mathbf{x}_{t-1})=\mathcal{N}\left(\sqrt{1-\beta_{t}}\mathbf{x}_{t-1},\beta_{t}\mathbf{I}\right)\,, (3) being \mathbf{I} the identity matrix. Figure 1 : Diffusion process and reverse process of a DM. The goal of the forward process is to

Read the complete text