An em algorithm for quantum Boltzmann machines

Takeshi Kimura 1, Kohtaro Kato 1, Masahito Hayashi 2,3,4 · 2025

Read An em algorithm for quantum Boltzmann machines by Takeshi Kimura 1, Kohtaro Kato 1, Masahito Hayashi 2,3,4 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21569.txt.

Introduction

Takeshi Kimura, Kohtaro Kato, and Masahito Hayashi train quantum Boltzmann machines without chasing gradients. Their paper, from twenty twenty-five, faces the barren plateau problem. In big quantum systems, gradients shrink to near zero, so training stalls. Their fix revives a classic method, the EM algorithm, in quantum form.

The EM method swaps hard direct tuning for two easier steps in turn. Their version runs on a hybrid machine with quantum effects in the hidden layer only. Training stayed stable where gradient descent failed. Scores on standard data sets beat the gradient route. The authors call it a structured, scalable path for quantum generative models.

Catalog record

CREATORTakeshi Kimura 1, Kohtaro Kato 1, Masahito Hayashi 2,3,4
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-21569

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An em algorithm for quantum Boltzmann machines Preprint: APS/123-QED Takeshi Kimura 1, Kohtaro Kato 1, Masahito Hayashi 2,3,4 Abstract We develop a quantum version of the em algorithm for training quantum Boltzmann machines. The em algorithm is an information-geometric extension of the well-known expectation-maximization (EM) algorithm, offering a structured alternative to gradient-based methods with potential advantages in stability and convergence. We implement the algorithm on a semi-quantum restricted Boltzmann machine, where quantum effects are confined to the hidden layer. This structure enables analytical update rules while preserving quantum expressivity. Numerical experiments on benchmark datasets show that the proposed method achieves stable learning and outperforms gradient-based training in several cases. These results demonstrate the potential of information-geometric optimization for quantum machine learning, particularly in settings where standard methods struggle due to non-commutativity or vanishing gradients. \usephysicsmodule ab, braket, doubleprod, xmat I Introduction Quantum machine learning is a field that aims to exploit quantum phenomena to enhance the expressivity and efficiency of learning models schuld2014quest ; biamonte2017quantum ; dunjko2018machine ; ciliberto2018quantum ; cerezo2022challenges . Some directions aim to enhance classical models through quantum subroutines, such as quantum kernel methods schuld2019quantum or quantum linear algebra harrow2009quantum . Others, such as variational quantum algorithms PhysRevA.98.032309 ; benedetti2019parameterized , rely on parametrized quantum circuits trained via classical optimization. Although these models are actively studied, especially in light of recent advances in quantum hardware, the extent to which quantum machine learning offers concrete advantages over classical machine learning remains largely unsettled. The quantum Boltzmann machine (QBM) amin2018quantum is a quantum machine learning scheme defined by a Hamiltonian that generalizes the Boltzmann machine to non-commutative settings. The aim is to leverage quantum coherence and entanglement to enhance the modeling capacity of energy-based generative models. The classical Boltzmann machine, originally proposed as a stochastic neural network based on statistical mechanics ackley1985learning , models data via an energy-based probability distribution and has played an influential role in the development of deep generative models. In learning, gradient-based optimization is one of the most widely used methods in modern machine learning, particularly for deep and energy-based models. Its generality make it a powerful and flexible choice also for Boltzmann machines. However, gradient-based methods treat the model largely as a black box and often struggle with non-convexity of the cost function when hidden variables are involved. In such cases, the Expectation-Maximization (EM) algorithm dempster1977maximum provides a structured alternative amari1992information . Unlike gradient-based methods, the EM algorithm exploits the hidden-layer structure by alternating between inference (E-step) and parameter optimization (M-step). This difference enable the algorithm to avoid issues such as vanishing gradients and poor convergence in highly non-convex landscapes. Extending the EM framework to quantum settings may offer similar advantages, providing a structured approach to optimization in the presence of hidden quantum layers. However, a straightforward application of the EM algorithm to QBMs is generally infeasible due to the lack of a well-defined conditional distribution. To address this challenge, we adopt the em algorithm, an information-geometric generalization of EM. The em algorithm reformulates the learning procedure as alternating projections in a dual statistical manifold: mixture and exponential families, which has found widespread applications in machine learning and neural network models amari2016information ; amari1995information ; fujimoto2007modified ; allassonniere2019new . The information-geometric formulation can be naturally extended to the quantum setting by replacing classical statistical manifolds with their non-commutative analogues hayashi2023bregman ; hayashi2024reverse ; hayashi2024iterative ; hayashi2024generalized ; hayashi2024bregman . Figure 1 : Conceptual overview of our learning framework. This figure illustrates the em algorithm, an information-geometric generalization of the EM algorithm, proposed as an alternative approach to training QBMs. The algorithm iteratively minimizes the divergence between an exponential family (model manifold) and a mixture family (data manifold) via alternating projections. For demonstration, we apply the method to sqRBMs, where quantum effects are confined to the hidden layer. Building on this perspective, we introduce a quantum version of the em algorithm for QBMs. To evaluate its performance and derive explicit update rules, we implement the algorithm in a semi-quantum restricted Boltzmann machine (sqRBM) demidik2025expressive , a hybrid model in which quantum effects appear only in the hidden layer. This setting reduces the complexity of analytical computation in each step of the em algorithm, yielding closed-form expressions for parameter updates. While sqRBMs can be simulated efficiently on a classical hardware, they are known to offer enhanced expressive power in the hidden layer compared to fully classical models demidik2025expressive . We demonstrate the quantum em algorithm within the sqRBM framework for several data sets. Numerical experiments show stable learning behavior and improved average optimization compared to gradient-based methods in some cases. While the sqRBM simplifies the quantum model by confining quantum effects to the hidden layer, this study represents a first step toward a solid learning framework for QBMs and aims to provide a foundation for future extensions to fully quantum architectures. II Results II.1 Model (semi-quantum restricted Boltzmann machine) A Boltzmann machine (BM) ackley1985learning is an energy-based probabilistic generative model defined on an undirected graph G=(\mathcal{V},E) . The vertices corresponding to binary units are classified into visible and hidden layers. The visible layer, denoted by the set of units V=\{v_{1},\ldots,v_{N}\} (v_{i}=\pm 1,i\in[1,N]) , represents the inputs and outputs of the observed data. The hidden layer, denoted by H=\{h_{1},\ldots,h_{M}\} , represents latent features of the data. The edges of the graph represent the interaction pattern between units, and each edge is assigned a weight indicating the strength of the coupling. A restricted Boltzmann machine (RBM) is a BM in which no connections exist between units within the same layer, resulting in a bipartite graph structure. This ensures that units within each layer are conditionally independent given the state of the opposite layer. The energy function of RBM is given as \displaystyle E(\mathbf{v},\mathbf{h})=-\sum_{v_{i}\in V}b_{i}v_{i}-\sum_{h_{j}\in H}b_{j}h_{j}-\sum_{(i,j)\in E}w_{ij}v_{i}h_{j}, (1) where {\bf v}=(v_{1},...,v_{N}) and {\bf h}=(h_{1},...,h_{M}) are short-hand notations, b_{i}\in\mathbb{R} are the bias strength and w_{ij}\in\mathbb{R} are the coupling strength between v_{i} and h_{j} . The entire state of the RBM is represented by the probability distribution: \displaystyle P_{VH,\theta}(\mathbf{v},\mathbf{h}):=e^{-E(\mathbf{v},\mathbf{h})}/Z,\quad Z=\sum_{\mathbf{v},\mathbf{h}}e^{-E(\mathbf{v},\mathbf{h})}. (2) The goal of training BM is to reproduce a probability distribution on V by the marginal distribution P_{V,\theta}({\bf v}):=\sum_{{\bf h}\in H}P_{VH,\theta}(\bf v,h) by finding suitable parameters \theta=(b,w) . A quantum Boltzmann machine (QBM) amin2018quantum is a model defined by replacing the binary units in the BM by qubits (1/2-spin quantum systems) \mathbb{C}^{2}={\rm span}\{|\pm 1\rangle\} . The energy function of BM is replaced by a local Pauli Hamiltonian on the graph that can include non-commuting interaction terms. In the main analysis, we use semiquantum RBM (sqRBM) demidik2025expressive with non-commutative terms only in the hidden units. As in the classical case, the vertices are decomposed as \mathcal{V}=V\sqcup H , where V refers the visible layer and H refers the hidden layer. Let us denote the Pauli operators acting on the i -th qubit as \displaystyle\sigma_{i}^{a}=\underbrace{I\otimes\cdots\otimes I}_{i-1}\otimes\sigma^{a}\otimes\underbrace{I\otimes\cdots\otimes I}_{N+M-i},\quad a=x,z. (3) Then, the Hamiltonian of sqRBM is given by: \displaystyle H=-\sum_{i\in V}b_{i}\sigma_{i}^{z}-\sum_{j\in H}(b_{j}\sigma_{j}^{z}+\Gamma_{j}\sigma_{j}^{x})-\sum_{(i,j)\in E}w_{ij}\sigma_{i}^{z}\sigma_{j}^{z}, (4) where \Gamma_{j}\in\mathbb{R} are the additional quantum parameters. The quantum state of the RQBM is the quantum Gibbs state \displaystyle\rho_{VH,\theta}:=e^{-H}/Z,\quad Z=\Tr[e^{-H}], (5) and the reduced state on the visible layer is given by \rho_{V,\theta}=\Tr_{H}\rho_{V,\theta} . The probability distribution on the visible units is then \displaystyle P_{V,\theta}(\mathbf{v})=\Tr[\Lambda_{\mathbf{v}}\rho_{V,\theta}], (6) where \Lambda_{\mathbf{v}} is

Read the complete text