Energy-based generator matching: A neural sampler for general state space

Dongyeop Woo, Minsu Kim, Minkyu Kim, Kiyoung Seong, Sungsoo Ahn · 2025

Read Energy-based generator matching: A neural sampler for general state space by Dongyeop Woo, Minsu Kim, Minkyu Kim, Kiyoung Seong, Sungsoo Ahn (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-19646.txt.

Introduction

Generative models usually learn from data, but sometimes all you hold is an energy function that scores states. Dongyeop Woo and co-authors propose in 2025 energy-based generator matching, a way to train a neural sampler from the energy alone. It stretches a recent matching method to any continuous-time Markov process, diffusion, flow, or jump, and to mixed data types.

The training loss is estimated with self-normalized importance sampling, plus a bootstrapping trick to quiet the noise in the weights. Tests reached one hundred dimensions on discrete tasks and twenty on mixed ones. The sampler opens energy-based modeling to domains where examples are scarce but physics is known.

Catalog record

CREATORDongyeop Woo, Minsu Kim, Minkyu Kim, Kiyoung Seong, Sungsoo Ahn
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE102 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-19646

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Energy-based generator matching: A neural sampler for general state space Dongyeop Woo, Minsu Kim, Minkyu Kim, Kiyoung Seong, Sungsoo Ahn Abstract We propose Energy-based generator matching (EGM) , a modality-agnostic approach to train generative models from energy functions in the absence of data. Extending the recently proposed generator matching, EGM enables training of arbitrary continuous-time Markov processes, e.g., diffusion, flow, and jump, and can generate data from continuous, discrete, and a mixture of two modalities. To this end, we propose estimating the generator matching loss using self-normalized importance sampling with an additional bootstrapping trick to reduce variance in the importance weight. We validate EGM on both discrete and multimodal tasks up to 100 and 20 dimensions, respectively. 1 Introduction We tackle the problem of drawing samples from a Boltzmann distribution p_{\text{target}}(x)\propto\exp(-\mathcal{E}(x)) given only oracle access to the energy function \mathcal{E}(x) and no pre-computed equilibrium samples. Such “energy-only” inference arises throughout machine learning, e.g., Bayesian inference [ 15 ] and statistical physics, e.g., computing thermodynamic averages [ 29 ] , yet it remains intractable in high-dimensional or combinatorial state spaces. Classical methods based on Markov processes, e.g., Metropolis–Hastings [ 28 , 18 ] , Gibbs sampling [ 16 ] , and Metropolis-adjusted Langevin algorithm [ 17 , 33 ] , provide asymptotically exact guarantees, but at the cost of long mixing times. In practice, one must run chains for a vast number of steps to traverse metastable regions, and each transition incurs an expensive energy evaluation, limiting applicability to large-scale systems [ 32 ] . Deep generative models, particularly diffusion and flow models tied to continuous-time processes [ 36 , 25 ] , offer a compelling alternative: after training, a cheap constant-cost network evaluation can produce independent samples. Once trained, they do not require energy queries for inference. These models show great success in vision [ 34 ] , language [ 24 ] , and audio [ 21 ] , and can be transferred to unseen conditions. However, their success critically depends on data-driven training on a large number of true equilibrium samples, which are unavailable when only an energy function is known. In response, researchers have designed new energy-driven algorithms, coined diffusion samplers, to train diffusion-based generative models to sample from the Boltzmann distribution. For example, path integral samplers (PIS) [ 42 ] and denoising diffusion samplers (DDS) [ 38 ] minimize the divergence between a forward SDE and the backward SDE defined by a Brownian bridge. Akhound-Sadegh et al. [1] proposed iterated denoising energy matching (iDEM), a simulation-free approach to train diffusion models, highlighting the expensive simulation procedure for acquiring new samples from the diffusion-based models. Generative flow networks (GFNs) [ 3 , 22 ] , originating from reinforcement learning, can also be interpreted as a continuous-time Markov process (CTMP) in the limit [ 5 ] . However, there still exists a gap between the data- and energy-driven training schemes, particularly on the choice of state spaces and CTMP. Especially, Holderrieth et al. [20] recently proposed generator matching (GM), which allows unified data-driven training of continuous-time processes ranging from flow, diffusion, and jump processes for both continuous and discrete state spaces. This allows training a generative model for hybrid data, e.g. amino acid sequences and 3D coordinates of a protein [ 7 ] , and greatly expands the available space of parameterization. Table 1 : Comparison of sampling methods by state space type and underlying Markov process. “D”, “F”, “J”, “J (D)” denotes the diffusion, flow, continuous jump, and discrete jump process respectively. Method D F J J (D) PIS [ 42 ] , iDEM [ 1 ] , CMCD [ 39 ] iEFM [ 40 ] , LFIS [ 37 ] , NFS 2 [ 8 ] LEAPS [ 19 ] EGM (ours) Contribution. We propose energy-based generator matching (EGM), an energy-driven training framework for continuous-time Markov processes parameterized by a neural network. EGM accommodates continuous, discrete, and mixed state spaces and applies to various process types, including diffusion-, flow-, and jump-based models. Our work greatly expands the scope of energy-driven training for continuous-time neural processes (See Table 1 ). To this end, our EGM estimates the generator matching loss with self-normalized importance sampling, which requires approximating samples from the target distribution. However, this is challenging due to the high variance in importance weights. To alleviate this issue, we introduce bootstrapping, which allows the generator to be estimated using easy-to-approximate samples from the nearby future time step. It reduces the variance of importance weights, significantly boosting the sampler’s performance. We validate our work through experiments on various target distributions: discrete Ising model and three joint discrete-continuous tasks, i.e., the Gaussian-Bernoulli restricted Boltzmann machine (GB-RBM) [ 9 ] , joint double-well potential (JointDW4), and joint mixture of Gaussians (JointMoG). Our findings demonstrate that the training algorithm enables parameterized CTMP to learn the desired distribution and is scalable to reasonably-sized problems. 2 Preliminary: Generator matching on general state space In this section, we provide preliminaries on generator matching (GM) [ 20 ] , which allows generative modeling using arbitrary continuous-time Markov processes (CTMP). Notation. Let S denote the state space with a reference measure \nu . We let p_{\text{target}} denote the target distribution with samples x_{1}\sim p_{\text{target}} . We denote a probability measure p on S by p(dx) , where “ dx ” indicates integration with respect to p in the variable x . If p admits a density, and when no confusion arises, we use p both for the measure p(dx) and its density p(x):=\frac{dp}{d\nu}(x) with respect to \nu . Overview of generator matching. GM relies on a set of time-varying probability distributions (p_{t|1}(dx|x_{1}))_{0\leq t\leq 1} depending on a data point x_{1}\in S , coined a conditional probability path. This induces a corresponding marginal probability path (p_{t})_{0\leq t\leq 1} via the hierarchical sampling procedure: x_{1}\sim p_{\text{target}},\;x\sim p_{t|1}(dx|x_{1})\quad\Rightarrow\quad x\sim p_{t}(dx). (1) GM trains a Markov process (X_{t}^{\theta})_{0\leq t\leq 1} , parameterized by a neural network, to match the marginal probability path p_{t} . After training, the induced probability path of the Markov process aligns with p_{t} , enabling sampling from p_{\text{target}}=p_{1} by simulating the trained process X_{t}^{\theta} . Generators. A generator characterizes a CTMP through the expected change of a test function f:S\rightarrow\mathbb{R} in an infinitesimal time frame. It is a linear operator defined as: \mathcal{L}_{t}f(x)=\left.\frac{d}{dh}\right\rvert_{h=0}\mathbb{E}_{X_{t+h}\sim p_{t+h|t}(\cdot|x)}[f(X_{t+h})]=\lim_{h\rightarrow 0}\frac{\mathbb{E}_{X_{t+h}\sim p_{t+h|t}(\cdot|x)}[f(X_{t+h})]-f(x)}{h}, (2) where p_{t+h|t} denotes the transition kernel of Markov process X_{t} . If two Markov processes X^{1} and X^{2} have identical generators \mathcal{L}_{t}^{1} and \mathcal{L}_{t}^{2} , the processes are equivalent. Linear parametrization of generators. For commonly used Markov processes, e.g., diffusion, flow, and jump processes, the generator can be linearly parameterized as \mathcal{L}_{t}f(x)=\langle\mathcal{K}f(x),F_{t}(x)\rangle_{V} where \mathcal{K} is an operator fixed for each type of Markov process, V is a vector space, and F_{t}(x)\in V is the parameterization. For example, F_{t}=u_{t} for flow model with ODE dx=u_{t}(x)dt , F_{t}=\sigma_{t}^{2} for diffusion with SDE dx=\sigma_{t}(x)dw , or F_{t}=Q_{t} for discrete jump with transition rate matrix Q_{t}(y,x) described by the Kolmogorov equation \partial_{t}p_{t}(y)=\sum_{y\in S}Q_{t}(y,x)p_{t}(x) . Marginalization trick. The key idea of GM is to express a marginal generator \mathcal{L}_{t} that generates probability path p_{t} by conditional generator \mathcal{L}_{t|1}^{x_{1}} for the conditional probability path p_{t|1}(\cdot|x_{1}) . This leads to the expression of the parameterization F_{t} for

Read the complete text