Diffusion-warm sampling of the XY model enables fast thermalization at scale
Sehmimul Hoque, Roger Melko, Pooya Ronagh · 2026
Read Diffusion-warm sampling of the XY model enables fast thermalization at scale by Sehmimul Hoque, Roger Melko, Pooya Ronagh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30773.txt.
Introduction
Sehmimul Hoque, Roger Melko and Pooya Ronagh use a generative model to warm-start simulations of a classic magnet model. The XY model places continuous spins on a lattice and underlies phenomena from magnets to superfluids. Markov chain Monte Carlo, the standard sampler, explores such continuous landscapes slowly, and reaching equilibrium can take very long. Worse, chains trained behaviour does not transfer across lattice sizes.
The team train a diffusion model, conditioned on temperature, on small XY lattices only. The model then generates plausible states for much larger lattices directly. A few Monte Carlo steps polish those generated states into accurate samples, judged by spin correlations and other physical observables. Compared with random starts, diffusion-warm sampling cut thermalization time by about an order of magnitude. The authors present the result as evidence that such models can help study continuous condensed-matter systems at scale.
Catalog record
| CREATOR | Sehmimul Hoque, Roger Melko, Pooya Ronagh |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30773
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Diffusion-warm sampling of the XY model enables fast thermalization at scale Sehmimul Hoque, Roger Melko, Pooya Ronagh Abstract We introduce a novel technique for scalable sampling of spin-system states with continuous symmetries using diffusion models. By applying our approach to the XY model, a fundamental continuous-spin model in condensed matter physics, we show that our technique addresses the shortfalls of the Markov chain Monte Carlo (MCMC) in generalization to varying system sizes. More specifically, we show that training a temperature-conditioned diffusion model on smaller-size XY model lattices enables the generation of accurate samples in larger lattice sizes. By tracking physically important observables of the model, such as spin correlations, our experiments demonstrate that diffusion sampling followed by a few MCMC steps reduces the thermalization time by an order of magnitude relative to the standard MCMC with random initialization. Our study provides valuable insight as to how generative models can be used to study continuous-state condensed matter systems at scale. I Introduction Physical systems often exhibit continuous degrees of freedom. This includes lattice models in condensed matter physics, gauge theories, molecular conformational searching, and many other optimization settings involving continuous spins, fractional current and voltage values, etc. So far, computational physicists have developed many efficient algorithms for simulating equilibrium and non-equilibrium dynamics of physical systems with discrete state spaces (such as the Ising model 17 , Potts models 29 , clock model 19 , etc.). However, these methods struggle to explore continuous-variable landscapes effectively. Moreover, in many such systems the continuous degrees of freedom have a periodic nature, which further confuses exploration strategies relying on local information and local moves, such as gradient-based or other convex optimization techniques. The 2D XY model is a fundamental spin model in condensed matter physics where the spins can take continuous values between 0 to 2\pi on a two dimensional lattice. It exhibits a Berezinskii-Kosterlitz-Thouless phase transition and has been studied extensively using numerical and analytical tools 21 ; 8 . The XY model is a fundamental model of magnetization in devices and materials, as well as superfluids and superconducting systems 10 ; 24 . Additionally the XY model has been associated with complex valued neural networks, implying that efficient sampling from XY model can have potential applications in neural network training 25 ; 39 . The anticipated high impact of solving the XY model efficiently has even led to the advent of special-purpose computers for simulating them using various species of coherent bosonic networks 39 ; 41 ; 38 . In this paper, we focus on simulating the equilibrium dynamics of the XY model. A central yet computationally intractable problem in this setting is Gibbs sampling, wherein, given an energy function E(x) corresponding to system configurations x , and an ambient temperature T>0 , the task is to generate high-quality independent samples from the distribution p(x)=e^{-E(x)/T}/\mathcal{Z} where the normalization constant \mathcal{Z} is the partition function . The standard approach to generate such independent Gibbs samples from the XY model is Markov Chain Monte Carlo using Wolff steps 5 ; 40 . However, MCMC can struggle with very long thermalization times, defined as the time taken for the Markov Chain to evolve from its initial random state to its stationary equilibrium distribution 6 ; 31 . Figure 1 : The figure demonstrates samples generated from the diffusion model provide an efficient warm start for MCMC, substantially reducing the thermalization time required to reach equilibrium configurations in large XY model systems. The diffusion model was trained on 20\times 20 XY model samples on a grid of temperatures ranging from \beta=0.5 to \beta=1.6 . Left panel: Energy per spin (blue) and helicity modulus (purple) compared against MCMC steps for randomly initialized samples (solid lines) versus samples initialized from the trained diffusion model (dashed lines) for a 60\times 60 system at \beta=1.5 . The system initialized using the diffusion samples thermalizes in very few MCMC steps, demonstrating that the diffusion samples are a very good warm start for MCMC. The dashed vertical lines show the steps when the observables initialized in the two different ways converge. Right panel: Total runtime for thermalization at different temperatures across the phase transition plotted against system size for pure MCMC and the diffusion-warmed MCMC method. The shaded area represents the standard deviation error bars in thermalization time. In the diffusion-warmed MCMC method, the trained diffusion model is used to do inference starting from random configurations and then a few steps of MCMC are done until thermalization (see Appendix A for details on computing thermalization time). This demonstrates approximately one order of magnitude speedup in thermalization time using diffusion-warmed MCMC method compared to the pure MCMC method. Machine learning has been explored for Gibbs sampling of the XY model to accelerate sampling by training neural networks to approximate the target Boltzmann distribution 22 . Models trained on data from fixed or multiple lattice sizes can generate accurate samples within the training regime, but often struggle to generalize to larger system sizes 9 . In particular, extrapolation beyond the training size can lead to exponentially growing errors 22 , which limits reliable Gibbs sampling for larger systems. Another approach to generate Gibbs samples from the XY model is by variational training where a model is trained without data. Variational training is generally done by importance sampling where samples are generated by the model during different steps of training and then weights are assigned depending on the probability of the sample and the Gibbs density 3 ; 26 . However, these models suffer from mode collapse in multimodal and high dimensional systems where some modes dominate the importance weights and thus causing low probability regions to be under represented 23 . Furthermore, the density of the samples produced by the model is also not readily available for some models and thus requires estimation of the density which can be computationally expensive. This can make training such models unstable and computationally very expensive. In this work we propose a different approach to obtain accurate samples from the Gibbs distribution for different system sizes overcoming both of the challenges stated above. We show that by training a rotationally invariant conditional diffusion model on a small 20\times 20 lattice system, we can perform inference at larger systems with small number of MCMC steps to obtain accurate samples. We call this method diffusion-warmed MCMC. Our main result is that diffusion-warmed MCMC reduces the thermalization time by around an order of magnitude compared to standard MCMC methods across all the system sizes and temperatures we have studied. In Fig. 1 we demonstrate this reduction in thermalization time across different temperatures and systems sizes using the diffusion-warmed MCMC method versus pure MCMC. In both cases, we start for 1000 randomly initialized configurations. We also investigate why a naive extrapolation in system size without any MCMC steps does not allow us to produce accurate samples from the XY model. Additionally, we compare our technique against a tiling baseline that constructs larger lattices by repeating small-lattice samples. Our experiments show that tiling underestimates long-range correlations and introduces artificial artifacts (more discussion on this is given in Appendix C ). Our diffusion-warmed MCMC method introduces a novel way to accelerate equilibration in XY models