Dreaming up scale invariance via inverse renormalization group
Adam Rançon, Ulysse Rançon, Tomislav Ivek, Ivan Balog · 2025
Read Dreaming up scale invariance via inverse renormalization group by Adam Rançon, Ulysse Rançon, Tomislav Ivek, Ivan Balog (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-04016.txt.
Introduction
Coarse maps of a system hide fine detail, and physics has a classic method for stepping between scales. Adam Rançon and co-authors run that method in reverse with tiny neural networks in a 2025 paper. Their nets dream up fine states of a magnet model from coarse ones, a task with no exact answer.
Even a net with three tunable numbers learned to make states at the balance point of the model. The made states matched key traits, from heat uptake to a standard ratio test. A scale check confirmed the nets caught the deep rules of the balance point. More layers gave no real gain. Simple local rules may hold the core of scale-free behavior.
Catalog record
| CREATOR | Adam Rançon, Ulysse Rançon, Tomislav Ivek, Ivan Balog |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-04016
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Dreaming up scale invariance via inverse renormalization group Adam Rançon, Ulysse Rançon, Tomislav Ivek, Ivan Balog Abstract We explore how minimal neural networks can invert the renormalization group (RG) coarse-graining procedure in the two-dimensional Ising model, effectively “dreaming up” microscopic configurations from coarse-grained states. This task—formally impossible at the level of configurations—can be approached probabilistically, allowing machine learning models to reconstruct scale-invariant distributions without relying on microscopic input. We demonstrate that even neural networks with as few as three trainable parameters can learn to generate critical configurations, reproducing the scaling behavior of observables such as magnetic susceptibility, heat capacity, and Binder ratios. A real-space renormalization group analysis of the generated configurations confirms that the models capture not only scale invariance but also reproduce nontrivial eigenvalues of the RG transformation. Surprisingly, we find that increasing network complexity by introducing multiple layers offers no significant benefit. These findings suggest that simple local rules, akin to those generating fractal structures, are sufficient to encode the universality of critical phenomena, opening the door to efficient generative models of statistical ensembles in physics. I Introduction Universal behavior near critical points is a cornerstone of statistical physics. In systems undergoing second-order phase transitions, observables such as correlation functions and susceptibilities exhibit power-law scaling that is largely independent of microscopic details. The renormalization group (RG) framework elegantly explains this universality by describing how short-range fluctuations are systematically averaged out to reveal long-range scale-invariant properties Wilson and Kogut 1974 . Yet, this very process of coarse-graining is inherently lossy and one-way: RG eliminates information about microscopic degrees of freedom and cannot, in general, be inverted. However, it bears a striking resemblance to various techniques in Deep Learning (DL) that also focus on capturing essential features while discarding superfluous details. This connection has been under intensive scrutiny recently Bény 2013 ; Mehta and Schwab 2014 ; De Mello Koch et al. 2020 ; Gordon et al. 2021 ; Gökmen et al. 2021 ; Erdmenger et al. 2022 ; Kline and Palmer 2022 ; Biroli et al. 2024 . Machine learning (ML) and DL have become foundational tools across modern science and engineering. These methods have dramatically improved the state-of-the-art in tasks ranging from image and speech recognition to drug discovery and genomics, and they have entered virtually every scientific discipline as indispensable techniques for data analysis and modeling Carleo et al. 2019 . Over the last decade, deep learning has emerged as a powerful tool for data transformation, particularly in the domain of image processing where super-resolution plays a central role in reconstructing fine-scale structures from coarse data Shi et al. 2016 ; Yang et al. 2019 . Convolutional neural networks and their generative extensions have demonstrated remarkable success in upscaling complex data structures, both in general imaging applications and in contexts where outputs must respect physical constraints Fukami et al. 2021 ; Li et al. 2021 . In particular, generative models such as Generative Adversarial Networks (GANs) Goodfellow et al. 2014 , Variational Autoencoders (VAEs) Kingma and Welling 2022 , and, more recently, diffusion models Ho et al. 2020 , have significantly advanced the ability to synthesize high-resolution, high-dimensional data from low-dimensional inputs by learning the underlying data distributions Ledig et al. 2017 ; Esser et al. 2021 ; Rombach et al. 2022 . These models enable the inference of plausible fine-grained details, yielding high-quality reconstructions that are both diverse and physically meaningful. Figure 1: Sierpiński triangle is a self-similar structure (a fractal) generated by an iterative application of a simple local rule (inset). A critical configuration of spins constitutes a fractal object as well, which leads us to explore the concept of using simple local neural networks for dreaming up critical spin configurations. This capability is naturally aligned with the challenge of inverting renormalization group (RG) transformations, which has been the focus of recent works Efthymiou et al. 2019 ; Bachtis et al. 2022 ; Shiina et al. 2021 ; Bachtis 2024a ; Bachtis 2024b , demonstrating that complex neural networks trained on small system configurations can generate configurations for larger systems that qualitatively—and sometimes quantitatively—reproduce critical behavior. At the same time, phase-characterization models have evolved from early supervised and unsupervised architectures, using techniques like principal component analysis and autoencoders to detect transitions and learn emergent order parameters directly from raw Ising spin data Wang 2016 ; Wetzel 2017 , to increasingly complex structures such as graph neural networks that encode interaction topology Ma et al. 2024 , attention‐based transformers that capture long-range correlations Kara et al. 2021 , and symmetry-equivariant architectures enforcing lattice and spin-flip invariances Chang et al. 2023 . While such approaches often greatly increase model complexity, it remains unclear if they are useful for inverting RG transformations or indeed what the minimal conditions are for a neural network to achieve scale invariance. In this work, we revisit this problem from a minimalistic perspective. Rather than employing deep or highly parameterized models, we ask: What is the simplest neural network that can learn to invert RG and reproduce scale-invariant physics ? By training single-layer convolutional networks with as few as three parameters, we show that it is possible to generate critical Ising configurations that reproduce key thermodynamic observables and universal finite-size scaling relations. Remarkably, we find that such simple models can match and in some respects outperform more complex architectures. The resulting configurations obey universal scaling laws and display stable RG eigenvalue spectra, confirming that even minimal models can learn the essential features of criticality. That a very simple network, with straightforward transformation rules, is able to produce scale invariance might not be too surprising in hindsight. Indeed, this is reminiscent of constructing fractals by local rules, such as e.g. the Sierpiński triangle, where simple iterative procedures yield complex, self-similar structures such as illustrated in Fig. 1 . Here, we focus on the Ising model, the standard model of statistical physics, known for its simplicity and rich critical behavior that makes it a classic example of universality in phase transitions. The model describes a two-dimensional lattice of spins, which interact via a Hamiltonian H(\bm{\sigma})=-K\sum_{\langle i,j\rangle}\sigma_{i}\sigma_{j}, (1) with ferromagnetic interaction K (proportional to the inverse temperature), and the sum is over nearest neighbors. This model undergoes a phase transition at a critical coupling, K_{c} , separating the paramagnetic phase, where spins are weakly correlated, from the ferromagnetic phase, where spins align. Furthermore, the physics close to the transition exhibits a universal behavior characterized by divergences in quantities such as magnetic susceptibility and heat capacity. These quantities follow power-law scaling with critical exponents that are independent of the system’s microscopic details—a hallmark of universality. Despite its simplicity, the Ising model’s critical properties are applicable to a broad class of physical systems, making it a paradigmatic example of a universality class in statistical physics. Our objective in this study is to determine whether simple neural networks, with minimal parameters, can capture the scale-invariant properties of the Ising model at criticality. We explore whether such networks can “dream up” configurations that reflect the universal characteristics of critical systems. Inspired by fractal patterns, which arise from simple, iterative rules, we focus on a minimalistic network architecture with linear filters of varying kernel sizes, assessing their capacity to learn universal