Finite-size scaling of hetero-associative retrieval in continuous-signal-driven Ising spin systems

Andrea Ladiana · 2026

Read Finite-size scaling of hetero-associative retrieval in continuous-signal-driven Ising spin systems by Andrea Ladiana (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14059.txt.

Introduction

Ladiana links smooth real-world signals to discrete Ising-spin recall memory. Real signals are smooth and high-dimensional, while recall memory math runs on discrete spins. A layered Ising frame joins a shape-keeping signal-to-spin coder, PCA whitening plus SimHash random-plane projection, to Kanter-Sompolinsky pseudo-inverse memory links in a tri-layer hetero-associative system. The pseudo-inverse tweak tips the equal-weight mix state, so heat noise breaks cross-modal symmetry and picks one global winner.

Catalog record

CREATORAndrea Ladiana
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE91749
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14059

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Finite-size scaling of hetero-associative retrieval in continuous-signal-driven Ising spin systems Andrea Ladiana Abstract Real-world physical signals are continuous and high-dimensional, yet the statistical-mechanics machinery of associative memory operates on discrete Ising spins. We bridge this divide through a multilayer Ising framework that couples a geometry-preserving continuous-to-Ising encoder (PCA whitening composed with SimHash random-hyperplane projection) to Kanter–Sompolinsky pseudo-inverse memory couplings, embedded directly into the local-field equations of a tri-layer hetero-associative system. The pseudo-inverse correction renders the equal-weight mixture state thermodynamically unstable, so that thermal fluctuations break the cross-modal symmetry and select a single global winner. We further establish a dynamical duality: parallel (Little) updates are structurally required to ignite the cross-modal signal avalanche from a single cued layer, whereas sequential (Glauber) sweeps resolve symmetric superpositions. The operational storage capacity obeys the Amit–Gutfreund–Sompolinsky finite-size correction α c ( N ) = α c ( ∞ ) − c N − 1 / 2 \alpha_{c}(N)=\alpha_{c}(\infty)-c\,N^{-1/2} , extrapolating to an asymptotic operational limit α c ​ ( ∞ ) ≈ 0.50 \alpha_{c}(\infty)\approx 0.50 under macroscopic-basin retrieval. Applied to multi-channel sleep polysomnography (PhysioNet Sleep-EDF), the architecture reconstructs the macroscopic sleep state on parietal EEG and EOG axes from a single noisy frontal-EEG cue, demonstrating cross-modal recall in the presence of quenched biological disorder. I Introduction Content-addressable memory—the recovery of a complete stored record from a partial or degraded cue—is a cornerstone of neural computation and a paradigmatic problem in the statistical mechanics of disordered systems. The Hopfield model Hopfield 1982 demonstrated that binary patterns in \{-1,+1\}^{N} can be stored as fixed-point attractors of an energy landscape shaped by Hebbian couplings, while Little’s earlier stochastic formulation Little 1974 cast the same architecture in the language of equilibrium statistical mechanics through parallel probabilistic updates. The storage capacity of these networks was rigorously characterised by Amit, Gutfreund and Sompolinsky Amit et al. 1985 ; Amit et al. 1987 , who established the threshold \alpha_{c}\approx 0.138 patterns per spin for Hebbian learning. Projection learning rules Personnaz et al. 1986 and their Kanter–Sompolinsky variant Kanter and Sompolinsky 1987 raised this bound toward \alpha_{c}=1 by eliminating inter-pattern cross-talk, at the cost of requiring global knowledge of all stored patterns; dreaming-based consolidation procedures Fachechi et al. 2019 ; Agliari et al. 2019 ; Agliari et al. 2024a ; Agliari et al. 2024b provide a complementary route to higher capacity through iterative suppression of spurious attractors. Dense associative memories Krotov and Hopfield 2016 ; Demircigil et al. 2017 and the identification of Hopfield dynamics within transformer attention layers Ramsauer et al. 2021 have recently reignited interest in energy-based retrieval, reframing the learning problem through the lens of statistical mechanics Bahri et al. 2020 ; Zdeborová and Krząkała 2016 ; sparse distributed representations Kanerva 1988 provide a complementary pathway through high-dimensional binary codes. Across all these advances, however, a single interface problem persists: real-world signals are continuous and high-dimensional, while the retrieval machinery operates on discrete Ising spins. Hetero-associative architectures address a complementary limitation. Where autoassociative models store and recall within a single spin population, hetero-associative networks couple two or more populations, each representing a distinct “view” of the same physical observable. Kosko’s Bidirectional Associative Memory Kosko 1988 first formalised this idea for two layers, showing that stable recall arises from the same energy-descent principle as in Hopfield networks but across two distinct pattern spaces: a cue presented to one layer drives the other toward the matching stored pattern, enabling cross-modal completion. Multi-species spin-glass analyses Barra et al. 2015 subsequently provided a rigorous thermodynamic foundation for architectures with an arbitrary number of interacting populations, generalising the classical single-species phase diagram. More recent work has characterised the thermodynamics of bidirectional memories Barra et al. 2023 , established rigorous capacity bounds for generalised hetero-associative architectures Agliari et al. 2025 , and developed both supervised and unsupervised learning protocols Alessandrelli et al. 2025 . The tri-layer system we study, with populations (\sigma,\tau,\phi) coupled pairwise, is the simplest non-trivial extension beyond two-layer BAM and supports three-way cross-modal completion from a single partial cue. Coupling continuous signals to a binary associative memory raises three concrete obstacles. First, naive binarisation (e.g. thresholding) discards the metric structure of the data: two nearby points in feature space may map to distant spin configurations. Classical symbolic representations such as SAX Lin et al. 2003 address this obstacle for scalar time series, but do not preserve angular neighbourhood geometry in high-dimensional feature space; alternative approaches keep memories in continuous state space Millidge et al. 2022 and bypass binarisation entirely, at the cost of leaving the Ising framework and its statistical-mechanics tractability. Second, empirical class-mean archetypes computed in spin space inherit inter-class correlations from the encoding, causing retrieval basins to overlap and merge—a failure mode we term basin collapse . Third, temporal signals are highly sensitive to phase shifts: standard sequence flattening maps identical, time-shifted sequences to orthogonal spin vectors, precluding shift-invariant retrieval. To resolve these obstacles systematically, we develop a modular three-stage framework. The continuous-to-Ising encoder (Sec. II.1 ) composes phase-invariant preprocessing (e.g. the Short-Time Fourier Transform), PCA whitening, and random-hyperplane hashing (SimHash Khan and Ali 2015 ; Charikar 2002 ) into a map from continuous vectors to Ising spins that preserves angular neighbourhood structure with sub-Gaussian overlap fluctuations of standard deviation O(N^{-1/2}) . Archetype extraction with coupling correction (Secs. II.2 – II.3 ) combines majority-vote archetypes with Kanter–Sompolinsky Kanter and Sompolinsky 1987 pseudo-inverse couplings to eliminate inter-pattern cross-talk. Multilayer retrieval dynamics (Sec. III ) injects the pseudo-inverse correction inside the local field of a generic L -layer hetero-associative system, and operates it via stochastic Monte Carlo updates with simulated annealing Kirkpatrick et al. 1983 ; we specialise to L=3 throughout the numerical experiments. The investigation that follows maps the thermodynamic phase crossovers of the system, quantifies the finite-size scaling of its storage capacity, and characterises the stochastic structure of spontaneous symmetry breaking during the disentanglement of superposed memory states. Crucially, to demonstrate that these mechanisms are not artefacts of identically distributed synthetic noise, we apply the framework to multi-channel physiological sleep recordings, showing successful cross-modal hetero-associative retrieval in the presence of strong, correlated biological disorder. Where quantitative claims are made, we accompany them with operational definitions, confidence intervals, and explicit baselines; where a behaviour cannot be rigorously established, we report empirical estimates and refrain from overstating their asymptotic content. II The Encoding Framework II.1 Continuous-to-Ising encoding Let \bm{x}\in\mathbb{R}^{d\times T} be a multivariate sequence with d channels and T time steps. To address the phase sensitivity of temporal signals, \bm{x} may first be mapped to a phase-invariant representation, such as the magnitude spectrum of a Short-Time Fourier Transform (STFT) (detailed in Sec. IV.7 ). We then flatten the (transformed or raw) sequence to a vector \bm{v}\in\mathbb{R}^{D} , with D=dT for the raw flattening; throughout, symbols with index superscripts (e.g. \xi^{\mu} ) denote pattern-indexed quantities, whereas \bm{\bar{v}} denotes the training-set mean. The four-step encoding then reads: 1. Centering: \bm{v}_{c}=\bm{v}-\bm{\bar{v}} . 2. PCA projection and whitening: \bm{z}=\Lambda^{-1/2}V\bm{v}_{c}\in\mathbb{R}^{d_{\mathrm{eff}}} , where V\in\mathbb{R}^{d_{\mathrm{eff}}\times D} contains the top eigenvectors and \Lambda=\mathrm{diag}(\lambda_{1},\ldots,\lambda_{d_{\mathrm{eff}}}) their eigenvalues. 3. Random-hyperplane projection: \bm{h}=H\bm{z}\in\mathbb{R}^{N} , where H\in\mathbb{R}^{N\times d_{\mathrm{eff}}} has i.i.d. \mathcal{N}(0,1) entries. 4. Sign binarisation: \bm{s}=\mathrm{sign}(\bm{h})\in\{-1,+1\}^{N} . The composite map is s(\bm{v})=\mathrm{sign}\!\big(H\Lambda^{-1/2}V(\bm{v}-\bm{\bar{v}})\big)\;\in\;\{-1,+1\}^{N}. (1) When more than one encoder is used (Sec. III ) we write s_{\ell}(\bm{v}) for

Read the complete text