DMFT analysis of Hopfield network with plasticity Preprint: APS/123-QED
Yoshinori Hara, Yoshiyuki Kabashima · 2026
Read DMFT analysis of Hopfield network with plasticity Preprint: APS/123-QED by Yoshinori Hara, Yoshiyuki Kabashima (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22254.txt.
Introduction
Hara and Kabashima analyse a fully connected Hopfield memory network where neural states and synapses change together during recall. Using dynamical mean-field theory, they reduce the many-body dynamics to a single-site process with coloured noise and delayed feedback. Moderate plasticity widens the recall basin and raises the maximum memory load. Too much plasticity, however, imprints the flawed starting cue itself and creates false attractors. An optimal plasticity strength therefore balances stabilisation against premature cue imprinting.
Catalog record
| CREATOR | Yoshinori Hara, Yoshiyuki Kabashima |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60309 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22254
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DMFT analysis of Hopfield network with plasticity Preprint: APS/123-QED Yoshinori Hara, Yoshiyuki Kabashima Abstract We study a fully connected Hopfield-type associative memory network with online activity-dependent synaptic plasticity, where neural states and synaptic couplings coevolve during retrieval. Using the generating-functional formalism, we derive a dynamical mean-field theory (DMFT) in the large-system limit with extensively many stored random patterns, and show that the many-body dynamics reduces to an effective single-site stochastic process with colored Gaussian crosstalk noise and delayed feedback terms. Numerical solutions of the DMFT equations agree well with direct simulations. We find that moderate plasticity enlarges the basin of attraction and increases the maximum retrievable memory load by generating a positive delayed feedback that stabilizes retrieval against crosstalk noise. However, excessively strong plasticity causes the network to imprint the imperfect initial cue itself, leading to spurious attractors and degraded retrieval performance. Consequently, an optimal plasticity strength emerges from the trade-off between memory stabilization and premature cue imprinting. These results extend the DMFT description of associative memory to networks with coevolving neural and synaptic dynamics. . I Introduction In classical theories of associative memory and working memory, synaptic couplings have generally been treated as fixed on the timescale of retrieval Hopfield1982 , or at least as changing much more slowly than neuronal states Amari1972 . This separation of learning and retrieval also underlies recent attempts to improve Hopfield-type networks by modifying the coupling matrix, such as unlearning and Daydreaming algorithms, where the couplings are optimized before retrieval and then treated as fixed interactions during the retrieval dynamics Serricchio2025 ; Doi2026 ; takeuchi2026 . A typical example is the Hopfield-type associative memory model with nontrivial fixed points, in which couplings embedded by Hebbian learning act as quenched disorder and only the neurons evolve in time. Within this framework, statistical mechanics has achieved major success in describing macroscopic properties such as memory capacity, basins of attraction, and spin-glass-like behavior Hopfield1982 ; PhysRevLett.55.1530 . Likewise, in the context of working memory, the view that information is maintained by persistent firing has long provided a standard theoretical foundation MAJOR2004675 . In this sense, the separation of timescales between neurons and synapses has been an extremely powerful theoretical approximation. In recent years, however, the validity of adopting this clear separation of timescales as a general principle has been reexamined. For example, studies of short-term synaptic plasticity and spike-timing-dependent plasticity have shown that synapses are not always static variables evolving sufficiently slowly compared with neural activity, and that at least some synaptic processes can change on timescales that overlap with neuronal computation Tsodyks1997 ; Bi10464 ; Zucker2002 . Therefore, although the timescale separation assumed in classical theory remains a useful approximation, it can no longer be regarded as a self-evident premise for all phenomena of memory and learning. This point is illustrated most clearly by a series of studies showing that synaptic efficacy can reflect recent neural activity in real time. The Tsodyks–Markram type of short-term plasticity formalized how synaptic responses change in a history-dependent manner on timescales ranging from a few milliseconds to several hundred milliseconds through depletion and recovery of available synaptic resources, thereby showing that synapses are not merely fixed transmission coefficients but possess their own internal dynamical states Tsodyks1997 . Ref. Gianluigi2008 theoretically proposed that working-memory contents can be retained through synaptic traces generated by short-term facilitation even in the absence of sustained high firing, providing a representative early example of what was later called “activity-silent” working memory. In addition, Ref. Bittner2017 showed that hippocampal CA1 place fields can be formed in a single or a few trials through behavioral timescale synaptic plasticity on the timescale of seconds, and Ref. Milstein2021 showed that the same mechanism can bidirectionally reconfigure preexisting place fields. These results suggest that, at least in the hippocampus, synaptic updates do not depend solely on offline consolidation but can directly participate in the formation and updating of neural representations during behavior. Against this experimental background, a theoretical framework that explicitly treats synaptic states as dynamical variables coupled to neural activity becomes compelling, at least in some situations, rather than one that strictly separates neuronal and synaptic states into distinct temporal hierarchies. Indeed, since Ref. Tsodyks1998 , it has been discussed that recurrent networks with short-term depression and facilitation exhibit macroscopic dynamics qualitatively different from those of systems with fixed couplings. In associative-memory models as well, studies beginning with Ref. Pantic2002 have examined how dynamic synapses modify memory phases, capacity, transitions between attractors, and stability. For example, Ref. Mejias2009 analyzed capacity, Ref. Otsubo2010 analyzed attractor switching, and Ref. Katori2013 analyzed bifurcation structure. Furthermore, Ref. Igarashi2010 showed that synaptic depression can generate new oscillatory states in more general recurrent and ring networks. These studies show that activity-dependent changes in synaptic efficacy can alter memory phases, storage capacity, attractor stability, and switching dynamics. They include fully connected associative-memory networks as well as uniform and ring-attractor networks with dynamic synapses. However, they mainly analyze short-term depression and/or facilitation through low-dimensional or sublattice mean-field descriptions, often focusing on steady states, storage capacity, bifurcation structure, or attractor switching. They are therefore different from the present setting, where a fully connected Hopfield-type associative memory is supplemented by online Hebbian plastic couplings that coevolve with the retrieval dynamics. What remains less explored is a DMFT description of fully connected associative-memory models in which neuronal states and online plastic couplings evolve with comparable time constants during retrieval. For coupled neuronal–synaptic dynamics in random recurrent networks, Ref. Clark2024 showed that synaptic dynamics not only modify collective dynamics but can, in some regimes, dominate them, and thereby provided a new phase diagram. In this sense, that work is the most direct precursor to the present study because it made clear on theoretical grounds that synapses should be treated not merely as slow background variables but as dynamical degrees of freedom on an equal footing with neurons. Meanwhile, as a recent reference system for dense-network DMFT specialized to associative memory, the analysis presented in Ref. Kabashima_2026 for a nonplastic fully connected associative-memory model is important. Although their study does not address plasticity itself, it provides a methodological benchmark for the present work in terms of the construction of DMFT for fully connected associative memory, the numerical solution of the effective single-site process, and the comparison with direct simulations. Taken together, what is currently needed is a theory that bridges, at the level of fully connected associative memory, the gap between classical fixed-synapse attractor memory and the online synaptic dynamics suggested by short-term plasticity and plasticity operating on behavioral timescales. In this study, we consider an associative-memory network with fully connected Hebbian couplings supplemented by plastic couplings that are updated in real time according to neural activity, so that neuronal variables and synaptic variables coevolve with comparable time constants. In particular, we focus on situations in which synaptic updates proceed during the retrieval process itself, so that the coupling structure, conventionally regarded as fixed, is deformed on the fly. For this system, we construct a dynamical mean-field theory in the fully connected limit and compare numerical solutions based on the effective single-site process with direct simulations, thereby clarifying how plasticity affects memory retrieval and the basins of attractors. In this way, we