Content-Addressable Memory with a Content-Free Energy Function

Félix Benoist, Luca Peliti, Pablo Sartori · 2025

Read Content-Addressable Memory with a Content-Free Energy Function by Félix Benoist, Luca Peliti, Pablo Sartori (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-18822.txt.

Introduction

Félix Benoist, Luca Peliti, and Pablo Sartori asked in 2025 whether a memory can be held in motion rather than in rest. A content-addressable memory gives back a stored pattern from a partial cue. Classic neural models store patterns as low spots in an energy map. Living chemistry, though, seems to sort facts by pure timing rules, with no such map.

Their spare model stores patterns in the paths of its kinetics, its rates of change, in place of energy lows. Called on a cue, it falls into a kinetic trap that holds the right pattern. Scores matched the classic energy stores in their tests. The team frames trap steadiness in time as a true peer to rest-state steadiness for computing in matter.

Catalog record

CREATORFélix Benoist, Luca Peliti, Pablo Sartori
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-18822

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Content-Addressable Memory with a Content-Free Energy Function Félix Benoist, Luca Peliti, Pablo Sartori Abstract Content-addressable memory, i.e. stored information that can be retrieved from content-based cues, is key to computation. Besides natural and artificial neural networks, physical learning systems have recently been shown to have remarkable ability in this domain. While classical neural network models encode memories as energy minima, biochemical systems have been shown to be able to process information based on purely kinetic principles. This raises the question of whether neural networks can also encode information kinetically. Here, we propose a minimal model for content-addressable memory in which the kinetics, and not the energy function, are used to encode patterns. We find that the performance of this kinetic encoding is comparable to that of classical energy-based approaches. This highlights the fundamental significance of the kinetic stability of kinetic traps as an alternative to the thermodynamic stability of energy minima, offering new insights into the principles of computation in physical and synthetic systems. Introduction. The ability to recover multiple memories from cues of their content is a fundamental computation performed by natural and artificial neural networks [ 1 , 2 , 3 ] . The physical modeling of such a computational ability was pioneered by J.J. Hopfield in his celebrated 1982 article [ 4 ] , which introduced an energy-based model for content-addressable memory. In this model, memories are modeled as patterns of activation of a fully-connected network of binary units representing neurons. The patterns are encoded via a set of energetic couplings and correspond to minima in the energy landscape of the network. Provided low crosstalk between patterns, each pattern can be retrieved via asynchronous updates from a content cue through equilibrium relaxation [ 5 , 2 ] . In recent years, the performance of Hopfield networks has been significantly improved [ 6 ] , with modern versions showing promising results in machine learning [ 7 , 8 , 9 , 3 , 10 ] . More realistic networks of spiking neurons are also the subject of intense research in the context of biological neural computation [ 11 , 1 , 12 ] . Besides neurons, Hopfield-like encoding schemes have been used in models of biological liquid mixtures [ 13 ] , multi-component self-assembly [ 14 , 15 , 16 ] and regulatory networks [ 17 ] . Figure 1: Schematics of kinetic encoding setup. A. In energetic encoding, the pattern state is preferred due to its lower energy. B. In kinetic encoding, the pattern state is discriminated from other states with the same energy via the lower kinetic barriers along its pathway. C. N=8 fully-connected units encode P=3 activity patterns. The retrieval of pattern \mu=1 corresponds to overlap values (m_{1},m_{2},m_{3})=(1,0,0) and activity m=0 . D. Sketch of the energy diagram for the retrieval of pattern \mu=1 from a state with only -1 errors (black minus signs) besides the cue (green plus and minus signs). Going down in energy, the system can either create a +1 error (left transition) or correct a -1 error (right transition), the latter being kinetically favored. Although there are many variants of Hopfield networks, patterns are always encoded as minima of an energy landscape [Fig. 1 A]. Instead, we propose a fundamentally new encoding approach based on tuning the kinetics of the pathways leading to the patterns; see Fig. 1 B. In this framework, each pattern becomes a kinetic trap, which can only be retrieved transiently. Therefore, patterns are not more stable than other states but are more kinetically accessible. Although such kinetic encoding has already been used to differentiate binding partners in copolymerization [ 18 , 19 , 20 ] and self-assembly processes [ 21 ] , in molecular error correction [ 22 , 19 , 23 ] , and in frenetic steering of random walkers [ 24 ] , it is so far absent from Hopfield neural networks. We anticipate that this kinetic approach results in a functional content-addressable memory network with capacity comparable to traditional Hopfield networks, along with unique features, such as glassy behavior [ 25 , 26 ] . Content-addressable memory. Consider N interacting binary units indexed i=1,\dots,N , which represent neurons in a neural network. Each unit can be active or inactive, which we characterize by its activity value, \sigma_{i}=+1 or -1 , respectively. Among the 2^{N} system configurations, we select P “pattern states” with random activities denoted \xi_{i}^{\mu} , \mu=1,\dots,P and null mean; see Fig. 1 C. We quantify similarity between an arbitrary state and pattern \mu through the overlap m_{\mu}=\sum_{i}\sigma_{i}\xi_{i}^{\mu}/N , which generalizes the activity m=\sum_{i}\sigma_{i}/N . We consider a dynamics satisfying detailed balance, such that the transition rate from state \bm{\sigma}=(\sigma_{1},\dots,\sigma_{i},\dots,\sigma_{N}) to \bm{\sigma}^{\prime}=(\sigma_{1},\dots,-\sigma_{i},\dots,\sigma_{N}) is given by k(\bm{\sigma}\to\bm{\sigma}^{\prime})=\frac{\omega(\bm{\sigma},\bm{\sigma}^{\prime})}{1+\exp(\beta\Delta E(\bm\sigma,\bm\sigma'))}. (1) Here, \beta is the inverse temperature, \omega(\bm{\sigma},\bm{\sigma}^{\prime})=\omega(\bm{\sigma}^{\prime},\bm{\sigma}) is a bare kinetic rate, and \Delta E=\mathcal{H}(\bm{\sigma}^{\prime})-\mathcal{H}(\bm{\sigma}) is the energy difference, where \mathcal{H} is the system’s Hamiltonian. Note that the energy differences and the bare kinetic rates have different symmetries: Whereas \omega(\bm{\sigma}^{\prime},\bm{\sigma}) is even in the exchange \bm{\sigma}\leftrightarrow\bm{\sigma}^{\prime} , one has \Delta E(\bm{\sigma}^{\prime},\bm{\sigma})=-\Delta E(\bm{\sigma},\bm{\sigma}^{\prime}) . A model for content-addressable memory provides expressions for \omega(\bm{\sigma},\bm{\sigma}^{\prime}) and \mathcal{H}(\bm{\sigma}) that ensure pattern retrieval. That is, if the system is initialized with a cue for pattern \mu=1 , i.e. , in a state for which m_{1} is small but non-zero and m_{\mu\neq 1}\ll m_{1} , then the system should evolve over time toward pattern 1: \bm{\sigma}=(\xi_{1}^{1},\dots,\xi_{N}^{1}) . In this pattern state, m_{1}=1 and m_{\mu\neq 1}\approx 0 , due to the near-orthogonality of patterns for large N [ 2 ] . Energetic encoding. In classical Hopfield networks, neurons are coupled via a matrix J_{ij} that encodes the P patterns [ 4 , 2 ] : J_{ij}=\frac{1}{N}\sum_{\mu=1}^{P}\xi_{i}^{\mu}\xi_{j}^{\mu}. (2) The Hamiltonian of the network is then defined as \mathcal{H}(\bm{\sigma})=-\frac{1}{2}\sum_{i,j\neq i}J_{ij}\sigma_{i}\sigma_{j} . At low temperature, \beta>1 , this setup ensures pattern retrieval provided that P<P_{\rm max} , with P_{\rm max}\sim N [SM Sec. S1 ]. Moreover, including higher-order couplings beyond the pairwise couplings of Eq. ( 2 ) leads to a dramatic increase in encoding capacity [ 27 , 28 , 29 ] . Crucially, this encoding is such that, for P<P_{\max} , the patterns are minima of \mathcal{H} . Since the original Hopfield network considered the limit \beta\to\infty , there was no discussion of bare kinetic rates. Later works at finite temperature [ 5 , 30 ] , as well as recent advances in energy-based models [ 27 , 9 , 29 ] , all assume \omega(\bm{\sigma},\bm{\sigma}^{\prime})=1 , so that all information encoding is energetic, i.e. engraved in the Hamiltonian. Kinetic encoding. We now provide an alternative approach to encoding patterns in Hopfield networks. We choose a Hamiltonian that is independent of the couplings J_{ij} defined in Eq. ( 2 ), but we let these couplings determine the bare kinetic parameters. Specifically, we set \displaystyle\beta\mathcal{H}(\bm{\sigma})=\frac{N}{2}K|m(\bm{\sigma})|, (3) where K\geq 0 is the energetic drive in units of \beta^{-1} . The 2^{N/2} states with zero activity, m=0 , are states of minimal energy, among which the P patterns need to be discriminated. To this end, we choose the bare kinetic parameters such that transitions that increase the overlap with the patterns are accelerated. In particular, we set \omega(\bm{\sigma},\bm{\sigma}^{\prime})=\begin{cases}1,&\text{if }\ h_{i}\geq 0,\\ \exp(-Q),&\text{if }\ h_{i}<0,\end{cases} (4) where

Read the complete text