High-resolution spatial memory requires grid-cell-like neural codes
2025
Read High-resolution spatial memory requires grid-cell-like neural codes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00598.txt.
Introduction
Cotteret and co-authors show that grid-like neural codes solve a memory dilemma in this 2025 paper. Networks that hold a continuous value, such as position, in ongoing activity are fragile: noise and uneven parts blur the stored value. Chopping the range into discrete states adds robustness but caps how fine the memory can be.
The team studies sparse binary codes in which neurons respond at repeating spatial periods, like the grid cells of the brain. Theory and simulation show these codes give high stability and high resolution at once. The model extends to curved spaces such as spheres and donuts, and to movement along paths that can be programmed freely.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-00598
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
High-resolution spatial memory requires grid-cell-like neural codes Thanks: 1 Bio-Inspired Circuits and Systems (BICS) Lab, Zernike Institute for Advanced Materials, University of Groningen, Netherlands. 2 Groningen Cognitive Systems and Materials Center (CogniGron), University of Groningen, Netherlands. 3 Micro- and Nanoelectronic Systems (MNES), Technische Universität Ilmenau, Germany. 4 Redwood Center for Theoretical Neuroscience, University of California, Berkeley, USA. 5 Energy Materials and Devices, Department of Materials Science, Kiel University, Germany. Corresponding author: [email protected] Abstract Continuous attractor networks (CANs) are widely used to model how the brain temporarily retains continuous behavioural variables via persistent recurrent activity, such as an animal’s position in an environment. However, this memory mechanism is very sensitive to even small imperfections, such as noise or heterogeneity, which are both common in biological systems. Previous work has shown that discretising the continuum into a finite set of discrete attractor states provides robustness to these imperfections, but necessarily reduces the resolution of the represented variable, creating a dilemma between stability and resolution. We show that this stability-resolution dilemma is most severe for CANs using unimodal bump-like codes, as in traditional models. To overcome this, we investigate sparse binary distributed codes based on random feature embeddings, in which neurons have spatially-periodic receptive fields. We demonstrate theoretically and with simulations that such grid-cell-like codes enable CANs to achieve both high stability and high resolution simultaneously. The model extends to embedding arbitrary nonlinear manifolds into a CAN, such as spheres or tori, and generalises linear path integration to integration along freely-programmable on-manifold vector fields. Together, this work provides a theory of how the brain could robustly represent continuous variables with high resolution and perform flexible computations over task-relevant manifolds. I Introduction Persistent neural activity has been proposed as a mechanism for temporarily storing behavioural variables during the execution of tasks Fuster 1973c . Since the time duration demanded of such working memories typically exceeds the time constants of individual neurons, state persistence is believed to be an emergent network effect. Attractor networks are theoretical network models describing this behaviour, in which persistent activity states – or fixed-point attractors – are maintained by recurrent synaptic feedback Little 1974c . The dynamics in these networks can be imagined as a gradual descent of an energy function, such that energy minima correspond to stable attractor states Hopfield 1982c ; Amit 1989c . Either by construction or by learning through synaptic plasticity, the energy landscape can then be tailored to support particular behaviours. Behavioural variables are often continuous, such as head direction or one’s position in space. Accordingly, in a continuous attractor network (CAN), translational symmetries in the synaptic weights can be introduced to arrange fixed-point attractors along a low-dimensional continuum in the network’s state space, such as a line. The first generation of CANs arranged neurons in a ring, in which attractor states comprised localised unimodal activity bumps at any angle on the ring Ben-Yishai et al. 1995c ; Amari 1977c ; Zhang 1996g ; Skaggs et al. 1995c ; Samsonovich & McNaughton 1997c . We call such bump-like neural representations of a behavioural variable unimodal because each neuron is selective for a single location only, like an idealized hippocampal place cell, which responds maximally near a single unique place in an animal’s environment Moser et al. 2017c . CANs have become a popular primitive for modelling biological working memory, such as for understanding navigation in the insect central complex Green et al. 2017c ; Noorman et al. 2024c or in the hippocampal formation of vertebrates Chaudhuri et al. 2019c ; Gardner et al. 2022c ; Burak & Fiete 2009c . However, nagging questions remain as to whether and how biological neural circuits could faithfully implement CANs. A major problem is the high degree of precision and reliability that CANs require of their individual components, which is at odds with the unreliability of neurons and synapses in the brain Faisal et al. 2008c ; Bartol et al. 2015c . Fast stochastic nonidealities (e.g. from stochastic spike timing) cause random walk dynamics, known as diffusion, which degrade the accuracy of the represented variable over time Camperi & Wang 1998c ; Compte et al. 2000c ; Burak & Fiete 2012c ; Wu et al. 2008c ; Seeholzer et al. 2019c ; Wang & Kang 2022c . Fixed nonidealities (quenched noise), such as fixed synaptic heterogeneity, lead to undesired deterministic movement of the neural state, known as drift Zhang 1996g ; Seung 1996c ; Renart et al. 2003c . Diffusion and drift undermine the capability of a CAN to hold or memorise a particular value, thus defeating its utility as working memory. Introducing “roughness” to the energy landscape has been proposed as a solution to the diffusion problem, by creating a finite set of discrete attractor states that tile the idealised continuum. This mitigates diffusion by “pinning” the network to one of these states, but necessarily reduces the resolution at which a behavioural variable can be represented Kilpatrick & Ermentrout 2013g ; Brody et al. 2003c ; Chaudhuri & Fiete 2016c . Narrowing the spacing between the discrete attractor states increases the resolution but also weakens stability, ultimately allowing diffusion between the discrete states to return Kilpatrick & Ermentrout 2013g . This dilemma between resolution and stability in CANs with biologically-realistic nonidealities has cast doubt upon their adequacy to describe how brains represent and hold continuous variables over long timescales Burak & Fiete 2012c ; Khona & Fiete 2022c . We introduce a solution to this dilemma, which relies on using multimodal rather than unimodal representations of continuous variables, such as in the entorhinal cortex, where grid-cell neurons are active at multiple positions in a 2D environment Moser et al. 2017c ; Fiete et al. 2008c . Leveraging results from vector-symbolic architectures (VSAs) Kleyko et al. 2022c and sketching techniques Woodruff 2014c , we study CANs where the continuous variable is represented by a high-dimensional sparse binary vector using randomised multimodal codes. We show that the noisy kernel approximations involved in these randomized coding schemes automatically introduce energy roughness, and further that they enable a CAN with traditional Hebbian plasticity to memorise continuous variables with high resolution and high robustness at the same time. Our model suggests that multimodal entorhinal grid cells are more suitable than unimodal hippocampal place cells for supporting working memories of continuous quantities. The proposed model also generalises to embedding arbitrary nonlinear CAN manifolds with freely-programmable integration capabilities, thus potentially explaining how general manifold-based computation could be realised in the brain Langdon et al. 2023c . II Results Fig. 1 : Three line attractor models subject to equal magnitudes of nonidealities, such that 1\text{\,}\mathrm{ms} of noise in the first two models is approximately equal to 1 time step’s worth in ours. a) When initiated from multiple positions, fixed synaptic nonidealities cause the model of Zhang 1996g to converge on a subset of preferred states. b) The position error variance is linear over time, indicative of an unconstrained random walk. c) Introducing low-frequency periodic synaptic heterogeneity (shown below) pins the network to one of n=8 discrete states, mitigating diffusion between states Kilpatrick & Ermentrout 2013g . d) For higher frequencies ( n=16 ) diffusion returns, and e) the error variance becomes linear in time again. f)