Learning continually with representational drift

Suzanne van der Veldt, Gido M. van de Ven, Sanne Moorman, Guillaume Etter · 2025

Read Learning continually with representational drift by Suzanne van der Veldt, Gido M. van de Ven, Sanne Moorman, Guillaume Etter (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-22045.txt.

Introduction

Artificial networks learning from non-stationary data forget old tasks and lose plasticity, yet animal brains keep learning while their neural representations drift beneath stable behavior. Suzanne van der Veldt, Gido M. van de Ven, Sanne Moorman, and Guillaume Etter review representational drift across species and brain regions and ask what it means for continual learning.

They propose drift reflects a mix of homeostatic turnover and learning-related synaptic plasticity, with new-task learning itself inducing drift in older representations that accumulates across regions. For artificial systems, drift is compatible only with approaches that do not freeze parameters against forgetting. The authors argue drift is a byproduct rather than a solution, but studying it could reshape how continual learning balances stability and plasticity.

Catalog record

CREATORSuzanne van der Veldt, Gido M. van de Ven, Sanne Moorman, Guillaume Etter
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-22045

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning continually with representational drift Suzanne van der Veldt, Gido M. van de Ven, Sanne Moorman, Guillaume Etter Abstract Deep artificial neural networks famously struggle to learn from non-stationary streams of data. Without dedicated mitigation strategies, continual learning is associated with continuous forgetting of previous tasks and a progressive loss of plasticity. Current approaches to continual learning have either focused on increasing the stability of representations of past tasks, or on promoting plasticity for future learning. Paradoxically, while animals including humans achieve a desirable stability-plasticity trade-off, the responses of biological neurons to external stimuli that are associated with stable behaviors gradually change over time. This suggests that, although unstable representations have historically been seen as undesirable in artificial systems, they could be a core property of biological neural networks learning continually. Here, we examine how linking representational drift to continual learning in biological neural networks could inform artificial systems. We highlight the existence of representational drift across numerous animal species and brain regions and propose that drift reflects a mixture of homeostatic turnover and learning-related synaptic plasticity. In particular, we evaluate how plasticity induced by learning new tasks could induce drift in the representation of previous tasks, and how such drift could accumulate across brain regions. In deep artificial neural networks, we propose that representational drift is only compatible with approaches that do not explicitly prevent parameter changes to mitigate forgetting. Remarkably, jointly promoting plasticity while mitigating forgetting could in principle induce representational drift in continual learning. While we argue that drift is a byproduct rather than a solution to incremental learning, its investigation could inform approaches to continual learning in artificial systems. Main Deep artificial neural networks (ANNs) are currently the major framework in artificial intelligence as they increasingly demonstrate human or above-human performance on numerous tasks [ 106 , 51 ] . These models take direct inspiration from biological neural networks (BNNs) by explicitly implementing neurons as units of computation, synapses as learnable parameters, non-linear activation functions, and deep architectures that act as universal function approximators [ 62 ] . However, a long-standing limitation of ANNs is their inability to accumulate knowledge continually i.e. to learn from continuous streams of data rather than from large datasets all at once. In absence of any dedicated regularizing strategy in ANNs, learning new tasks is associated with large changes in representations and rapid forgetting of previous tasks [ 74 , 87 , 35 , 115 ] . More recently, standard ANNs were also shown to lose plasticity over the course of training, gradually decreasing their ability to learn new information [ 24 ] . Currently, approaches to continual learning of ANNs focus on mitigating one limitation at a time, with some combating catastrophic forgetting, and others loss of plasticity. Paradoxically, while BNNs are reasonably well suited for learning continually, they are supported by a highly unstable hardware: synapses undergo constant homeostatic turnover [ 108 , 47 , 112 , 41 ] and neural representations continuously change in spite of supporting stable behavioral performance [ 25 , 96 , 76 , 124 , 57 , 38 , 23 ] . These changes in representations associated with stable performance have been termed ‘representational drift’. This intriguing instability in BNNs prompts to evaluate the potential link between representational drift and continual learning in neural networks (Fig. 1 ). Here, we highlight the pervasiveness of representational drift across species and brain regions. We examine plausible plasticity mechanisms involved in the gradual drift of representations. We hypothesize that representational drift reflects plasticity processes involved in maintaining performance under changes induced by homeostatic turnover and plasticity related to learning new tasks. In ANNs, we evaluate the compatibility of current continual learning approaches with representational drift. In particular, approaches that do not explicitly prevent changes in neural networks are in principle compatible with drifting representations. Crucially, we discuss that recent approaches for mitigating loss of plasticity in ANNs implement a form of synaptic turnover, which actively drives changes in the representation of past tasks during the learning of new ones. We propose that drift itself does not improve continual learning capabilities, but could rather be the byproduct of neural networks that effectively balance stability and plasticity. Figure 1: Linking representational drift and continual learning . Unlike biological systems, standard deep ANNs (left) exhibit catastrophic forgetting and loss of plasticity when learning continually. Intriguingly, in BNNs (right), neural representations of previously learned tasks gradually change over time while supporting stable performance. Linking such representational drift to learning mechanisms could help define principles of continual learning in BNNs and inform artificial systems. Representational drift in biological neural networks Historically, neurophysiological studies have characterized neural representations through tuning curves, which describe the selectivity of individual neurons to specific variables, including the sensory [ 48 ] , spatial [ 80 ] or motor [ 37 ] domains. At shorter timescales, the apparent stability of these representations can fluctuate due to intrinsic mechanisms, such as changes in synaptic release probability [ 11 ] or transient structural plasticity of dendritic spines and axonal boutons [ 47 ] . Recent advances in optical imaging techniques, including calcium imaging of genetically expressed fluorescent sensors [ 40 , 39 , 109 , 15 , 1 ] , as well as in computational tools to track neuron identities over long periods of time [ 104 ] , have enabled longitudinal recordings of the same neurons in awake, behaving animals across periods ranging from weeks to several months. Together, these methods now allow the direct investigation of how neuronal representations evolve over extended timescales under constant stimulus or task conditions. Evidence for representational drift Strikingly, recent longitudinal studies report non-rigid representations in biological systems, where the tuning of individual neurons gradually changes in the absence of experimental changes [ 2 , 8 , 22 , 26 , 38 , 54 , 70 , 77 , 91 , 93 , 97 , 100 , 124 ] . This gradual change in how individual neurons encode the same stimulus, context or behavior over time under stable external and behavioral conditions has been termed ‘representational drift’ [ 96 , 25 ] (Fig. 2 a ). Such drift unfolds across a range of timescales, from subtle changes over minutes or hours [ 3 , 22 , 57 ] , to cumulative transformations across days or weeks [ 124 , 54 , 38 , 57 ] . While time alone can induce representational drift as shown by having animals explore the same environment at distinct time points [ 124 ] , [ 57 ] found that regularly re-exposing animals to the same environment accelerated the rate of drift in the hippocampus (Fig. 2 b ). These two experimental conditions have been referred to as ‘time’ versus ‘experience’, and other studies support this phenomenon [ 38 , 91 , 26 ] . Remarkably, despite drift at the level of individual neurons, the information that can be read out from large populations of neurons often remains comparatively stable [ 97 , 36 , 119 , 54 ] (Fig. 2 c ). Figure 2: Representational drift in biological neural networks . a , representational drift refers to gradual, non-mean-reverting changes in how individual neurons encode constant inputs

Read the complete text