Neuroscience-Inspired Memory Replay for Continual Learning: A Comparative Study of Predictive Coding and Backpropagation-Based Strategies
Goutham Nalagatla, [0.5em] Shreyas Grandhe · 2025
Read Neuroscience-Inspired Memory Replay for Continual Learning: A Comparative Study of Predictive Coding and Backpropagation-Based Strategies by Goutham Nalagatla, [0.5em] Shreyas Grandhe (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-00619.txt.
Introduction
Neural networks that keep learning new tasks tend to forget old ones, a failure called catastrophic forgetting. Goutham Nalagatla and Shreyas Grandhe compare memory replay strategies for continual learning in 2025, inspired by neuroscience. Biological memory consolidation replays experiences during rest to stabilize them.
Their framework uses generative replay built on predictive coding principles to reduce forgetting. It is compared against backpropagation-based strategies on equal footing. Continual learning decides whether deployed AI can adapt for years without periodic retraining from scratch, so biologically inspired replay is a promising direction. Predictive coding is a brain-inspired theory of how cortex predicts its inputs. Generative replay creates fresh training examples instead of storing old data. For teams who field aides that must learn for years, the gain is a path with no need to keep old data on file. That helps on both cost and trust.
Catalog record
| CREATOR | Goutham Nalagatla, [0.5em] Shreyas Grandhe |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 15 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-00619
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Neuroscience-Inspired Memory Replay for Continual Learning: A Comparative Study of Predictive Coding and Backpropagation-Based Strategies Goutham Nalagatla, [0.5em] Shreyas Grandhe Abstract Continual learning remains a fundamental challenge in artificial intelligence, with catastrophic forgetting posing a significant barrier to deploying neural networks in dynamic environments. Inspired by biological memory consolidation mechanisms, we propose a novel framework for generative replay that leverages predictive coding principles to mitigate forgetting. We present a comprehensive comparison between predictive coding-based and backpropagation-based generative replay strategies, evaluating their effectiveness on task retention and transfer efficiency across multiple benchmark datasets. Our experimental results demonstrate that predictive coding-based replay achieves superior retention performance (average 15.3% improvement) while maintaining competitive transfer efficiency, suggesting that biologically-inspired mechanisms can offer principled solutions to continual learning challenges. The proposed framework provides insights into the relationship between biological memory processes and artificial learning systems, opening new avenues for neuroscience-inspired AI research. 1 Introduction The ability to learn continuously from a stream of non-stationary data is a hallmark of biological intelligence, yet remains an elusive goal for artificial neural networks. When trained sequentially on multiple tasks, deep learning models exhibit catastrophic forgetting [ 1 ] , rapidly overwriting previously acquired knowledge as new information is incorporated. This limitation severely constrains the deployment of AI systems in real-world scenarios where data distributions evolve over time. Biological systems employ sophisticated mechanisms to prevent catastrophic forgetting, including memory consolidation through hippocampal replay [ 2 ] and predictive coding principles in cortical processing [ 3 ] . The hippocampus generates synthetic experiences during sleep and rest periods, reactivating neural patterns associated with past events to reinforce synaptic connections in the neocortex. This generative replay mechanism enables the brain to maintain long-term memories while continuing to learn new information. Inspired by these biological mechanisms, generative replay has emerged as a promising approach to continual learning [ 5 ] . The core idea involves training a generative model to synthesize samples from previous tasks, which are then interleaved with new task data during training. However, existing generative replay methods predominantly rely on backpropagation-based training, which may not fully capture the biological principles underlying memory consolidation. Predictive coding [ 4 , 3 ] offers an alternative computational framework that more closely mirrors cortical information processing. In predictive coding networks, neurons maintain predictions about their inputs and propagate prediction errors upward through the hierarchy, enabling local, biologically-plausible learning rules. This framework has shown promise in various domains but has not been systematically evaluated for generative replay in continual learning scenarios. In this work, we address this gap by: 1. Developing a biologically-inspired generative replay framework that integrates predictive coding principles with memory consolidation mechanisms 2. Conducting a comprehensive comparative analysis between predictive coding-based and backpropagation-based generative replay strategies 3. Evaluating both approaches on multiple continual learning benchmarks, measuring task retention and transfer efficiency 4. Providing insights into the relationship between biological memory processes and artificial learning systems Our contributions demonstrate that predictive coding-based replay achieves superior task retention while maintaining competitive transfer efficiency, suggesting that neuroscience-inspired approaches can offer principled solutions to continual learning challenges. 2 Related Work 2.1 Continual Learning Continual learning has been approached through three main paradigms: regularization-based methods [ 1 , 6 ] , architectural approaches [ 7 , 8 ] , and rehearsal-based strategies [ 9 , 5 ] . Regularization methods add constraints to prevent weight changes important for previous tasks, while architectural approaches dynamically expand network capacity. Rehearsal methods, including generative replay, maintain access to past experiences through stored or generated samples. 2.2 Generative Replay Generative replay was introduced by Shin et al. [ 5 ] as a method to prevent catastrophic forgetting by training a generative model to synthesize samples from previous tasks. The synthesized samples are then interleaved with new task data during training. Variants include conditional generative replay [ 10 ] , which conditions generation on task identity, and memory-based approaches that combine generative replay with episodic memory [ 11 ] . 2.3 Predictive Coding Predictive coding [ 4 ] is a theoretical framework for understanding cortical information processing, where higher-level areas generate predictions that are compared with lower-level inputs, generating prediction errors that drive learning. Recent work has shown that predictive coding can be implemented in deep neural networks [ 3 , 12 ] , achieving competitive performance with backpropagation while offering biological plausibility and local learning rules. 2.4 Neuroscience-Inspired AI The intersection of neuroscience and AI has yielded insights into learning mechanisms [ 13 ] . Hippocampal replay [ 2 ] and memory consolidation [ 14 ] have inspired various continual learning approaches. However, most existing work adapts biological principles at a high level without fully integrating the underlying computational mechanisms. 3 Methodology 3.1 Problem Formulation In continual learning, we consider a sequence of tasks \mathcal{T}_{1},\mathcal{T}_{2},\ldots,\mathcal{T}_{T} , where each task \mathcal{T}_{t} consists of a dataset \mathcal{D}_{t}=\{(x_{i}^{t},y_{i}^{t})\}_{i=1}^{n_{t}} . The goal is to learn a model f_{\theta}:\mathcal{X}\rightarrow\mathcal{Y} that maintains performance on all previously seen tasks while learning new ones. We measure performance using: • Task Retention : Average accuracy on all previous tasks after learning task t • Transfer Efficiency : Improvement in learning new tasks due to knowledge from previous tasks 3.2 Generative Replay Framework Our generative replay framework consists of two components: 1. A task model f_{\theta} that performs the main learning objective 2. A generative model g_{\phi} that synthesizes samples from previous tasks When learning task \mathcal{T}_{t} , we interleave real samples from \mathcal{D}_{t} with synthetic samples generated by g_{\phi} from previous tasks \mathcal{T}_{1},\ldots,\mathcal{T}_{t-1} . 3.3 Predictive Coding-Based Generative Replay Predictive coding networks maintain hierarchical predictions and propagate prediction errors. For a generative model, we structure the network as a hierarchy where each layer l maintains: \displaystyle\hat{x}_{l} \displaystyle=f_{l}(\mu_{l+1})\quad\text{(prediction)} (1) \displaystyle\epsilon_{l} \displaystyle=x_{l}-\hat{x}_{l}\quad\text{(prediction error)} (2) \displaystyle\mu_{l} \displaystyle=\mu_{l}+\alpha\frac{\partial E}{\partial\mu_{l}}\quad\text{(state update)} (3) where f_{l} is the generative function at layer l , \mu_{l} is the latent state, and E is the energy function. For generative replay, we train the predictive coding generator using local learning rules: \Delta\theta_{l}=-\eta\left(\epsilon_{l}\frac{\partial\hat{x}_{l}}{\partial\theta_{l}}-\lambda\epsilon_{l+1}\frac{\partial\mu_{l+1}}{\partial\theta_{l}}\right) (4) where \eta is the learning rate and \lambda balances bottom-up and top-down influences. 3.4 Backpropagation-Based Generative Replay For comparison, we implement standard backpropagation-based generative replay using a Variational Autoencoder (VAE) [ 15 ] architecture. The generator is trained to minimize: \mathcal{L}_{\text{VAE}}=\mathbb{E}_{q_{\phi}(z|x)}[\log p_{\theta}(x|z)]-\text{KL}(q_{\phi}(z|x)||p(z)) (5) where q_{\phi}(z|x) is the encoder, p_{\theta}(x|z) is the decoder, and p(z) is the prior. 3.5 Training Procedure For each task \mathcal{T}_{t} : 1. Train the task model f_{\theta} on \mathcal{D}_{t} mixed with generated samples from previous tasks 2. Update the generative model g_{\phi} to incorporate samples from \mathcal{D}_{t} 3. Evaluate performance on all seen tasks The mixing ratio between real and generated samples is controlled by a hyperparameter \beta\in[0,1] , where \beta represents the proportion of real samples in each batch. Figure 1 illustrates the architectural differences between predictive coding-based and backpropagation-based generative replay approaches. 4 Experiments 4.1 Datasets We evaluate our methods on three benchmark datasets: Split-MNIST : The MNIST dataset is split into 5 sequential tasks, each containing 2 digit classes (0-1, 2-3, 4-5, 6-7, 8-9). Split-CIFAR-10 : CIFAR-10 is divided into 5 tasks, each containing 2 classes. Split-CIFAR-100 : CIFAR-100 is divided into 10 tasks, each containing 10 classes. 4.2 Architecture For the task model, we use a multi-layer perceptron