Flashbacks to Harmonize Stability and Plasticity in Continual Learning Note: Manuscript submitted to Neural Networks (Elsevier) in August 2024; and accepted in May 2025 for publication. Journal: Neural Networks

Leila Mahmoodi, Peyman Moghadam, Munawar Hayat, Christian Simon, Mehrtash Harandi · 2025

Read Flashbacks to Harmonize Stability and Plasticity in Continual Learning Note: Manuscript submitted to Neural Networks (Elsevier) in August 2024; and accepted in May 2025 for publication. Journal: Neural Networks by Leila Mahmoodi, Peyman Moghadam, Munawar Hayat, Christian Simon, Mehrtash Harandi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00477.txt.

Introduction

Leila Mahmoodi and co-authors present a training trick that helps AI models learn new tasks without forgetting old ones, in a 2025 paper. Continual learning systems face a tug of war: stay stable on the past or stay flexible for the new. Most methods tip the balance by restraining updates. Their method, Flashback Learning, instead regularizes in both directions at once, using two reference knowledge bases, one favoring flexibility and one favoring stability.

Training runs in two phases, and the trick plugs into replay, distillation, and other standard continual learning families. On standard image benchmarks, adding it lifted accuracy by up to about five percent in class-by-class learning. A measured stability-to-flexibility ratio confirmed the balance genuinely improved. It also beat leading methods on the harder ImageNet tests. The authors frame the two-way pull as the key difference from one-sided fixes.

Catalog record

CREATORLeila Mahmoodi, Peyman Moghadam, Munawar Hayat, Christian Simon, Mehrtash Harandi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE136 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00477

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Flashbacks to Harmonize Stability and Plasticity in Continual Learning Note: Manuscript submitted to Neural Networks (Elsevier) in August 2024; and accepted in May 2025 for publication. Journal: Neural Networks Leila Mahmoodi, Peyman Moghadam, Munawar Hayat, Christian Simon, Mehrtash Harandi Abstract We introduce Flashback Learning (FL), a novel method designed to harmonize the stability and plasticity of models in Continual Learning (CL). Unlike prior approaches that primarily focus on regularizing model updates to preserve old information while learning new concepts, FL explicitly balances this trade-off through a bidirectional form of regularization. This approach effectively guides the model to swiftly incorporate new knowledge while actively retaining its old knowledge. FL operates through a two-phase training process and can be seamlessly integrated into various CL methods, including replay, parameter regularization, distillation, and dynamic architecture techniques. In designing FL, we use two distinct knowledge bases : one to enhance plasticity and another to improve stability. FL ensures a more balanced model by utilizing both knowledge bases to regularize model updates. Theoretically, we analyze how the FL mechanism enhances the stability-plasticity balance. Empirically, FL demonstrates tangible improvements over baseline methods within the same training budget. By integrating FL into at least one representative baseline from each CL category, we observed an average accuracy improvement of up to 4.91% in Class-Incremental and 3.51% in Task-Incremental settings on standard image classification benchmarks. Additionally, measurements of the stability-to-plasticity ratio confirm that FL effectively enhances this balance. FL also outperforms state-of-the-art CL methods on more challenging datasets like ImageNet. The codes of this article will be available at https://github.com/csiro-robotics/Flashback-Learning . 1 Introduction Figure 1 : Left: Former CL methods use existing knowledge from previous tasks to adjust model updates on new data. Right: FL method refines new knowledge out of new task data in Phase 1, then controls model updates by bidirectional regularization in Phase 2. Our brain excels at learning new information without significantly disrupting or forgetting previously acquired knowledge. In contrast, Deep Neural Networks (DNNs) often struggle with Catastrophic Forgetting (CF) [ 1 ] , where new information can overwrite and interfere with existing knowledge. This phenomenon poses a significant challenge when continuous learning of new tasks is required. Continual Learning (CL) methods have been developed to mitigate catastrophic forgetting by enabling DNNs to retain prior knowledge while acquiring new skills. Deploying AI models in realistic settings demands that models function effectively when encountering data with varying distributions over time. Therefore, updating the model based on newly received data after training on previous tasks is necessary. However, storing all previous data and retraining the model on the entire dataset from scratch is not feasible due to storage, processing, or privacy constraints. Consequently, many studies have focused on developing methods to learn from new data while avoiding CF. The primary challenge in this endeavor is to achieve a delicate balance between the model’s stability ( i.e . , the ability to preserve what it has learned before) and its plasticity ( i.e . , the capacity to learn new data) [ 2 ] . The more effectively this balance is maintained, the more optimal the model’s performance in the continual learning setting. Towards this aim, CL methods employ various techniques, such as 1. constraining the model parameters ( e.g . , [ 3 , 4 , 5 ] ), 2. knowledge distillation ( e.g . , [ 6 ] , [ 7 ] , [ 8 ] ), or 3. replaying old memory [ 9 ] using a fraction of old samples ( e.g . , [ 10 , 11 ] ) or generative models to recreate them ( e.g . , [ 12 , 13 , 14 ] ). These methodologies have a common feature: they retain some knowledge from previous tasks and use it during model updates on new task data. We call this retained knowledge “ stable knowledge " in this study. “ stable knowledge " represents the information from previous tasks that CL methods aim to embed within the model while learning novel concepts and information. To successfully learn continually, stability must be balanced with plasticity. However, as revealed by new studies ( e.g . , [ 15 ] ) most CL methods prioritize stability over plasticity. In [ 15 ] , Kim et al . evaluate several distinct CL methods in terms of their ability to extract useful features from new task data after the first tasks. They show that the model’s feature extractor’s capacity deteriorates significantly in most methods, while their primary focus has been on maintaining stability. When stability is prioritized, the model essentially operates in a unidirectional flow to transfer knowledge from old tasks to new tasks (see Figure 1 : Left ). Excessive emphasis on stability can hinder the model’s ability to learn new tasks effectively. A missing key here is that CL methods often do not have explicit control over plasticity despite model access to a new source of knowledge when a new task begins. This gap prompts a question: Once the new task begins, can we harness its knowledge to control stability-plasticity balance effectively? Imagine compiling new task knowledge into a new source called “ plastic knowledge " and enabling the CL method to take control over plasticity (see Figure 1 : Right for a conceptual illustration). Achieving this would establish a bidirectional formulation of knowledge transfer to guide the model updates while ensuring a balanced approach, harmonizing stability and plasticity effectively; thereby, stability is not prioritized over plasticity. Interestingly, evidence from neuroscience supports the feasibility of such a bidirectional mechanism. The stability of dendritic spines in the neocortex is associated with lifelong consolidated memories [ 16 ] , and the hippocampus plays a crucial role in memory consolidation by coordinating memory replay with the visual cortex during sleep [ 17 ] . [ 17 ] shows multicell firing sequences, evoked by awake experiences, are replayed in both the cortex and hippocampus during sleep, leading to the simultaneous reactivation of coherent memory traces in both regions. This suggests that the biological replay mechanism is not merely unidirectional from the hippocampus to the neocortex. The hippocampus actively refines memories by integrating new information into past memory traces [ 18 ] . This process fosters a more profound understanding and better adaptation to the new context [ 19 ] . In this study, we build upon our initial research [ 20 ] on the impact of bidirectional knowledge flow on the stability-plasticity balance. The encouraging results from that investigation motivated us to develop a mechanism that can be adapted to various categories of CL methods. We demonstrate the benefits of this approach across a broad range of CL techniques. To be more specific, we formulate FL for distillation, memory rehearsal, parameter regularization, and dynamic architecture methods. The first phase of FL focuses on compiling plastic knowledge as the new task commences and its data becomes available. We update the old model with new task data throughout this phase, prioritizing the swift acquisition of new information over preserving the old one. This phase creates a primary version of the new model, which is essential for accumulating plastic knowledge. In the second phase, termed “flashback," the old model revisits new task

Read the complete text