Unlocking the Power of Rehearsal in Continual Learning: A Theoretical Perspective

Junze Deng, Qinhang Wu, Peizhong Ju, Sen Lin, Yingbin Liang, Ness Shroff · 2025

Read Unlocking the Power of Rehearsal in Continual Learning: A Theoretical Perspective by Junze Deng, Qinhang Wu, Peizhong Ju, Sen Lin, Yingbin Liang, Ness Shroff (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00205.txt.

Introduction

Revisiting old lessons after learning new ones may beat mixing them together, and a 2025 paper by Junze Deng and co-authors proves the point in theory. The setting is continual learning, where a model that masters new tasks tends to forget old ones. That failure is called catastrophic forgetting.

Working with overparameterized linear models, the team compares two rehearsal styles. The standard one trains old and new data side by side. A sequential one learns the new task first and then revisits the old. Formulas for forgetting and error show the sequential style wins when tasks differ enough. A hybrid follows naturally: train similar tasks together, revisit dissimilar ones in sequence.

Catalog record

CREATORJunze Deng, Qinhang Wu, Peizhong Ju, Sen Lin, Yingbin Liang, Ness Shroff
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE185 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00205

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Unlocking the Power of Rehearsal in Continual Learning: A Theoretical Perspective Junze Deng, Qinhang Wu, Peizhong Ju, Sen Lin, Yingbin Liang, Ness Shroff Abstract Rehearsal-based methods have shown superior performance in addressing catastrophic forgetting in continual learning (CL) by storing and training on a subset of past data alongside new data in current task. While such a concurrent rehearsal strategy is widely used, it remains unclear if this approach is always optimal. Inspired by human learning, where sequentially revisiting tasks helps mitigate forgetting, we explore whether sequential rehearsal can offer greater benefits for CL compared to standard concurrent rehearsal. To address this question, we conduct a theoretical analysis of rehearsal-based CL in overparameterized linear models, comparing two strategies: 1) Concurrent Rehearsal, where past and new data are trained together, and 2) Sequential Rehearsal, where new data is trained first, followed by revisiting past data sequentially. By explicitly characterizing forgetting and generalization error, we show that sequential rehearsal performs better when tasks are less similar. These insights further motivate a novel Hybrid Rehearsal method, which trains similar tasks concurrently and revisits dissimilar tasks sequentially. We characterize its forgetting and generalization performance, and our experiments with deep neural networks further confirm that the hybrid approach outperforms standard concurrent rehearsal. This work provides the first comprehensive theoretical analysis of rehearsal-based CL. 1 Introduction Continual learning (CL) ( Parisi et al. 2019 ) seeks to build an agent that can learn a sequence of tasks continuously without access to old task data, resembling human’s capability of lifelong learning. One of the major challenges therein is the so-called catastrophic forgetting ( Kirkpatrick et al. 2017 ) , i.e., the agent can easily forget the knowledge of old tasks when learning new tasks. A large amount of studies have been proposed to address this issue, among which rehearsal-based approaches ( Rolnick et al. 2019 ) have demonstrated the state-of-the-art performance. The main idea behind is to store a subset of old task data in the memory and revisit them for new task learning, where a widely adopted strategy for training is concurrent rehearsal ( Goldfarb et al. 2024 ) , i.e., train the model concurrently on new data and past data. While the concurrent rehearsal strategy seems very natural and has shown successful performance to address catastrophic forgetting, it is indeed questionable whether this strategy is always the right way for rehearsal in CL as we consider the following aspects. 1) From the perspective of human learning. In daily life, a common strategy to prevent forgetting is to review old knowledge. For example, suppose a student needs to learn a series of topics over a semester before taking an exam, and each topic corresponds to one task in CL. Intuitively, if these topics are highly related to each other, incorporating the knowledge of old topics into learning a new topic can be an effective strategy to strengthen the new learning and simultaneously reduce the forgetting of old knowledge, which is analogous to concurrent rehearsal . However, if the topics are very different from each other, a common practice is to learn new topics first and then go over old topics to mitigate forgetting. Here, such a sequential rehearsal may lead to better outcome in the exam. 2) From the perspective of multi-task learning. Learning multiple tasks all at once may lead to poor learning performance due to the potential interference among gradients of different tasks ( Yu et al. 2020 ) , whereas standard CL without regularization and rehearsal may even achieve less forgetting for more dissimilar tasks ( Lin et al. 2023 ) . Thus motivated, an interesting and open question to ask is: Question: Whether sequential rehearsal will serve as an appealing rehearsal strategy to complement the standard concurrent rehearsal, and when will it be advantageous over concurrent rehearsal for CL? To answer this question from a theoretical perspective, we study rehearsal-based CL through the lens of overparameterized linear models to gain useful insights, by following a recent series of theoretical studies in CL ( Lin et al. 2023 ; Evron et al. 2022 ; Ding et al. 2024 ; Li et al. 2024 ) . However, none of those previous studies analyzed the rehearsal-based methods. The only theoretical work that studied the rehearsal-based methods is the recent concurrent work ( Banayeeanzade et al. 2024 ) . But this work considered only the standard concurrent rehearsal method, not from the new perspective of sequential rehearsal. To capture the idea of sequential rehearsal, we propose a novel rehearsal strategy, in which the agent sequentially revisits each old task and trains the model with the corresponding past data after the current task is well learned. We summarize our main contributions as follows. (1) First of all, we provide the first explicit closed-form expressions for the expected value of forgetting and generalization error for both concurrent rehearsal strategy and sequential rehearsal strategy under an overparameterized linear regression setting. Note that the blending of samples from old tasks in concurrent rehearsal introduces significant intricacies related to task correlation in theoretical analysis. To address this challenge, we partition training data into blocks based on different tasks, which enables us to further calculate the task interference using the properties of block matrix. In particular, our theoretical results demonstrate how the performance of rehearsal-based CL is affected by various factors, including task similarity and memory size. (2) Secondly, we propose a novel rehearsal strategy, i.e., sequential rehearsal , to sequentially revisit old tasks after the current task is fully learned. By characterizing the explicit closed-form expressions for the expected forgetting and generalization error for sequential rehearsal and comparing with the concurrent rehearsal, we give an affirmative answer to the open question above. More importantly, we rigorously characterize the conditions when sequential rehearsal can benefit CL more than concurrent rehearsal, in terms of both forgetting and generalization error, which is also consistent with our motivations above: Sequential rehearsal outperforms concurrent rehearsal if tasks in CL are dissimilar, and the performance improvement is larger when the tasks are more dissimilar. Numerical simulations on linear models further corroborate our theoretical results. (3) Last but not least, our theoretical insights can indeed go beyond the linear models and guide the practical algorithm design for rehearsal-based CL with deep neural networks (DNNs). More specifically, we merge the idea of sequential rehearsal into standard rehearsal-based CL with concurrent rehearsal, leading to a novel hybrid rehearsal approach where 1) old tasks dissimilar to the current task will be revisited by using sequential rehearsal (guided by our theory that suggests more benefit if dissimilar tasks are revisited sequentially) and 2) the past data for the remaining old tasks (that are sufficiently similar to the current task) will still be used concurrently with current task data. Our experiments on real datasets with DNNs verify that our hybrid approach can perform better than concurrent rehearsal and the advantage is more apparent when tasks are more dissimilar. 2 Related Work Empirical studies in CL. CL has drawn significant attention in recent years, with numerous empirical approaches developed to mitigate the issue of catastrophic forgetting. Architecture-based approaches combat catastrophic forgetting by dynamically adjusting network parameters ( Rusu et al. 2016 ) or introducing

Read the complete text