Advancing Prompt-Based Methods for Replay-Independent General Continual Learning
Zhiqi Kang, Liyuan Wang †, Xingxing Zhang, Karteek Alahari † · 2025
Read Advancing Prompt-Based Methods for Replay-Independent General Continual Learning by Zhiqi Kang, Liyuan Wang †, Xingxing Zhang, Karteek Alahari † (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-00677.txt.
Introduction
Zhiqi Kang, Liyuan Wang, and their co-authors work on teaching models in a steady stream, where new data arrive without clear breaks between tasks. Their 2025 paper notes that such general continual learning often starts poorly and forgets old skills fast. A common fix freezes a pretrained backbone and tunes only small prompt inputs, but that still leaves weak spots.
Their method, called MISA, first adapts the prompts in an opening session that uses pretraining data, with forgetting in mind. It then adds a mask on the model's outputs that needs no stored examples of old tasks. Tests showed clear gains over recent prompt based rivals. The method aims at learning systems that must keep up with shifting real world data.
Catalog record
| CREATOR | Zhiqi Kang, Liyuan Wang †, Xingxing Zhang, Karteek Alahari † |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-00677
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Advancing Prompt-Based Methods for Replay-Independent General Continual Learning Zhiqi Kang, Liyuan Wang †, Xingxing Zhang, Karteek Alahari † Abstract General continual learning (GCL) is a broad concept to describe real-world continual learning (CL) problems, which are often characterized by online data streams without distinct transitions between tasks, i.e., blurry task boundaries. Such requirements result in poor initial performance, limited generalizability, and severe catastrophic forgetting, heavily impacting the effectiveness of mainstream GCL models trained from scratch. While the use of a frozen pretrained backbone with appropriate prompt tuning can partially address these challenges, such prompt-based methods remain suboptimal for CL of remaining tunable parameters on the fly. In this regard, we propose an innovative approach named MISA (Mask and Initial Session Adaption) to advance prompt-based methods in GCL. It includes a forgetting-aware initial session adaption that employs pretraining data to initialize prompt parameters and improve generalizability, as well as a non-parametric logit mask of the output layers to mitigate catastrophic forgetting. Empirical results demonstrate substantial performance gains of our approach compared to recent competitors, especially without a replay buffer (e.g., up to 18.39%, 22.06%, and 11.96% performance lead on CIFAR-100, Tiny-ImageNet, and ImageNet-R, respectively). Moreover, our approach features the plug-in nature for prompt-based methods, independence of replay, ease of implementation, and avoidance of CL-relevant hyperparameters, serving as a strong baseline for GCL research. Our source code is publicly available at https://github.com/kangzhiq/MISA . $\dagger$ $\dagger$ footnotetext: Corresponding authors: L. Wang and K. Alahari. $\ast$ $\ast$ footnotetext: Univ. Grenoble Alpes, CNRS, Grenoble INP, LJK, 38000 Grenoble, France. 1 Introduction Continual learning (CL) ( Wang et al., 2024b ; De Lange et al., 2021 ) focuses on the lifelong acquisition of knowledge in response to real-world changes. Although conventional CL research often relies on offline training of each task with distinct transitions between tasks (i.e., clear task boundaries), online scenarios with blurry task boundaries tend to be more practical yet challenging. Such “online” scenarios demand the model to swiftly adapt to new information, which is essential for real-time applications. Blurry task boundaries further reflect realistic data distributions without distinct transitions between tasks, i.e., old classes disappear gradually over time and might re-appear when new classes emerge (see Fig. 1 , Left). The above considerations, collectively referred to as general continual learning (GCL) ( De Lange et al., 2021 ) , have received increasing attention in recent years. However, most of the earlier works ( Aljundi et al., 2019 ; Buzzega et al., 2020 ; Koh et al., 2021 ; Bang et al., 2021 ) address GCL by learning a model from scratch. This strategy often leads to challenges such as poor initial performance, limited generalizability, and severe catastrophic forgetting ( McCloskey & Cohen, 1989 ) in such a complex setting. Figure 1: Problem setup and motivation. Left: illustration of the GCL data stream. Mid: average prediction accuracy at different timesteps in GCL. Right: session 1 accuracy, where we evaluate the retention of knowledge acquired at session 1 after each session. All methods are tested without a replay buffer. One promising direction that emerged in GCL literature ( Moon et al., 2023 ) is to employ prompt-based methods ( Wang et al., 2022d ; Wang et al., 2022c ; Wang et al., 2024a ) on the basis of pretrained models (PTMs), which involves keeping the PTMs frozen and introducing a few prompt parameters for representation learning. Such methods outperform previous train-from-scratch ones by a significant margin. The frozen backbone pretrained on a large-scale dataset provides a solid initialization with strong generalizability and is resistant to forgetting. However, the particular challenges of GCL persist for the remaining tunable components, i.e., the prompt parameters and the output layers, making the direct application of prompt-based methods to GCL suboptimal. Studies have demonstrated that prompt parameters and output layers are particularly vulnerable in the challenging setting of GCL. First, prompt-tuning is known to suffer from a limited capacity in vision tasks ( Lester et al., 2021 ; Vu et al., 2021 ; Chen et al., 2021 ) . Training these parameters on the fly in online scenarios of GCL can result in poor initial performance and limited generalizability. As shown in Fig. 1 (Mid), state-of-the-art methods have moderate initial performance and drop dramatically after session transitions (timestep 4). Moreover, it is well studied in the CL literature ( Wu et al., 2019 ; Ahn et al., 2021 ) that the output layers suffer from forgetting in class-incremental learning, a challenge that is exacerbated in GCL due to the naturally imbalanced data stream and the interference between new and old knowledge caused by blurry task boundaries. While recent GCL works ( Moon et al., 2023 ) have introduced specialized learning strategies for the output layers, they still fail to outperform conventional prompt-based methods. Specifically, the session 1 accuracy in Fig. 1 (Right) shows the capacity to retain acquired knowledge from the first session in subsequent sessions, where all existing methods suffer to retain this knowledge. Thus, there is a clear need for learning-efficient and forgetting-less strategies to address the particular challenges of GCL. Our method, MISA (Mask and Initial Session Adaption), is designed with two objectives: a forgetting-aware initial session adaption (ISA) for better learning efficiency and generalizability of the prompt parameters, and a non-parametric logit masking for less catastrophic forgetting of the output layers. The initial session refers to a warm-up of the model parameters prior to any GCL sessions. Specifically, we reuse the pretraining data of the PTMs to warm up the prompt parameters. As naïve pretraining tends to enhance mainly the initialization rather than the generalizability, we devise a novel forgetting-aware minimization technique in ISA to improve the generalizability of prompts to distribution shift. Unlike conventional CL methods that address forgetting after it occurs, our approach proactively prevents future forgetting and maintains the pretrained knowledge for downstream GCL. As for reducing forgetting of the output layers, we propose a non-parametric strategy that is based on class appearance to mask the output logits. We show that such a simple strategy, which is not effective for the train-from-scratch paradigm, can benefit from the stable representation space retained by the frozen backbone and effectively rectify the output layers. In summary, our MISA is specifically designed for tunable parameters of prompt-based methods in GCL. We emphasize the plug-in nature of MISA for different methods and scenarios, as it is replay-independent, hyperparameter-free, and effective in GCL. Accordingly, our approach brings substantial performance gains compared to recent strong baselines. For instance, there is up to 18.39%, 22.06%, and 11.96% performance lead on CIFAR-100, Tiny-ImageNet, and ImageNet-R datasets respectively. Our contributions can be summarized as follows: • We propose an innovative approach that addresses the poor initialization, limited generalizability, and severe forgetting of GCL, which features the ease of implementation, avoidance of CL-relevant hyperparameters, and plug-in nature for prompt-based methods. • Our proposed forgetting-aware initial session adaptation effectively improves the initialization of prompt parameters and their generalizability to distribution shift, and our non-parametric logit masking rectifies the output layers to alleviate catastrophic forgetting. • Across multiple challenging benchmarks, our approach outperforms a variety of existing methods by a wide margin, setting a new state of the art for GCL research. 2 Related Work Continual