PrePrompt: Predictive prompting for class incremental learning
Libo Huang, Zhulin An, Chuanguang Yang, Boyu Diao, Fei Wang, Yan Zeng, Zhifeng Hao, Yongjun Xu · 2025
Read PrePrompt: Predictive prompting for class incremental learning by Libo Huang, Zhulin An, Chuanguang Yang, Boyu Diao, Fei Wang, Yan Zeng, Zhifeng Hao, Yongjun Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08586.txt.
Introduction
Libo Huang and seven co-authors present PrePrompt in 2025, a way to teach image models new classes over time without forgetting old ones. Prompt-based methods fetch stored prompts by matching image features, but a handful of prompts cannot cover the feature space of every task.
PrePrompt instead predicts which task a picture belongs to using the base model's own classification skill, then predicts the label in a second stage. The catch is drift toward recent classes, since old data are gone. A feature translation step rebalances stability against flexibility. Across benchmarks the method beat the leading prompt-based rivals.
Catalog record
| CREATOR | Libo Huang, Zhulin An, Chuanguang Yang, Boyu Diao, Fei Wang, Yan Zeng, Zhifeng Hao, Yongjun Xu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08586
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PrePrompt: Predictive prompting for class incremental learning Libo Huang, Zhulin An, Chuanguang Yang, Boyu Diao, Fei Wang, Yan Zeng, Zhifeng Hao, Yongjun Xu Abstract Class Incremental Learning (CIL) based on pre-trained models offers a promising direction for open-world continual learning. Existing methods typically rely on correlation-based strategies, where an image’s classification feature is used as a query to retrieve the most related key prompts and select the corresponding value prompts for training. However, these approaches face an inherent limitation: fitting the entire feature space of all tasks with only a few trainable prompts is fundamentally challenging. We propose Predictive Prompting (PrePrompt), a novel CIL framework that circumvents correlation-based limitations by leveraging pre-trained models’ natural classification ability to predict task-specific prompts. Specifically, PrePrompt decomposes CIL into a two-stage prediction framework: task-specific prompt prediction followed by label prediction. While theoretically appealing, this framework risks bias toward recent classes due to missing historical data for older classifier calibration. PrePrompt then mitigates this by incorporating feature translation, dynamically balancing stability and plasticity. Experiments across multiple benchmarks demonstrate PrePrompt’s superiority over state-of-the-art prompt-based CIL methods. Code available at github.com/libo-huang/preprompt . 1 Introduction Figure 1: Comparison of existing prompt-based CIL methods and our PrePrompt approach. Existing prompt-based CIL methods typically utilize prompts as key-value pairs ( i.e., [ ] ) and select prompts based on feature-key correlation. Specifically, L2P employs k-nearest neighbors for selection, DualPrompt introduces a set of general-purpose prompts ( i.e., [ ] ), and CODA-Prompt combines all prompts with weights determined by their correlation. In contrast, the proposed PrePrompt simplifies this structure by using a single value prompt and selects the final prompt based on the initial prediction. Deep learning models have demonstrated remarkable success in various applications through conventional training paradigms that utilize pre-collected datasets [ 14 , 39 ] . However, real-world deployment scenarios introduce a critical challenge: constrained by privacy preservation requirements and finite storage capacity, artificial intelligence systems must progressively acquire knowledge from sequentially arriving tasks [ 33 ] . In response to these constraints, Class-Incremental Learning (CIL) has emerged as an essential machine learning paradigm, enabling models to continuously expand their classification capabilities while maintaining previously acquired knowledge [ 20 , 43 ] . The primary obstacle in CIL frameworks is catastrophic forgetting, a phenomenon where direct optimization on new task data induces exponential performance degradation on previously learned classes [ 21 ] . L2P DualPrompt CODA-Prompt PrePrompt Figure 2: T-SNE visualization of feature and prompt distributions on CIFAR-100. The plot compares key-prompt embeddings (large stars, color-coded by task) and feature embeddings (small dots) across four sequential tasks, each containing 25 classes. Since PrePrompt does not use key-prompts, we visualize the class feature means instead, where the class IDs are inferred by the prompt classifier. L2P, DualPrompt, and CODA-Prompt exhibit spatial overlap and clustering in their key-prompt embeddings (with some regions zoomed out), indicating inter-task interference. PrePrompt’s embeddings remain well-separated and strategically distributed in distinct regions. This highlights PrePrompt’s superior task-specific decoupling and robustness against catastrophic forgetting in prompt-based class incremental learning. While conventional CIL methodologies often require training models from scratch for each new task, recent advancements have shifted toward leveraging pre-trained models (PTMs) as foundational knowledge repositories [ 37 , 9 ] . These PTM-based frameworks exploit the generalizable knowledge encoded in pre-trained transformers, significantly enhancing learning efficiency in CIL scenarios. Among these advancements, prompt-based CIL methods have emerged as a promising direction due to their parameter efficiency and adaptability [ 16 ] . By freezing the transformer backbone and appending lightweight prompt modules, these methods guide feature adaptation while requiring less than 1\% of the total model parameters to be updated [ 43 , 42 ] . As illustrated in Fig. 1 , state-of-the-art methods such as Learning to Prompt (L2P) [ 37 ] , DualPrompt [ 36 ] , and CODA-Prompt [ 29 ] organize prompts as key-value pairs, where image classification features serve as queries to select the most relevant key prompts, which in turn determine the corresponding value prompts for training. L2P selects prompts using a k-nearest neighbors mechanism but often fails to achieve sufficient task-specific feature separation [ 37 ] . DualPrompt introduces general-purpose prompts to mitigate this issue but achieves only partial separation [ 36 ] . Similarly, CODA-Prompt attempts to combine all prompts with weighted correlations using an attention mechanism [ 29 ] . Although these methods have pushed performance levels close to the theoretical upper bounds of conventional CIL, they rely heavily on predefined correlations between classification features (queries) and key prompts. This reliance limits their ability to represent the complex and diverse feature spaces of multiple tasks. As tasks increase in number or diversity, overlaps between prompts associated with different tasks become inevitable, reducing task separability and diminishing performance gains. These shortcomings are evident in Fig. 2 , where the prompts from L2P, DualPrompt, and CODA-Prompt exhibit varying degrees of spatial overlap, with their embeddings partially clustered together, indicating potential interference between tasks due to insufficient prompt separation. In this paper, we propose PrePrompt, a novel prediction-based prompt selection strategy that simplifies the key-value pair framework used in prior methods. As shown in Fig. 1 , PrePrompt eliminates the need for a separate key-value structure and reduces reliance on correlation-based queries. Instead of relying on predefined correlations, PrePrompt leverages the model’s initial prediction capability to identify the most appropriate prompt for each task and subsequently predicts the final label using the selected prompt. To achieve an optimal balance between stability and plasticity, PrePrompt incorporates a feature translation strategy across these two prediction stages. As demonstrated in Fig. 2 , PrePrompt achieves two significant improvements over existing methods. First, it ensures that prompts are distributed across distinct feature subspaces, effectively reducing task overlap and mitigating interference between tasks. Second, it avoids the partial clustering observed in previous methods, thereby enhancing task-specific adaptability and improving the model’s ability to handle diverse and complex feature spaces. These advancements collectively address the limitations of existing prompt-based CIL methods, offering a more robust and scalable solution for continual learning scenarios. In summary, our contributions are threefold: (1) We identify and analyze the limitations of existing prompt-based CIL methods, particularly their reliance on predefined correlations and insufficient task separability; (2) We propose PrePrompt, a prediction-based prompt selection strategy that eliminates the need for key-value pairs and leverages feature translation to improve task-specific adaptability; and (3) We demonstrate through extensive experiments that PrePrompt achieves superior performance in reducing task overlap and enhancing task separability, outperforming state-of-the-art methods on benchmark datasets. 2 Related work 2.1 Incremental learning Continual learning enables neural networks to acquire new knowledge while preserving previously learned capabilities, a critical requirement for real-world applications encountering dynamic data streams. Early approaches addressed catastrophic forgetting through regularization-based methods that selectively stabilize important parameters [ 11 , 40 ] , exemplified by synaptic intelligence [ 40 ] and elastic weight consolidation [ 11 ] . Rehearsal-based strategies later emerged as dominant solutions, maintaining performance through episodic memory buffers [ 25 ] or generative replay [ 28 ] , though these incur storage overhead and privacy risks. Architectural innovations further advanced the field, introducing task-specific parameters [ 27 ] or dynamically expanding networks [ 26 ]