Semantic Shift Estimation via Dual-Projection and Classifier Reconstruction for Exemplar-Free Class-Incremental Learning
Run He, Di Fang, Yicheng Xu, Yawen Cui, Ming Li, Cen Chen, Ziqian Zeng, Huiping Zhuang · 2025
Read Semantic Shift Estimation via Dual-Projection and Classifier Reconstruction for Exemplar-Free Class-Incremental Learning by Run He, Di Fang, Yicheng Xu, Yawen Cui, Ming Li, Cen Chen, Ziqian Zeng, Huiping Zhuang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-05423.txt.
Introduction
Run He and co-authors help a learning system take on new classes without forgetting the old, and without keeping old examples, in a 2025 paper. The trap has two jaws. First, old classes drift in the model's inner map as new lessons land, a semantic shift. Second, the judge at the top leans toward the new, since only new data feeds its training.
Their method, DPCR, reads the drift two ways at once: a learned warp catches task-level moves, and a row-space projection catches class-level ones. The judge is then rebuilt by ridge regression, fed with the old class profiles shifted back into place. Across standard datasets the approach held the old-new balance better than the leading rivals. Code is public. The authors pitch the twin projection as the key: drift is not one motion but two, and each needs its own gauge.
Catalog record
| CREATOR | Run He, Di Fang, Yicheng Xu, Yawen Cui, Ming Li, Cen Chen, Ziqian Zeng, Huiping Zhuang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-05423
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Semantic Shift Estimation via Dual-Projection and Classifier Reconstruction for Exemplar-Free Class-Incremental Learning Run He, Di Fang, Yicheng Xu, Yawen Cui, Ming Li, Cen Chen, Ziqian Zeng, Huiping Zhuang Abstract Exemplar-Free Class-Incremental Learning (EFCIL) aims to sequentially learn from distinct categories without retaining exemplars but easily suffers from catastrophic forgetting of learned knowledge. While existing EFCIL methods leverage knowledge distillation to alleviate forgetting, they still face two critical challenges: semantic shift and decision bias. Specifically, the embeddings of old tasks shift in the embedding space after learning new tasks, and the classifier becomes biased towards new tasks due to training solely with new data, hindering the balance between old and new knowledge. To address these issues, we propose the Dual-Projection Shift Estimation and Classifier Reconstruction (DPCR) approach for EFCIL. DPCR effectively estimates semantic shift through a dual-projection, which combines a learnable transformation with a row-space projection to capture both task-wise and category-wise shifts. Furthermore, to mitigate decision bias, DPCR employs ridge regression to reformulate a classifier reconstruction process. This reconstruction exploits previous in covariance and prototype of each class after calibration with estimated shift, thereby reducing decision bias. Extensive experiments demonstrate that, on various datasets, DPCR effectively balances old and new tasks, outperforming state-of-the-art EFCIL methods. Our codes are available at https://github.com/RHe502/ICML25-DPCR . 1 Introduction Class-incremental learning (CIL) ( Zhou et al., 2024 ; Rebuffi et al., 2017 ) enables models to acquire knowledge from distinct categories arriving sequentially in a task-wise manner. This paradigm addresses that data is only accessible at specific times or locations, facilitating the accumulation of machine intelligence in dynamic real-world scenarios. However, CIL encounters the challenge of catastrophic forgetting (CF) ( Belouadah et al., 2021 ) , where the model rapidly loses previous knowledge when acquiring new information. To address forgetting, exemplar-based CIL (EBCIL) ( Hou et al., 2019 ; Zheng et al., 2024 ; Bian et al., 2024 ) stores a portion of previous data as exemplars for replaying. However, this method may be limited by privacy concerns or storage capacity constraints. By contrast, Exemplar-free CIL (EFCIL), which does not store previous samples ( Rypeść et al., 2024 ; Masana et al., 2023 ) , is more applicable in practical situations. Figure 1: After learning new tasks, (a) the embeddings of old tasks undergo semantic shift in embedding space, (b) and the embeddings are more likely to be classified as new classes. Recent EFCIL approaches mainly leverage knowledge distillation to mitigate CF ( Li & Hoiem, 2017 ; Feng et al., 2022 ; Gao et al., 2024a ) . However, their performance can be constrained by two key challenges: semantic shift in learned representations caused by incremental updates to the backbone, and decision bias in classifier training due to the absence of historical data (see Figure 1 ). These challenges lead to stability-plasticity dilemma ( Mermillod et al., 2013 ) , where the model struggles to balance preserving old knowledge (stability) with acquiring new knowledge (plasticity). Specifically, when adapting the backbone to new tasks, the embeddings of old classes inevitably shift in the embedding space ( Yu et al., 2020 ) , reducing the compatibility of updated representations with previously learned classes and thus compromising stability ( Zhu et al., 2021a ) . Meanwhile, updating the classifier via iterative back-propagation (BP) without access to previous data often results in a preference for the newly learned data, introducing decision bias ( Zhuang et al., 2024c ; Hou et al., 2019 ) . This bias skews the classification towards new tasks 1 1 1 This phenomenon of model’s tendency to favor new task is also termed as task-recency bias ( Rebuffi et al., 2017 ) . Several works attribute it to the biased classifier ( Zhuang et al., 2024c ) . We use decision bias to clarify that the bias originates from classifier. , imposing preference on plasticity at the expense of stability. Existing solutions struggle to simultaneously address both semantic shift and decision bias, resulting in imbalance between stability and plasticity. For instance, several works resort to freezing backbone to prevent alterations of the old representation thus avoid semantic shift ( Zhuang et al., 2022b ; Goswami et al., 2023 ; He et al., 2024b ) . However, this strategy restricts the backbone’s ability to adapt representations for new tasks, thereby highly limiting plasticity. To tackle decision bias, several methods adopt a Nearest-Class Mean (NCM) classifier based on prototypes to avoid direct classifier updates ( Hou et al., 2019 ; Goswami et al., 2024 ; Gomez-Villa et al., 2024 ) . However, as non-parametric classifiers, NCM classifiers heavily depend on the quality of the learned representations, which are susceptible to degradation caused by semantic shift. Also, the absence of trainable parameters could limit their adaptability across task. To address stability-plasticity dilemma, it is imperative to propose a novel EFCIL technique capable of continuously adapting the model to new tasks, effectively addressing semantic shift, and maintaining a well-balanced parametrized classifier. In this paper, we propose a Dual-Projection Shift Estimation and Classifier Reconstruction (DPCR) approach to handle the semantic shift and decision bias simultaneously. DPCR incorporates a dual-projection (DP) to address the semantic shift, and employs a ridge regression-based classifier reconstruction approach (RRCR) to mitigate the decision bias while benefiting from a parametrized classifier. DP formulates a learnable Task-wise Semantic Shift Projection (TSSP) together with a Category Information Projection (CIP), enabling DPCR to accurately estimate shift and improves stability. RRCR reformulates the classifier training as BP-free classifier reconstruction process using ridge regression. RRCR can leverage previous information encoded in covariance and prototype of each class to obtain a well-balanced classifier with calibration with shift. Our key contributions are summarized as follows: • We present DPCR, an EFCIL technique that addresses both semantic shift and decision bias, ultimately balancing stability and plasticity in EFCIL. • To address the semantic shift, we propose the DP to capture the shift. DP comprises a TSSP for learning task-specific shifts and a CIP for offering category-specific information. By comprehensively capturing semantic shifts across tasks and categories, DP enables DPCR to effectively address semantic shift. • To address the decision bias, we formulate the RRCR. RRCR establishes a BP-free classifier training framework based on ridge regression, mitigating biases arising from new tasks. When combined with the estimated shift, RRCR yields a less biased classifier. • Extensive experiments on various benchmark datasets demonstrate that, our DPCR effectively handles semantic shift and decision bias, outperforming the state-of-the-art (SOTA) EFCIL methods with a good balance between stability and plasticity. 2 Related Works EFCIL can be categorized into regularization-based CIL ( Li & Zeng, 2023 ; Zhao et al., 2024 ; Gao et al., 2024b ) , prototype-based CIL ( Zhu et al., 2021a ; Toldo & Ozay, 2022 ; Wang et al., 2023 ) , and analytic continual learning ( Zhuang et al., 2022b ; He et al., 2024a ; Zeng et al., 2025 ) . Regularization-based CIL imposes additional constraints on activation or key parameters to mitigate forgetting. Knowledge Distillation (KD) is often employed to formulate constraints to mitigate forgetting. For instance, KD can be utilized to restrict activation changes ( Li & Hoiem, 2017 ) , establish attention distillation loss ( Dhar et al., 2019