Measuring Representational Shifts in Continual Learning: A Linear Transformation Perspective

Joonkyu Kim, Yejin Kim, Jy-yong Sohn · 2025

Read Measuring Representational Shifts in Continual Learning: A Linear Transformation Perspective by Joonkyu Kim, Yejin Kim, Jy-yong Sohn (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20970.txt.

Introduction

Joonkyu Kim, Yejin Kim, and Jy-yong Sohn measure how a learning model's inner representations drift as it learns task after task. Their work appeared in twenty twenty-five. In continual learning, new tasks can erase old ones, a failure called catastrophic forgetting.

The authors define a new measure, representation discrepancy, comparing the inner spaces of two snapshots of one model. They prove it stands in well for representation-level forgetting while staying easy to compute. The math yields clear rules: deeper layers forget faster and harder, while wider networks forget more slowly. Tests on split image data sets, including a large standard one, back the theory. The measure gives builders a sharper tool for tracking what continual learning loses.

Catalog record

CREATORJoonkyu Kim, Yejin Kim, Jy-yong Sohn
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-20970

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Measuring Representational Shifts in Continual Learning: A Linear Transformation Perspective Joonkyu Kim, Yejin Kim, Jy-yong Sohn Abstract In continual learning scenarios, catastrophic forgetting of previously learned tasks is a critical issue, making it essential to effectively measure such forgetting. Recently, there has been growing interest in focusing on representation forgetting , the forgetting measured at the hidden layer. In this paper, we provide the first theoretical analysis of representation forgetting and use this analysis to better understand the behavior of continual learning. First, we introduce a new metric called representation discrepancy , which measures the difference between representation spaces constructed by two snapshots of a model trained through continual learning. We demonstrate that our proposed metric serves as an effective surrogate for the representation forgetting while remaining analytically tractable. Second, through mathematical analysis of our metric, we derive several key findings about the dynamics of representation forgetting: the forgetting occurs more rapidly to a higher degree as the layer index increases, while increasing the width of the network slows down the forgetting process. Third, we support our theoretical findings through experiments on real image datasets, including Split-CIFAR100 and ImageNet1K. 1 Introduction Continual learning, referred to as lifelong learning, involves training models on a sequence of tasks with the aim of achieving good performance for all tasks ( Chen & Liu, 2018 ; Hadsell et al., 2020 ; Kudithipudi et al., 2022 ) . This framework is particularly compelling as it closely mimics the human learning process; an individual continually acquires new skills and knowledge throughout their lifetime. However, unlike humans, who can retain and recall a good amount of memories from the past, the trained models experience a significant decline in performance on the previous tasks as they adapt to the new ones. This phenomenon, known as catastrophic forgetting, is described as the model losing knowledge of the previous tasks and is typically evaluated by measuring the drop in accuracy on the previous tasks ( McClelland et al., 1995 ; McCloskey & Cohen, 1989 ) . Internally, the representations of the model, that is, the hidden activations, undergo a drastic shift during continual learning as well ( Caccia et al., 2021 ) . This calls for a separate term that indicates the loss of knowledge for previous tasks in terms of the hidden representations . In this paper, we will use the term representation forgetting of task t to refer to the degradation in a model’s ability to produce high-quality features for task t . Note that we are not the first to use the term representation forgetting , as it has been used in the literature to indicate representational shifts during the continual learning process in general ( Davari et al., 2022 ; Luo et al., 2023 ; Zhang et al., 2022 ; Murata et al., 2020 ) . Understanding the behavior of the representation forgetting, which is measured at the level of the intermediate layers, is equally important to that of the observed forgetting (forgetting measured through the model’s final output), because (1) there are situations such as in unsupervised continual learning ( Rao et al., 2019 ; Fini et al., 2022 ) where our interest is in the inner representations of the model rather than the model’s output, and (2) understanding the representation forgetting itself can lead to better understanding of the observed forgetting. Although there have been several empirical results on the representation forgetting under continual learning ( Caccia et al., 2021 ; Davari et al., 2022 ; Hess et al., 2023 ; Luo et al., 2023 ) , no clear justification was provided in terms of theory. Our work addresses this gap by offering one of the first theoretical analyses of the representation forgetting. To achieve this, we introduce a novel metric, representation discrepancy , which quantifies the minimum alignment error of two representation spaces under a linear transformation. We show that this metric not only effectively measures representation forgetting, but also enables analytical feasibility. Using the representation discrepancy, we focus on comparing the representations of two models h_{t} and h_{t+\Delta t} , where h_{t} represents the model trained incrementally up to task t , and analyze how the representation evolves over the continual learning process. Our main contributions are summarized as below. Main Contributions: • We propose a novel metric representation discrepancy , denoted by D_{t}^{k}(h_{t},\Delta t){} , which measures the discrepancy of the representation spaces of models h_{t} and h_{t+\Delta t} (for task t at layer k ), when an optimal linear transformation {\bm{T}} is applied to align the spaces. We show that D_{t}^{k}(h_{t},\Delta t){} serves as an effective surrogate for the representation forgetting of task t while also being analytically feasible. • We construct an upper bound U^{k}_{t}(\Delta t) on D_{t}^{k}(h_{t},\Delta t){} using the theoretical framework proposed by Guha & Lakshman (2024) and derive three main theoretical findings. First, U^{k}_{t}(\Delta t) exhibits two distinct phases: the forgetting phase , during which it monotonically increases with \Delta t (the number of tasks learned after task t ), and the saturation phase , where it gradually converges to the asymptotic value. Second, the asymptotic representation discrepancy U^{k}_{t,\infty}:=\lim_{\Delta t\to\infty}U^{k}_{t}(\Delta t) is linearly proportional to the size 1 1 1 The size of the k -th layer representation space of task t is the norm of its biggest feature, as defined in Def. 2 . of the representation space. Third, U^{k}_{t}(\Delta t) enters the saturation phase more quickly in the upper layers ( i.e., higher k ) compared to the lower layers, while increasing the width of the model delays the transition to the saturation phase. • We support our theoretical findings through experiments on real image datasets, including Split-CIFAR100 and ImageNet1K. Furthermore, we empirically observe a strong linear relationship between the layer index k and the size of the representation space. Combined with our second theoretical result shown above, we conclude that the asymptotic representation discrepancy increases linearly with the layer index k . 2 Related Works 2.1 Continual Learning Theory Several prior works have conducted theoretical analyses of continual learning. These works can be categorized according to the modeling of the continual learning setup and their analytical framework. A simple yet effective approach assumes the model to be linear, with each task framed as a regression problem ( Ding et al., 2024 ; Zhao et al., 2024 ; Evron et al., 2022 ; Lin et al., 2023 ; Li et al., 2023 ; Heckel, 2022 ) . Here, the drift in the weights during the continual learning process is generally used as a measure of the forgetting or the generalization error. For instance, Evron et al. (2022) ; Lin et al. (2023) ; Ding et al. (2024) examines how task sequence properties ( e.g., number of tasks, task ordering, task similarity) influence the error. Meanwhile, Heckel (2022) ; Li et al. (2023) ; Zhao et al. (2024) focuses more on the impact of regularization on the error. Another line of work employs the well-established theoretical teacher-student framework ( Saad & Solla, 1995b ; Saad & Solla, 1995a ; Yoshida & Okada, 2019 ; Goldt et al., 2019 ; Straat et al., 2022 ) to study continual learning ( Lee et al., 2021 ; Asanuma

Read the complete text