Forgetting is Everywhere
Ben Sanati, Thomas L. Lee, Trevor McInroe, Aidan Scannell, Nikolay Malkin, David Abel, Amos Storkey University of Edinburgh, School of Informatics { b.sanati,s2191233,t.mcinroe,aidan.scannell, nmalkin,david.abel,a.storkey } @ed.ac.uk \left\{\text{\begin{minipage}[234.87749pt]\tt b.sanati,s2191233, · 2025
Read Forgetting is Everywhere by Ben Sanati, Thomas L. Lee, Trevor McInroe, Aidan Scannell, Nikolay Malkin, David Abel, Amos Storkey University of Edinburgh, School of Informatics { b.sanati,s2191233,t.mcinroe,aidan.scannell, nmalkin,david.abel,a.storkey } @ed.ac.uk \left\{\text{\begin{minipage}[234.87749pt]\tt b.sanati,s2191233, (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04666.txt.
Introduction
Ben Sanati leads seven authors building a unified theory of forgetting in learning systems. Algorithms tend to lose old knowledge as they adapt to new data. Decades of study produced no shared definition that explains the dynamics behind it.
Their theory defines forgetting as a loss of self-consistency in the learner's predictions. Put plainly, the model stops agreeing with its own earlier predictive information. From that view, a general measure of forgetting propensity follows naturally. They also prove exact Bayesian inference can adapt without forgetting, and explain why generative models degrade when trained on their own output.
Catalog record
| CREATOR | Ben Sanati, Thomas L. Lee, Trevor McInroe, Aidan Scannell, Nikolay Malkin, David Abel, Amos Storkey University of Edinburgh, School of Informatics { b.sanati,s2191233,t.mcinroe,aidan.scannell, nmalkin,david.abel,a.storkey } @ed.ac.uk \left\{\text{\begin{minipage}[234.87749pt]\tt b.sanati,s2191233, |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-04666
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Forgetting is Everywhere Ben Sanati, Thomas L. Lee, Trevor McInroe, Aidan Scannell, Nikolay Malkin, David Abel, Amos Storkey University of Edinburgh, School of Informatics { b.sanati,s2191233,t.mcinroe,aidan.scannell, nmalkin,david.abel,a.storkey } @ed.ac.uk \left\{\text{\begin{minipage}[234.87749pt]\tt b.sanati,s2191233,t.mcinroe,aidan.scannell,\\ nmalkin,david.abel,a.storkey\end{minipage}}\right\}\text{\[email protected]} Abstract A fundamental challenge in developing general learning algorithms is their tendency to forget past knowledge when adapting to new data. Addressing this problem requires a principled understanding of forgetting; yet, despite decades of study, no unified definition has emerged that provides insights into the underlying dynamics of learning. We propose an algorithm- and task-agnostic theory that characterises forgetting as a lack of self-consistency in a learner’s predictive distribution over future experiences, manifesting as a loss of predictive information. Our theory naturally yields a general measure of an algorithm’s propensity to forget. To validate the theory, we design a comprehensive set of experiments that span classification, regression, generative modelling, and reinforcement learning. We empirically demonstrate how forgetting is present across all learning settings and plays a significant role in determining learning efficiency. Together, these results establish a principled understanding of forgetting and lay the foundation for analysing and improving the information retention capabilities of general learning algorithms. † † Project page: https://ben-sanati.github.io/forgetting-is-everywhere-project/ . 1 Introduction Forgetting is a ubiquitous yet poorly understood phenomenon in machine learning ( 29 ) . When a learner updates its beliefs based on new observations, it often forgets prior knowledge, leading to a degradation in performance on previous observations. Although this behaviour is well documented in continual learning (CL; 23 , 23 ) and reinforcement learning (RL; 4 , 4 ; 21 , 21 ), it is not confined to non-stationary settings. Even under standard training regimes with independent and identically distributed (i.i.d.) data, models can forget previously acquired abilities, reducing learning efficiency and stability ( 28 ) . Classical learning theory offers limited tools to analyse forgetting. Concepts such as bias, variance, and generalisation describe performance at fixed times, typically used at convergence. Forgetting, by contrast, is inherently temporal ; it concerns what a model retains, what it discards, and how it balances adaptation with stability over time ( 20 ) . Most existing studies of forgetting come from the CL literature, where metrics typically track performance degradation on earlier tasks after training on later tasks ( 8 ) . Although these measures are widely adopted, they poorly capture forgetting and frequently conflate two distinct phenomena: backward transfer , where new learning improves performance on past tasks ( 5 ) , and forgetting , where updates erode prior knowledge ( 20 ) , making it challenging to distinguish between constructive and destructive adaptation. In this paper, we introduce a new conceptual foundation for understanding forgetting, built on the following insight: If a learner updates its predictions on data it already expects, such an update cannot represent the acquisition of new information; it must instead represent the loss of previously acquired knowledge. This allows us to characterise forgetting in a precise and general manner. We ask: What is forgetting? When and why does it occur? How does forgetting impact learning? We address these questions through the following contributions: 1. Formulation of learning over time : Inspired by 19 and 11 , we define a general theoretical formulation for reasoning about how learners acquire, retain, and lose capabilities during learning ( Section 3 ). 2. Conceptualisation of forgetting : Building on our insight, we formulate forgetting from a predictive perspective : as a property of how a learner’s predictions evolve over time. Specifically, we define forgetting as a violation of self-consistency in the learner’s predictive distribution, providing a unified probabilistic foundation that generalises prior conceptions of forgetting ( Section 4.2 ). 3. Operational measure : This conceptualisation naturally yields a measure of the propensity to forget, which we propose to assess the validity of our formalism ( Definition 4.2 ). 4. Empirical characterisation : We empirically investigate the propensity to forget across diverse environments and learning paradigms, including regression, classification, generative modelling, CL, and RL. The results confirm that the observed forgetting dynamics conform to the expected theoretical characteristics of forgetting and further reveal a trade-off between forgetting and training efficiency, with deep RL being particularly susceptible to forgetting ( Section 5 ). 2 Related work In this paper, we study the prevalence of forgetting in general learning algorithms. While terminology varies across fields, all phenomena involving the loss of previously acquired knowledge reflect the same underlying process. For clarity, we refer to all such phenomena collectively as forgetting . Forgetting in supervised settings. Forgetting is often studied in the context of CL ( 10 ; 40 ) . In this literature, various proxy metrics are used to measure forgetting in settings where a learner encounters data sequentially from different distributions. Here, forgetting is calculated as the change in performance on previously observed distributions ( 23 ; 9 ; 8 ) . However, this approach cannot distinguish between two distinct effects: backwards transfer , where learning on new data improves performance on past tasks ( 5 ) , and forgetting, where learning on new data degrades previously acquired knowledge ( 29 ; 20 ) . Performance on previous tasks depends on both how current data informs the learner about past data ( backwards transfer ) and the extent to which updating on new tasks results in a loss of previous knowledge. Furthermore, most metrics are limited to CL settings and do not generalise to all learners or domains, motivating the need for a more general definition of forgetting. Various approaches have sought to quantify forgetting. In toy settings with known data distributions, forgetting can be measured relative to an oracle ( 27 ) . Others examine changes in internal representations ( 22 ) or model the trade-off between generalisation and forgetting ( 31 ) . Meanwhile, mechanistic accounts in associative memory models demonstrate how interference between correlated patterns leads to retrieval errors ( 17 ; 3 ) . A related line of work studies models trained on their own generated outputs, typically in the context of generative model collapse or stability ( 2 ; 37 ; 6 ; 36 ) . These studies implicitly touch on the phenomenon we formalise as forgetting: updating a model on self-generated targets can degrade previously encoded knowledge or induce systematic shifts in its predictions. Forgetting in RL. Forgetting has also been studied in continual RL; however, it has received less systematic study than in supervised CL. Early discussions of continual RL already noted the risk of knowledge degradation when agents adapt over long time horizons ( 33 ; 32 ) . More recent surveys highlight that catastrophic forgetting is a persistent challenge in RL, where continual adaptation to changing state distributions or reward signals can interfere with previously acquired knowledge ( 21 ; 25 ) . Empirical studies document several forms of forgetting. Value-based methods with function approximation often lose performance on earlier estimates ( 30 ; 39 ) . This is closely related to the phenomenon of policy churn identified by ( 35 ) in which the greedy policy of a value-based learner changes in a large portion of the input space after just a few updates. Policy gradient methods are also prone to overwriting earlier