Re-evaluating Continual Learning with Few-Shot Adaptation

Amogh Inamdar, Matthew So, Vici Milenia, Richard Zemel · 2026

Read Re-evaluating Continual Learning with Few-Shot Adaptation by Amogh Inamdar, Matthew So, Vici Milenia, Richard Zemel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03843.txt.

Introduction

Inamdar, So, Milenia, and Zemel re-evaluate continual learning through few-shot adaptation. Continual methods balance stability against plasticity across a task sequence. Standard stability scores use zero-shot recall of old tasks. That demands perfect recall and misses how fast a model can re-adapt. Few-shot evaluation gives a fuller picture of both traits.

A fine-grained study runs on continual image classification sequences. A new metric, per-shot plasticity, quantifies quick adaptation. Adding foresight changes the picture in a notable way. Meta-learning a short run of future tasks induces learning-to-learn across the sequence. Popular strategies look different under this lens than under zero-shot scoring. Some methods retain more usable knowledge than raw recall suggests. The work argues for richer evaluation before ranking continual methods. Benchmark designers get a concrete alternative protocol.

Catalog record

CREATORAmogh Inamdar, Matthew So, Vici Milenia, Richard Zemel
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03843

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Re-evaluating Continual Learning with Few-Shot Adaptation Amogh Inamdar, Matthew So, Vici Milenia, Richard Zemel Abstract Continual learning methods aim to maximize the stability and plasticity of machine learning models that are trained on a sequence of tasks. The standard measure of stability (i.e., forgetting) is the 0-shot performance of a model on previously learned tasks, and plasticity, the performance on the most recently learned task. However, 0-shot evaluation does not fully measure a model or method’s ability to retain learned information or adapt quickly to new information, as it requires perfect recall across multiple tasks. In this paper, we propose few-shot evaluation as a more comprehensive assessment of the stability and plasticity of a continual learning system. We conduct a fine-grained assessment on task sequences for continual image classification and find that this paradigm produces novel insights into the performance of popular continual learning strategies. Through few-shot evaluation with a novel metric— per-shot plasticity —we show that adding ‘foresight’ to continual learning methods via the meta-learning of a short sequence of future tasks induces learning-to-learn behavior over the task sequence. 1 Introduction The stability-plasticity dilemma of continual learning (CL) arises from the difficulty in retaining performance on prior tasks (‘stability’) while also maximizing performance on the current task (‘plasticity’) when training a machine learning (ML) model on a sequence of tasks. As ML models grow both increasingly capable and increasingly expensive to train, the need for continuous and incremental model updates has brought this dilemma to the forefront of ML research. At the time of writing, the standard measure of the stability of a model as its resistance to catastrophic forgetting ( 39 ; 20 ; 22 ) , or the irrecoverable loss of performance on previously learned tasks when a model learns a new task. Plasticity , which represents how well a model can learn new information, is typically measured by the performance of a model on the task that it was most recently optimized to learn 15 . However, we find that this evaluation paradigm does not capture multiple key characteristics of continually trained models. Firstly, while a CL model may not show a high recall on previously learned tasks after optimizing on a new task, this ‘forgetting’ is not necessarily catastrophic. Natural learners (like humans) often require warm-up via cued recall to switch context and perform well on previously learned tasks 47 . The rapid re-acquisition of seemingly forgotten concepts, known as the relearning effect ( 17 ) , is a well-studied phenomenon in humans 40 and other animals ( 41 ; 43 ) . Similarly, a stable CL model may efficiently regain past performance—an aspect that is not measured by existing metrics for forgetting or backward transfer. Evaluating after adapting with a few task examples may recover past information that is not completely inaccessible, but simply has a low probability of surfacing due to the most recent optimization. Secondly, while the mitigation of catastrophic forgetting (stability) is a well-studied problem in continual learning, plasticity is often treated as an afterthought, and measured only as the ability to learn a new task through direct optimization. In contrast, plasticity in learning systems can improve as learning progresses, via, e.g., the learning of shared task structure ( 1 ; 5 ) . A related metric that is occasionally studied in CL is 0-shot forward transfer 37 , which measures the average performance on tasks that have not yet been learned. However, this metric is trivially zero when new tasks do not share the same outputs (e.g. class labels) as learned tasks, and only measures the ability to generalize across tasks in shared domains. An ideal metric for plasticity should also measure within-task adaptation —how efficiently a model adapts to a new task, i.e., its relative improvement with limited information or training. This definition is better aligned with natural learning, and enables plasticity to be measured and aggregated over tasks with differing inputs, outputs, and relative difficulty. In this work, we propose a novel paradigm for evaluation in continual learning that addresses both of these issues: continuous evaluation with few-shot adaptation . Modern ML models, particularly for vision and language, exhibit an impressive few-shot learning ability to perform tasks with very little new information and computation compared to full-fledged task training 31 ; 10 . We train neural networks on task sequences for vision classification and conduct a large-scale evaluation of each checkpoint on every learning task with few-shot adaptation, finding surprising results with popular CL methods. We introduce a novel metric— per-shot plasticity —that measures the rapidity of adaptation of a model to a task, providing additional insight into the dynamics of continual learning. We also develop a simple but novel method that meta-initializes the learner on future samples prior to each task, optimizing for learning-to-learn ability without sacrificing fine-tuning or backward performance. Figure 1 : Few-shot evaluation and adaptation in continual learning. A model \theta_{0} is trained on a task sequence \mathcal{T}_{1}\rightarrow\cdots\rightarrow\mathcal{T}_{S} and evaluated on every task at each post-task checkpoint. We propose evaluation with few-shot adaptation to the task data ( violet ), and show surprising results with existing methods. We also develop a foresight meta-learning algorithm ( blue ) that rolls back the model at task t+L to task t and leverages the intermediate sequence to improve few-shot performance, and a novel metric for measuring plasticity and learning-to-learn ability as rapid adaptation (Section 5 ). 2 Related Work 2.1 Continual Learning With the rise of powerful multi-task deep learning models, continual learning—the training and evaluation of models on a sequence of tasks —is an increasingly popular paradigm in machine learning research. Each task in the sequence may add a new set of elements to existing objectives ( class-incremental ), switch to an entirely different set of objectives ( task-incremental ), or shift the training data distribution ( domain-incremental CL) 50 ; 6 . Existing methods for continual learning focus primarily on mitigating catastrophic forgetting 39 ; 20 . Of these, replay -based strategies that focus on storing and re-training on past examples 35 ; 3 ; 2 ; 36 are the most popular 6 . Other strategies focus on distilling previous model states 12 , regularizing the model to prevent information loss 29 ; 37 ; 13 , or modifying the model architecture as new tasks are learned 34 ; 21 . We present a more extensive review in Appendix A . While some recent work has shifted focus to the continual pre-training of massive-scale foundation models ( 26 ; 33 ) , the scale and high redundancy 49 of pretraining data limit the ability to conduct robust experimentation, and likely also the effectiveness of curricula. Image classification remains the primary domain for studies on continual learning 6 , and we focus on studying the continual image classification setting in this work. 2.2 Evaluation in Continual Learning Recent work has emphasized the importance of continuous evaluation over the task sequence 14 to fully characterize the effects of continual learning. Rather than a single metric summarizing a complex setting, the standard practice is to measure a model’s ‘stability’ on previously learned tasks 20 , and its ‘plasticity’ on the most recently learned task 15 . Formally, let

Read the complete text