Continual Learning for Sequential Personalization of Small Language Models: A Stability Monitoring Analysis

Thomas S. Paula, Lucas S. Kupssinskü, Rodrigo C. Barros · 2026

Read Continual Learning for Sequential Personalization of Small Language Models: A Stability Monitoring Analysis by Thomas S. Paula, Lucas S. Kupssinskü, Rodrigo C. Barros (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-27634.txt.

Introduction

Small language models increasingly run on laptops and other edge devices. Local running gives privacy and low delay. Personal use needs the model to adapt over time, though. Adapting brings a risk called catastrophic forgetting. New learning can damage older skills. Thomas Paula, Lucas Kupssinskü, and Rodrigo Barros study this risk in 2026.

Their setup personalises models step by step with LoRA adapters. A checkpoint is saved after each adaptation stage. Each checkpoint is tested on current tasks, older tasks, and a fixed reference set. This protocol tracks performance, forgetting, and drift over time. Lightweight diagnostics on the reference set reveal instability patterns that are specific to each model. Some harmful adaptation stays hidden when only task scores are watched. One signal stands out. KL divergence often warns of internal damage before task scores collapse. Stability also seems tied to architecture. Gemma swung widely, while Qwen stayed anchored across task orders.

Catalog record

CREATORThomas S. Paula, Lucas S. Kupssinskü, Rodrigo C. Barros
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.27634

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Continual Learning for Sequential Personalization of Small Language Models: A Stability Monitoring Analysis Thomas S. Paula, Lucas S. Kupssinskü, Rodrigo C. Barros Abstract Small Language Models (SLMs) are increasingly being considered for deployment on edge devices such as laptops, enabling private, low-latency, and locally personalized applications. However, personalization requires models to adapt over time to evolving user- or task-specific data, placing them in a continual learning setting. This creates the risk of catastrophic forgetting, where learning new information degrades performance on previously learned tasks or broader model capabilities. Recent benchmarks such as TRACE have shown that continual fine-tuning can significantly degrade the general abilities of aligned large language models. In this work, we present a study for sequential LoRA personalization of SLMs. We save model checkpoints after each adaptation stage and evaluate them on current tasks, previously seen tasks, and a fixed reference set. This checkpoint-level protocol enables us to monitor task performance, forgetting, and reference set drift over time. We show that lightweight reference set distributional diagnostics can reveal model-specific instability patterns during sequential LoRA personalization of SLMs, including cases where task-level metrics alone hide harmful adaptation. We hope this can highlight new research avenues for monitoring stability of SLMs in a continual learning setting. 1 Introduction Large Language Models (LLMs) demonstrated strong performance across a variety of natural language processing tasks, becoming pervasive across applications and domains. Although most of the state-of-the-art models run on the cloud, there is a recent effort on deploying LLMs to the edge, motivated by privacy, personalization, and dedicated compute such as Neural Processing Units (NPUs) ( 26 ) . In order to do so, techniques such as quantization, pruning, and distillation have been employed to compress the models to a size that can fit on edge devices. The research and industry communities have called these models Small Language Models (SLMs), which allow significant computational savings in pre-training, fine-tuning, and inference with reduced memory and storage needs due to the smaller parameters count ( 22 ) . SLMs are increasingly relevant for edge and personal computing scenarios, where local inference can provide lower latency, improved privacy, and reduced dependence on cloud services. In these settings, personalization becomes a natural requirement: models may need to adapt to user- or task-specific preferences, domains, writing styles, or any other data distributions over time. However, sequential personalization introduces a continual learning problem. A model adapted to a new task or user distribution may degrade on previously learned tasks or on broader reference behavior. This phenomenon is commonly studied as catastrophic forgetting ( 5 ) . In deployed SLM systems, the system also must remain useful, predictable, and stable across a sequence of updates. Recent benchmarks such as TRACE ( 24 ) show that continual fine-tuning can degrade aligned LLMs across sequential tasks and broader capabilities, including general ability and instruction following. TRACE evaluates models over diverse sequential tasks and uses metrics such as Overall Performance (OP) and Backward Transfer (BWT), while also introducing broader deltas for general ability, instruction following, and safety. However, most recent papers building on top of such benchmarks do not focus on edge scenarios, where the size of the models and the amount of available memory make it even more challenging. Motivated by this landscape, we study sequential personalization of SLMs from a stability monitoring perspective. Our focus is to evaluate how an SLM behaves when adapted sequentially using a lightweight parameter-efficient method. In particular, we ask whether checkpoint-level evaluation can expose useful signals about acquisition, forgetting, transfer, and stability during personalization. We present a monitoring protocol inspired by the evaluation logic of TRACE, but focused on a smaller number of tasks and stability. A base SLM is adapted sequentially across a small number of tasks using LoRA ( 7 ) . After each adaptation stage, the resulting checkpoint is evaluated not only on the current task, but also on previously seen tasks, future tasks, and a fixed reference set. This produces a checkpoint-by-task matrix that allows us to track how model behavior evolves over time. This paper makes three contributions 1 1 1 Code is available at: https://github.com/tspthomas/slm_stability_cl : 1. We operationalize sequential personalization of SLMs as a checkpoint-level stability monitoring problem. Rather than evaluating only final-task performance, we track how each adaptation stage affects current-task acquisition, retention on previous tasks, transfer to future tasks, and behavior on a fixed reference set. 2. We introduce a lightweight monitoring protocol for cumulative LoRA personalization of SLMs. It combines a checkpoint-by-task evaluation matrix with standard continual learning metrics and reference set diagnostics. 3. We provide an empirical analysis across three SLM families and three tasks, identifying an order-invariant internal stability signature. We demonstrate that KL Divergence may serve as an early-warning signal for model health. Overall, the study positions reference set monitoring as a practical diagnostic tool for long-running SLM personalization. While not intended as a comprehensive benchmark or a new continual learning algorithm, results show that checkpoint-level stability signals can expose failure modes that are not visible from final accuracy alone. 2 Background 2.0.1 Continual Learning and Evaluation of Language Models. Continual learning is a machine learning approach for learning continuously, accumulating the knowledge learned in previous tasks, and using it to help future learning ( 2 ) . It breaks the traditional assumption that the data distribution remains static, connecting better with real-world applications where data is non-stationary ( 27 ) . The key objectives of CL are to avoid catastrophic forgetting and facilitate knowledge transfer ( 1 ) . In LLMs, this phenomena is quite important because continuous fine-tuning may degrade general capabilities learned during pre-training or later stages. TRACE ( 24 ) is a benchmark designed to evaluate CL in LLMs. The authors show that continual fine-tuning can degrade aligned LLMs across sequential tasks and broader capabilities, including general ability and instruction following. Existing CL benchmarks for LLMs focus primarily on measuring task performance and capability degradation, whereas our work focuses on checkpoint-level stability monitoring for cumulative LoRA personalization of SLMs. 2.0.2 Parameter-Efficient Adaptation for Personalization. Fine-tuning all parameters of large language models is prohibitive for most use cases due to the memory and processing requirements. Parameter Efficient Fine-Tuning (PEFT) emerged as a promising technique, where less parameters are trained, in a memory-efficient manner ( 6 ) . Low-Rank Adapdation (LoRA) is a well-known parameter-efficient fine tuning method, which adapts LLMs to downstream tasks without the large computational cost as a full fine-tuning approach ( 7 ) . Multiple LoRA variants emerged recently, including QLoRA ( 3 ) , which combines 4-bit quantization with LoRA to enable memory efficient fine-tuning of LLMs; and O-LoRA ( 23 ) , which extends LoRA for continual learning, having a new LoRA module for each task in a temporal sequence. These works demonstrate efficient approaches that are suitable for on-device personalization, but they do not study stability of the adaptation process over time. 2.0.3 Stability and Drift Monitoring During Adaptation General continual learning metrics emphasize task accuracy, forgetting, and transfer, which not always reflect why models are degrading. In sequential personalization tasks, a model may improve on the current task while drifting away from its original behavior — it may have lost capabilities learned

Read the complete text