Tunable MAGMAX: Preference-Aware Model Merging for Continual Learning

Kei Hiroshima, Kento Uchida, Shinichi Shirakawa · 2026

Read Tunable MAGMAX: Preference-Aware Model Merging for Continual Learning by Kei Hiroshima, Kento Uchida, Shinichi Shirakawa (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20803.txt.

Introduction

Kei Hiroshima, Kento Uchida, and Shinichi Shirakawa propose Tunable MAGMAX, a preference-aware model merging design for continual learning. Continual learning trains models on tasks in sequence while fighting drastic forgetting of earlier knowledge. Existing merging methods focus on average scores and ignore how different deployment settings or user tastes might rank tasks. Their method adds a taste vector that controls how many parts are taken from each task vector during merging, letting merged scores follow deployment needs.

Catalog record

CREATORKei Hiroshima, Kento Uchida, Shinichi Shirakawa
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43018
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20803

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Tunable MAGMAX: Preference-Aware Model Merging for Continual Learning Kei Hiroshima, Kento Uchida, Shinichi Shirakawa Abstract Continual learning (CL) aims to train models sequentially on multiple tasks while mitigating catastrophic forgetting of previously learned knowledge. Recent advances in large pre-trained models (LPMs) and model merging techniques, such as MAGMAX, have demonstrated effective CL performance by combining task-specific parameters. However, existing methods primarily focus on average performance across all tasks and do not adequately address how to construct models accommodating different deployment environments or varying user preferences. This paper proposes a model merging framework, termed Tunable MAGMAX, which enables preference-aware control of task-specific performance in CL. Our method introduces a preference vector that controls the number of elements selected from each task vector during model merging, allowing us to adjust the merged model performance according to their deployment needs. We further propose a method for automatically constructing appropriate preference vectors by leveraging small amounts of target environment data and datasets from model training tasks, thereby eliminating the need for manual specification. The experimental result on CL benchmark tasks demonstrates that Tunable MAGMAX effectively controls task-wise performance and successfully adapts merged models to various target environments. The proposed Tunable MAGMAX achieves superior or comparable performance to baseline methods, making it a practical solution for deploying CL models to various environments where the preferences of each task performance differ. 1 Introduction In continual learning (CL), a machine learning model is trained sequentially on a series of tasks without access to data from previous tasks [ 19 ] . The objective of CL is to obtain a generalized model across all tasks by adapting to incoming tasks while retaining knowledge from previously trained tasks. Models trained in CL often suffer from catastrophic forgetting (CF), a phenomenon where performance on previous tasks degrades due to biased training on the current task. To alleviate CF, many CL techniques have been developed. The major techniques can be categorized into three groups: adding regularization terms to the loss function to maintain knowledge of previously trained tasks [ 11 , 13 ] , expanding the model architecture to avoid parameter interference among training tasks [ 17 ] , and utilizing replay buffers that store small amounts of data from previous tasks to enable retraining [ 2 ] . These traditional techniques have mainly been evaluated on relatively simple models with limited capacity, such as deep and convolutional neural networks. Nowadays, large pre-trained models (LPMs), including large-scale Vision Transformers pre-trained on extensive datasets (e.g., ImageNet [ 6 ] and LAION-400M [ 18 ] ), have become a common tool, owing to rapid advancements in deep learning technology [ 4 , 16 ] . These models have a large capacity and perform remarkably well on a wide variety of tasks. In addition, model merging, a cost-efficient approach to developing models tailored to specific tasks [ 1 , 3 ] , has been investigated [ 9 , 21 ] . Model merging creates a new model tailored to a given task by combining multiple model parameters fine-tuned on different tasks from a common LPM. LPMs are also adopted as base models in CL. In such scenarios, it is crucial not only to mitigate CF during training but also to effectively leverage the general capabilities of LPMs. Maximum Magnitude Selection (MAGMAX) [ 14 ] demonstrated the effectiveness of LPMs and model merging in CL by utilizing model parameters corresponding to sequentially fine-tuned models across a sequence of tasks. In MAGMAX, the task vector is defined as the difference between the base pre-trained model parameters and those of the sequentially fine-tuned model from the base model. The task vectors obtained for each trained task are merged by selecting the value with element-wise maximum absolute magnitude across the task vectors. Despite having relatively low space and time complexities, MAGMAX outperforms other CL and model merging methods. Previous works on CL have focused on improving average performance across all trained tasks. In contrast, the importance of each task can vary depending on user demands or deployment environments in practical situations. For instance, in medical diagnosis systems, different hospitals may prioritize different disease detection tasks based on their specialization, such as tumor detection or cardiac abnormality detection. However, due to limited computational resources and insufficient training data available at each hospital, they often rely on a published pre-trained model trained on general medical tasks and customize it to emphasize only the most relevant tasks for their specific needs. Similarly, in autonomous driving, vehicles deployed in different geographical regions, such as rainy or snowy climates, or urban versus highway environments, require different emphases on region-specific driving tasks, even though the base LPM is pre-trained to cover a wide range of driving conditions during pre-training. From this perspective, existing CL techniques have not adequately addressed how to construct models flexibly to reflect these diverse and deployment-specific task priorities. In that sense, it is unclear whether MAGMAX [ 14 ] remains effective. In fact, Marczak et al. [ 14 ] reported that the task vector corresponding to the last trained task accounted for more than 40% of the elements of the merged task vector. This dominance can lead to inferior performance compared to other existing methods on some tasks, even though MAGMAX achieves the highest average performance. In this paper, we propose a novel model-merging-based CL method for preference-aware control of performances for each task by extending MAGMAX. The proposed method, Tunable MAGMAX, adjusts the number of elements selected from each task vector during model merging based on a preference vector. We further introduce a method that automatically sets the preference vector and constructs an appropriate merged model tailored to various target environments with a lower computational cost than training their own model from scratch. In our method, a preference vector is determined based on the dataset similarity, such as one defined using the optimal transport (OT) distance [ 10 ] and the label distribution similarity, between a small amount of target environment data and datasets from the model training tasks. We conduct validation experiments based on CL benchmarks to compare our proposed method with the existing model merging methods. Experimental results demonstrate that our proposed method successfully controls task-wise performance, and our method constructs suitable merged models for given target environments by controlling the preference vector based on dataset similarity. Our contributions are summarized as follows: • We propose Tunable MAGMAX, a preference-aware model merging for CL, that regulates the number of elements selected from each task vector to control task-wise performance. • We propose a method to construct merged models tailored to target environments based on dataset similarity between small amounts of target environment data and datasets from model training tasks. • Through the experimental evaluation on CL benchmarks, we demonstrate that our framework successfully constructs preferable merged models for various target environments. 2 Related Works 2.1 Continual Learning In continual learning (CL) settings, a single model is repeatedly trained on multiple tasks in a sequence while being required to maintain its knowledge from previously trained tasks without access to training data from those tasks. The domain, class, and task incremental learning are widely known CL settings in classification tasks [ 19 ] . In domain incremental learning, tasks

Read the complete text