Dynamic Allocation Hypernetwork with Adaptive Model Recalibration for Federated Continual Learning
Xiaoming Qi, Jingyang Zhang, Huazhu Fu, Guanyu Yang, Shuo Li, Yueming Jin* · 2025
Read Dynamic Allocation Hypernetwork with Adaptive Model Recalibration for Federated Continual Learning by Xiaoming Qi, Jingyang Zhang, Huazhu Fu, Guanyu Yang, Shuo Li, Yueming Jin* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-18064.txt.
Introduction
Xiaoming Qi and co-authors proposed in 2025 a server-side method for federated learning that must keep learning new tasks across sites, above all in medicine. Tasks arrive at different times at different clients. Old methods forget earlier tasks and clash when clients aim at different targets at the same step.
Their design uses a hypernetwork that maps each task identity to its own model settings, updated as tasks change. A recalibration step folds past model changes into current updates, weighted by task likeness. Tests on a medical image set beat rival methods across sites with different task streams. Code was shared in public.
Catalog record
| CREATOR | Xiaoming Qi, Jingyang Zhang, Huazhu Fu, Guanyu Yang, Shuo Li, Yueming Jin* |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-18064
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Dynamic Allocation Hypernetwork with Adaptive Model Recalibration for Federated Continual Learning Xiaoming Qi, Jingyang Zhang, Huazhu Fu, Guanyu Yang, Shuo Li, Yueming Jin* Abstract Federated continual learning (FCL) offers an emerging pattern to facilitate the applicability of federated learning (FL) in real-world scenarios, where tasks evolve dynamically and asynchronously across clients, especially in medical scenario. Existing server-side FCL methods in nature domain construct a continually learnable server model by client aggregation on all-involved tasks. However, they are challenged by: (1) Catastrophic forgetting for previously learned tasks, leading to error accumulation in server model, making it difficult to sustain comprehensive knowledge across all tasks. (2) Biased optimization due to asynchronous tasks handled across different clients, leading to the collision of optimization targets of different clients at the same time steps. In this work, we take the first step to propose a novel server-side FCL pattern in medical domain, Dynamic Allocation Hypernetwork with adaptive model recalibration ( FedDAH ). It is to facilitate collaborative learning under the distinct and dynamic task streams across clients. To alleviate the catastrophic forgetting, we propose a dynamic allocation hypernetwork (DAHyper) where a continually updated hypernetwork is designed to manage the mapping between task identities and their associated model parameters, enabling the dynamic allocation of the model across clients. For the biased optimization, we introduce a novel adaptive model recalibration (AMR) to incorporate the candidate changes of historical models into current server updates, and assign weights to identical tasks across different time steps based on the similarity for continual optimization. Extensive experiments on the AMOS dataset demonstrate the superiority of our FedDAH to other FCL methods on sites with different task streams. The code is available:https://github.com/jinlab-imvr/FedDAH. 1 Introduction Federated learning (FL) [ 14 , 6 , 19 , 26 , 22 ] is proposed as a paradigm to learn from decentralized data with privacy protection in different clinical centers (clients) and collaboratively learn a global model in server. However, since disease evolves, the development and deployment of treatment options and medical devices occur at varying rates across different clinical centres, this necessitates that clients continuously learn new tasks dynamically and adapt to varying task orders asynchronously [ 21 ] . These realities limit the applicability of FL in real-world clinical scenarios (Fig. 1 ). Hence, how to make clients adapt to dynamic and asynchronous task learning, while preserving effective collaborative training, is crucial for facilitating the real-world deployment of the FL model. Figure 1: Task: Since disease evolves and treatment options change, different clients require to continually evolves on different task orders (asynchronous) or add new tasks (dynamic). Challenge: The construction of a server-side FCL model is challenged by: 1) Catastrophic forgetting for previously learned tasks. 2) Biased optimization due to asynchronous tasks. To this end, we focus on a more practical FL setting where clients handling dynamic tasks with asynchronous evolution, namely federated continual learning (FCL). Some previous studies propose client-side based methods to meet the challenges in FCL [ 20 , 1 , 23 ] , which simply employs the off-the-rack continual learning (CL) methods onto client-side updating in federated learning (Fig. 1 ). However, the client-side FCL ignores the server-side aggregation and breaks the interaction across clients, without effectively utilizing the substantial knowledge available across other clients. Some server-side FCL methods are proposed recently in natural domain [ 6 , 22 , 3 , 16 ] , which aim to construct a continually learnable server model by efficient client aggregation on all-involved tasks. For example, the historical data is utilized to recover the previous optimization by knowledge distillation [ 24 , 16 ] and consistency constraints [ 5 , 6 , 12 ] in the server fusion process. However, to our best knowledge, the server-side FCL method is still underexplored in medical domain. Meanwhile, we have identified two main limitations in these existing server-side FCL works: 1) Catastrophic forgetting for previously learned tasks, especially historical data is unavailable for server and future unknown task in FCL. The server accumulates error in FCL and can hardly preserve all task knowledge without data in retraining. 2) Biased optimization due to asynchronous tasks handled across different clients. The existing FCL methods assume each client have the same task order in continual learning. However, the real-world medical sites utilize different task orders in FCL. This leads to the collision of optimization targets of different sites at the same time steps, hindering the provision of an optimal server model for all tasks to each client. To meet above limitations, one main critical factor lies in how to improve the server memory with harmonious optimization. In this work, our core insight and contribution is to effectively equip the hypernetwork [ 9 ] onto the server design to achieve this goal. The idea is motivated by the advantage of the hypernetwork, which can learn an task-specific mapping from a task identity to the task model weights, providing a feasible way to replay all task models of clients to reduce server forgetting and thus facilitate the harmonious optimization. However, there exist some challenges to effectively utilize hypernetwork to tackle FCL problems. For asynchronously evolving tasks in each client, the mapping learning by hypernetwork would be confused with the task-hypernetwork correspondence, misguiding the server optimization. In addition, for server updating, hypernetwork should be recalibrated to update faster for new tasks and slower for existing tasks, which further prompts harmonious optimization. In this paper, we propose a novel server-side FCL pattern, termed dynamic allocation hypernetwork with adaptive prototype recalibration ( FedDAH ), aiming to tackle a more realistic collaborative learning setting where distinct and dynamic task streams present in different clients. Specifically, we first propose a dynamic allocation hypernetwork (DAHyper) module. DAHyper presents a continually updated hypernetwork for managing the mapping between task identities and their associated model parameters, enabling dynamic allocation of model parameters across various clients. Through the identity of task I, the hypernetwork is trained to preserve the model parameters of task I. By this setting, the server can establish the mappings between all tasks and model parameters. This enables server updates to leverage all task models learned by clients without accumulating errors. We further design an adaptive model recalibration (AMR) . Benefiting from the defined mapping mechanism between task and model parameter, the server could obtain the same task parameter in the asynchronous tasks. AMR assigns a calibration to each model optimization based on the contrastive similarity, enabling rapid integration of new knowledge from new task models while retaining previously learned knowledge with less fading. We have conducted extensive experiments on AMOS dataset for abdominal organ segmentation with multi-center, multi-vendor, multi-modality, multi-phase, multi-disease patients. Our FedDAH achieves the substantial improvement compared with the state-of-the-art methods. Overall, our contributions can be summarized as follows: 1. For the first time, we propose a novel server-side FCL pattern in the medical scenario, FedDAH, to tackle a more practical collaborative training setting where different clinical clients have their distinct and dynamic task streams. 2. A novel server-side model aggregation pattern, DAHyper, is proposed to manage and allocate the model parameters across various clients without error accumulation caused by forgetting in FCL. 3. A novel server-side model optimization strategy, AMR, is proposed to calibrate the