Task-Agnostic Federated Continual Learning via Replay-Free Gradient Projection

Seohyeon Cha, Huancheng Chen, Haris Vikalo · 2025

Read Task-Agnostic Federated Continual Learning via Replay-Free Gradient Projection by Seohyeon Cha, Huancheng Chen, Haris Vikalo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-21606.txt.

Introduction

Clients in federated learning meet tasks in sequence and must not forget old ones. Seohyeon Cha and 2 co-authors propose a replay free continual method in a 2025 paper. Past approaches suffer catastrophic forgetting or store replay data that can violate privacy. Task identities are often assumed known at inference, which real deployments cannot promise. Their framework predicts task identity as part of the model.

Each client extracts low rank core bases from intermediate activations with randomized singular value decomposition. Those bases capture dominant feature directions for the current task. The server aggregates bases into global task subspaces shared across clients, without data sharing. Gradient projection then protects earlier subspaces during new training. The method is task agnostic and replay free by design.

Catalog record

CREATORSeohyeon Cha, Huancheng Chen, Haris Vikalo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-21606

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Task-Agnostic Federated Continual Learning via Replay-Free Gradient Projection Seohyeon Cha, Huancheng Chen, Haris Vikalo Abstract Federated continual learning (FCL) enables distributed client devices to learn from streaming data across diverse and evolving tasks. A major challenge to continual learning, catastrophic forgetting, is exacerbated in decentralized settings by the data heterogeneity, constrained communication and privacy concerns. We propose Fed erated gradient Pro jection-based Continual Learning with T ask I dentity P rediction ( FedProTIP ), a novel FCL framework that mitigates forgetting by projecting client updates onto the orthogonal complement of the subspace spanned by previously learned representations of the global model. This projection reduces interference with earlier tasks and preserves performance across the task sequence. To further address the challenge of task-agnostic inference, we incorporate a lightweight mechanism that leverages core bases from prior tasks to predict task identity and dynamically adjust the global model’s outputs. Extensive experiments across standard FCL benchmarks demonstrate that FedProTIP significantly outperforms state-of-the-art methods in average accuracy, particularly in settings where task identities are a priori unknown. Our code is available here . 1 Introduction Federated learning (FL) ( McMahan et al. 2017 ) , where client devices collaboratively train a global model without sharing private data, has emerged as a compelling alternative to centralized learning. Most FL systems assume static local datasets and a single inference task per client. In practice, however, devices (e.g., phones, smart glasses) often collect data for multiple evolving tasks and must fine-tune the model over time. Limited storage further forces clients to discard old data, creating a continual learning (CL) scenario where models must adapt to new tasks without having access to prior ones. This setting exacerbates catastrophic forgetting ( McCloskey & Cohen 1989 ) , i.e., deterioration of the model’s performance on previously learned tasks. In federated systems that operate under continual learning, this problem is further intensified by the data heterogeneity across client devices. Many studies have explored adapting conventional continual learning schemes to federated settings, typically falling into three categories: (1) replay-based methods ( Dong et al. 2022 ; Liu et al. 2023 ; Dai et al. 2023 ; Li et al. 2024c ; Li et al. 2024a ) ; (2) generation-based methods ( Qi et al. 2023 ; Zhang et al. 2023 ; Tran et al. 2024 ; Liang et al. 2024 ; Yu et al. 2024 ) ; and (3) regularization-based methods ( Yoon et al. 2021 ; Ma et al. 2022 ; Li et al. 2024b ; Lee et al. 2024 ) . Each faces challenges in FL: replay methods store old examples, risking privacy or exceeding storage limits; generation methods require server-side generative models, slowing aggregation; and regularization methods often impose significant local compute overhead. Recently, gradient projection methods such as GPM ( Saha et al. 2021 ) have proven effective in centralized continual learning by projecting new task gradients onto subspaces orthogonal to those of previously learned tasks. However, GPM assumes centralized access to activation statistics, which renders it impractical in federated settings. While FOT ( Bakman et al. 2024 ) adapts GPM to FL by collecting high-dimensional embeddings from clients, this approach incurs significant communication overhead and raises potential privacy concerns. In this work, we propose Fed erated gradient Proj ection-based continual learning with T ask I dentity P rediction ( FedProTIP ), a novel federated continual learning (FCL) framework that combines subspace-based gradient projection with inference-time task prediction to address both forgetting and task ambiguity. FedProTIP mitigates catastrophic forgetting by projecting local gradients onto the subspace orthogonal to that spanned by previously learned features; this reduces interference between representations across tasks. Specifically, each client collects layer-wise activations at the end of local training on its current task and performs randomized singular value decomposition (SVD) on the collected activations to extract the core bases of the task’s feature subspace. These local core bases are sent to the server, which constructs a projection matrix and broadcasts it back to the clients. The clients then perform projected gradient descent to fine-tune their local models – a strategy that preserves earlier features by ensuring updates are orthogonal to prior task subspaces. Beyond gradient projection, FedProTIP introduces a novel task identity prediction mechanism that exploits the extracted gradient subspaces to estimate task relevance during inference. By leveraging these subspaces to infer the most likely task identity of each test input, FedProTIP dynamically adjusts the global model’s outputs, yielding significant performance improvements in the challenging task-agnostic federated continual learning setting. Extensive experimental results demonstrate that FedProTIP outperforms existing FCL approaches across a range of benchmarking datasets. The main contributions of this paper can be summarized as follows: • We introduce FedProTIP , a novel federated continual learning framework that mitigates catastrophic forgetting through subspace-based gradient projection. Unlike prior approaches, FedProTIP performs local gradient projection and communicates only compact core subspace bases to the server, preserving data privacy and achieving efficiency with minimal computational and memory overhead. • We develop a novel task identity prediction method that leverages gradient subspace alignment to infer task-ID at inference and dynamically route inputs to the appropriate output heads. This removes the unrealistic assumption of known task identities and delivers strong gains in task-agnostic federated continual learning, without relying on replay buffers, generative models, or auxiliary prediction modules. • We conduct extensive experiments on multiple continual image classification benchmarks, showing that FedProTIP consistently outperforms state-of-the-art FCL methods in both accuracy and forgetting, with accuracy improvements ranging from at least 4.3% up to 47%. 2 Related Work 2.1 Federated Continual Learning Federated continual learning (FCL) tackles the challenge of continuously learning from decentralized data while preserving performance across sequential tasks. An early FCL approach, FedWeIT ( Yoon et al. 2021 ) , decomposes model parameters into task-generic and task-specific components, focusing on a task-incremental setting where the task ID is known during inference. CFeD ( Ma et al. 2022 ) relies on knowledge distillation using a surrogate dataset shared between the server and clients. GLFC ( Dong et al. 2022 ; Dong et al. 2023 ) addresses catastrophic forgetting by combining class-aware gradient compensation with class-semantic relation distillation, but relies on storing examples from previous tasks. Subsequent works ( Liu et al. 2023 ; Dai et al. 2023 ; Li et al. 2024c ; Li et al. 2024a ) reduce the size of the replay cache, yet remain reliant on stored samples. Recently, several FCL methods have leveraged generative models to replace real examples in memory with synthetic data. FedCIL ( Qi et al. 2023 ) employs a GAN with an auxiliary classifier to enable generative replay, thereby mitigating forgetting while aggregating global knowledge across clients. TARGET ( Zhang et al. 2023 ) and MFCL ( Babakniya et al. 2024 ) introduce data-free knowledge distillation that uses synthetic examples to transfer knowledge from a previously trained global model to client models. LANDER ( Tran et al. 2024 ) builds on this idea by incorporating label text embeddings from pretrained language models as anchors, which enables the generation of more meaningful samples and enhances resistance to forgetting. While effective in mitigating forgetting, these approaches inherit significant drawbacks: training generative models is computationally expensive as image resolution increases and introduces new privacy risks

Read the complete text