FedRef: Communication-Efficient Bayesian Fine Tuning with Reference Model
1 st PhD. Taehwan Yoon, 1 st prof. Bongjun Choi · 2025
Read FedRef: Communication-Efficient Bayesian Fine Tuning with Reference Model by 1 st PhD. Taehwan Yoon, 1 st prof. Bongjun Choi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-23210.txt.
Introduction
Taehwan Yoon, Bongjun Choi, and Wesley De Neve present FedRef in 2025, a fine-tuning method for federated learning. Federated learning trains one model across many sites without moving private data. When sites differ in data and hardware, training can forget earlier learning and drift without bound, hurting accuracy and raising local computing cost.
FedRef takes a Bayesian approach anchored to a reference model built from past global states. The anchor reins in drift and guards memory of earlier tasks. It also trims the chatter between sites, saving bandwidth. Hospitals or phone fleets that learn together without sharing data get a steadier method that respects both privacy and limited hardware.
Catalog record
| CREATOR | 1 st PhD. Taehwan Yoon, 1 st prof. Bongjun Choi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-23210
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FedRef: Communication-Efficient Bayesian Fine Tuning with Reference Model Thanks: Identify applicable funding agency here. If none, delete this. 1 st PhD. Taehwan Yoon, 1 st prof. Bongjun Choi Abstract Federated learning(FL) is used for distributed scenarios to train artificial intelligence(AI) models while ensuring users’ privacy. In federated learning scenario, the server generally never knows about users’ data. This type of concept makes the AI training process efficient in terms of data privacy. However, regarding model performance, federated AI models may not sufficiently satisfy AI users’ expectations. Furthermore, AI users have a wide range of different needs. It is not easy to satisfy the whole users needs. These types of issues can be addressed through AI model optimization, fine-tuning, or personalization to achieve optimal model performance. To address model optimization challenges, we propose reference model-based federated learning for optimal fine-tuning, which overcomes catastrophic forgetting in each round. This method is derived from Bayesian parameter-efficient transfer learning, which includes an optimal proximal term and enables overcoming the catastrophic forgetting issue in each round by utilizing a reference model that incorporates previous model parameters. As a result, this method achieves both high model performance and low computing cost. I Introduction Recently, in the AI industry, federated learning (FL) has been proposed as a prominent solution to protect users’ data privacy while allowing collaborative model training between independent affiliations. Users’ data are fundamentally protected because clients share only updated local model parameters (resulting from local training using their local data) and other non-private values with the server or other clients. The server then computes the global model by aggregating the local models received by the clients. However, as highlighted in [ 1 ] , FL solutions face numerous challenges. Our focus is on optimizing model performance and decreasing computing costs on client devices. 1. Model performance optimization in FL scenarios. 2. Decreasing computing cost and energy consumption. 3. How to protect the model from malicious users. In the related work section, we introduce existing approaches (FedAvg, FedProx, FedOpt, Bayesian Transfer Learning) for model optimization in FL scenarios, along with their limitations regarding client computing cost and catastrophic forgetting [ 2 ] [ 3 ] [ 4 ] in each round. We then introduce our FedRef: a communication-efficient Bayesian fine-tuning approach with a reference model. This concept overcomes catastrophic forgetting in each round by integrating previous model features into the maximum a posteriori (MAP) problem. In existing work, the MAP problem was applied as an objective function for optimizing model transfer learning between a target model with pre-trained parameters and a source model. On the other hand, traditional model optimization in FL scenarios used a proximal term to minimize deviation from the global model. However, the proximal term can be denoted as a MAP problem. In this paper, we define the MAP problem as an objective function that is updated with aggregated models from previous rounds only on the server-side, thereby minimizing clients’ computing cost. In our experiments, we applied FedRef on MNIST, CIFAR10, FeTs2022 data partitioning from distributed condition for non-IID(Independent and Identically Distributed) setting. We defined each baseline and then analyzed model performances, as baseline models differ for each dataset. Especially, on the FeTs2022, the data is derived in medical imaging area for brain tumor segmentation. In this case, the client-side can be a hospital, as shown in Fig. 1 . Fig. 1: Basic federated learning system. As a result, our FedRef achieves high model performance, despite minimizing clients’ computing cost. II Related Work II- 1 FedAvg Communication-efficient learning of deep networks from decentralized data [ 1 ] , they proposed typical system of federated learning concept. The paper, which introduced FedAvg, demonstrated higher model performance than FedSGD on the MNIST classification task under both IID and non-IID conditions using the Federated Averaging method. Federated Averaging is based on the stochastic gradient descent (SGD) concept [ 5 ] , which aggregates client models weighted by the number of samples from each client, as shown in equation ( 1 ). \theta_{r+1}=\sum_{i=1}^{K}\frac{n_{i}}{n}\theta_{i,r} (1) r : round of repeating server routine, \theta_{i} : i index client’s model parameter, n_{i} : i index client’s number of samples, n : total number of clients’ samples. We also selected this type of aggregation, but it is easy to apply other weighted aggregation concepts to our FedRef solution. On the client side, local training is represented by equation ( 2 ). \theta_{i}^{(s+1)}=\theta_{i}^{(s)}-\eta\nabla F_{i}(\theta_{i}^{(s)};\mathcal{B}_{i}^{(s)}) (2) s : number of local steps for local training, \eta : learning rate, \mathcal{B}_{i}^{(s)} : mini-batch sampled from i index client local dataset on step s , F_{i}(\theta_{i}^{(s)};\mathcal{B}_{i}^{(s)}) : local loss function evaluated on a mini-batch. The local training in our FedRef client update is based on the SGD solution. In algorithm 1 , it show whole FedAvg process flow. Algorithm 1 FedAvg: Communication-efficient learning of deep networks from decentralized data 1: Initialize global model weights \theta_{0} 2: for each round r=1,2,\dots,R do 3: Server selects of clients \mathcal{S}_{r}\subseteq\{1,\dots,K\} 4: for all client k\in\mathcal{S}_{r} in parallel do 5: Client k receives \theta_{r} from the server 6: Client k performs local training: 7: \theta_{r+1}^{k}\leftarrow\text{ClientUpdate}(k,\theta_{r}) 8: end for 9: Server aggregates the client updates: 10: \theta_{r+1}\leftarrow\sum_{k\in\mathcal{S}_{r}}\frac{n_{k}}{n_{\mathcal{S}_{r}}}\theta_{r+1}^{k} 11: n_{\mathcal{S}_{r}}=\sum_{k\in\mathcal{S}_{r}}n_{k} 12: end for II- 2 FedProx Federated Optimization in Heterogeneous Networks [ 6 ] , they proposed equation ( 3 ) named ”Proximal Term” to objective function for ensuring that local models do not deviate significantly from the global model. This concept enables optimizing the model to account for data skew and heterogeneity. However, it does not consider clients’ computing costs, as clients must compute the proximal term and send it to the server. \min_{\theta_{k}}\left(\mathbf{E}_{\mathcal{D}_{k}}\left[\mathcal{L}(\theta_{k},\mathcal{D}_{k})\right]+\frac{\mu}{2}\|\theta_{k}-\theta_{\text{global}}\|^{2}\right) (3) k : a client index, \theta_{k} : a client k local model parameter, \mathcal{L}(\theta_{k},\mathcal{D}_{k}) : client k local data \mathcal{D}_{k} cost function, \theta_{\text{global}} : global model parameter, \mu : hyperparameter for proximal term strength, \|\theta_{k}-\theta_{\text{global}}\|^{2} : L2(Euclidean) distance between local model parameter and global model parameter. The complete FedProx Algorithm 2 is shown below. Algorithm 2 FedProx: Federated Optimization in Heterogeneous Networks 1: Initialize global model weights \theta_{0} 2: for each round r=1,2,\dots,R do 3: Server selects clients \mathcal{S}_{r}\subseteq\{1,\dots,K\} 4: for all client k\in\mathcal{S}_{r} in parallel do 5: Client k receives \theta_{r} from the server 6: Client k performs local training: 7: \theta_{r+1}^{k}\leftarrow\text{ClientUpdate\_Prox}(k,\theta_{r},\mu) 8: end for 9: Server aggregates the client updates: 10: \theta_{r+1}\leftarrow\sum_{k\in\mathcal{S}_{r}}\frac{n_{k}}{n_{\mathcal{S}_{r}}}\theta_{r+1}^{k} 11: where n_{k} is the number of samples at client k , and n_{\mathcal{S}_{r}}=\sum_{k\in\mathcal{S}_{r}}n_{k} 12: end for In the server side, they just aggregate and return model parameter to clients. This led to the issue of concentrated computing costs on the client. Therefore, on the client side, Algorithm 3 introduces local training with a proximal term, which increases the client computing cost. Algorithm 3 ClientUpdate_Prox( k , \theta_{r} , \mu ) 1: Initialize local model \theta\leftarrow\theta_{r} 2: for each local epoch e=1,2,\dots,E do 3: for each minibatch b in local data \mathcal{D}_{k} do 4: Compute gradient: 5: g\leftarrow\nabla f_{k}(\theta;b)+\mu(\theta-\theta_{r}) 6: Update local model: 7: \theta\leftarrow\theta-\eta g 8: end for 9: end for 10: return \theta II- 3 FedOpt Adaptive Federated Optimization [ 7 ] , they introduced and included optimization concept merged with (FedADAGRAD, FedADAM, FedYOGI). They included each different specific proximal terms. Following FedADAGRAD equation ( 4 ): \displaystyle