Towards Performance-Enhanced Model-Contrastive Federated Learning using Historical Information in Heterogeneous Scenarios

Hongliang Zhang, Jiguo Yu, Guijuan Wang, Wenshuo Ma, Tianqing He, Baobao Chai, Chunqiang Hu · 2026

Read Towards Performance-Enhanced Model-Contrastive Federated Learning using Historical Information in Heterogeneous Scenarios by Hongliang Zhang, Jiguo Yu, Guijuan Wang, Wenshuo Ma, Tianqing He, Baobao Chai, Chunqiang Hu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11945.txt.

Description

Federated learning lets many nodes train one model without sharing raw data, but real deployments are heterogeneous: nodes differ in data and in how often they join. Hongliang Zhang and six co-authors propose PMFL, a model-contrastive federated learning framework that uses historical training information to steady the process. On the node side, a contrastive term built from past local models keeps updates consistent across differing data.

On the server side, each node's cumulative participation count adjusts its aggregation weight, correcting bias from uneven participation. The updated global model also folds in past global models, damping swings in performance between rounds. Across experiments in heterogeneous settings, PMFL beats existing federated methods, suggesting that memory of past models, on both sides of the exchange, is a cheap route to stronger federated learning.

Catalog record

CREATORHongliang Zhang, Jiguo Yu, Guijuan Wang, Wenshuo Ma, Tianqing He, Baobao Chai, Chunqiang Hu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-11945

Browse the full library · About the Tower of Babel