FedProtoKD: Dual Knowledge Distillation with Adaptive Class-wise Prototype Margin for Heterogeneous Federated Learning

Md Anwar Hossen * , Fatema Siddika * , Wensheng Zhang, Anuj Sharma, Ali Jannesari · 2025

Read FedProtoKD: Dual Knowledge Distillation with Adaptive Class-wise Prototype Margin for Heterogeneous Federated Learning by Md Anwar Hossen * , Fatema Siddika * , Wensheng Zhang, Anuj Sharma, Ali Jannesari (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-19009.txt.

Description

Fatema Siddika and co-authors wrote a 2025 paper on federated learning when each participant runs a different model on different data. In federated learning, clients train locally and share summaries, not raw data. Prototype methods share a class-average feature vector per category. Averaging those prototypes shrinks their decision margins and hurts accuracy.

Their framework, FedProtoKD, fights the shrinkage with dual knowledge distillation, learning from both client predictions and prototype features. The server keeps trainable global prototypes with a class-wise adaptive margin, trained contrastively. Public samples are weighted by how representative they are. The design targets model and data heterogeneity at once, plus privacy. Tests address non-identical data splits across clients. The work refines a promising family of heterogeneous federated methods.

Catalog record

CREATORMd Anwar Hossen * , Fatema Siddika * , Wensheng Zhang, Anuj Sharma, Ali Jannesari
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-19009

Browse the full library · About the Tower of Babel