Boosting Generalization Performance in Model-Heterogeneous Federated Learning Using Variational Transposed Convolution

Ziru Niu, Hai Dong, A. K. Qin · 2025

Read Boosting Generalization Performance in Model-Heterogeneous Federated Learning Using Variational Transposed Convolution by Ziru Niu, Hai Dong, A. K. Qin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01669.txt.

Description

Ziru Niu, Hai Dong, and A K Qin improve federated learning when each site runs a different model in a 2025 computing paper. Federated learning trains models across many sites without moving private data. Sites with unlike model shapes cannot simply average their weights. Uneven local data also makes each model weak on new cases.

Instead of weights, sites share summary statistics of their data features with the server. Each site then trains a generator that makes fake data matching the shared patterns. Fine-tuning on the fake data widens what local models can handle. Gains on unseen data were strong in their tests. The trick lets odd-shaped models still learn from each other.

Catalog record

CREATORZiru Niu, Hai Dong, A. K. Qin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-01669

Browse the full library · About the Tower of Babel