The Impact of Cut Layer Selection in Split Federated Learning
Justin Dachille, Chao Huang, Xin Liu · 2024
Read The Impact of Cut Layer Selection in Split Federated Learning by Justin Dachille, Chao Huang, Xin Liu (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-15536.txt.
Description
Justin Dachille, Chao Huang, and Xin Liu ask where to split a neural network between phones and server in split federated learning. Their paper appeared in 2024. In this training style, each client runs the first layers and the server the rest, so raw data stays local. Two variants exist: separate server models per client, or one shared server model. The team analyzed both on paper and tested them on four data sets with two networks.
The per-client variant barely cared where the cut sat, matching the theory. The shared variant swung widely with cut choice. With a well-chosen cut, the shared variant even beat the classic federated averaging method on uneven data. The authors say cut selection deserves the same care as other design choices in split learning.
Catalog record
| CREATOR | Justin Dachille, Chao Huang, Xin Liu |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-15536