Fine-tuning Multimodal Transformers on Edge: A Parallel Split Learning Approach
Timo Fudala, Vasileios Tsouvalas, Nirvana Meratnia · 2025
Read Fine-tuning Multimodal Transformers on Edge: A Parallel Split Learning Approach by Timo Fudala, Vasileios Tsouvalas, Nirvana Meratnia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-06355.txt.
Description
Timo Fudala, Vasileios Tsouvalas, and Nirvana Meratnia present a 2025 way to fine-tune multimodal models on edge devices. Such models fuse image, sound, and text, but their size bars them from small gear. Split learning cuts the model in two, with the heavy half on a server, yet it had barely been tried here.
Their design runs the split in parallel across clients, with slim token tools on each device and one shared encoder that takes any input type. No labels cross the wire, and no client waits on another. Across seven data sets it matched or beat a rival scheme while cutting device-side math hugely.
Catalog record
| CREATOR | Timo Fudala, Vasileios Tsouvalas, Nirvana Meratnia |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-06355