OmniLearn : A Framework for Distributed Deep Learning over Heterogeneous Clusters
Sahil Tyagi, Prateek Sharma, Member, IEEE · 2025
Read OmniLearn : A Framework for Distributed Deep Learning over Heterogeneous Clusters by Sahil Tyagi, Prateek Sharma, Member, IEEE (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17469.txt.
Description
Sahil Tyagi and Prateek Sharma speed deep learning on mixed hardware clusters in a 2025 paper. Training kits are tuned for even machines, but real clusters mix old and new gear across edge, cloud, and super sites. Slow stragglers and stale updates then drag the whole run. Their frame, OmniLearn, sizes each worker's batch like a control loop to even the load.
Batch sizes flex live as gear frees or fills. Training time fell by fourteen to eighty five percent across their tests. A loose sync mode, where workers do not wait, gained up to near seven points of accuracy with their tricks in play. The authors pitch the frame for the messy clusters most labs truly run.
Catalog record
| CREATOR | Sahil Tyagi, Prateek Sharma, Member, IEEE |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-17469