LDC-MTL: Balancing Multi-Task Learning through Scalable Loss Discrepancy Control
Peiyao Xiao, Chaosheng Dong, Shaofeng Zou, Kaiyi Ji · 2025
Read LDC-MTL: Balancing Multi-Task Learning through Scalable Loss Discrepancy Control by Peiyao Xiao, Chaosheng Dong, Shaofeng Zou, Kaiyi Ji (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08585.txt.
Description
Peiyao Xiao and co-authors balance multi-task learning by policing the gaps between task losses. Their 2025 paper notes that gradient surgery methods balance tasks at steep cost, scaling with task count in time and memory. Their method, LDC-MTL, frames loss gap control as a two-level problem. A lean first-order solver then runs it at flat cost, whatever the task count.
Proofs show the method lands at a balance point that is also near-Pareto for all tasks under mild terms. Tests across varied multi-task sets beat rivals on score and speed alike, the team reports.
Catalog record
| CREATOR | Peiyao Xiao, Chaosheng Dong, Shaofeng Zou, Kaiyi Ji |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-08585