LDC-MTL: Balancing Multi-Task Learning through Scalable Loss Discrepancy Control

Peiyao Xiao, Chaosheng Dong, Shaofeng Zou, Kaiyi Ji · 2025

Read LDC-MTL: Balancing Multi-Task Learning through Scalable Loss Discrepancy Control by Peiyao Xiao, Chaosheng Dong, Shaofeng Zou, Kaiyi Ji (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08585.txt.

Description

Peiyao Xiao and co-authors balance multi-task learning by policing the gaps between task losses. Their 2025 paper notes that gradient surgery methods balance tasks at steep cost, scaling with task count in time and memory. Their method, LDC-MTL, frames loss gap control as a two-level problem. A lean first-order solver then runs it at flat cost, whatever the task count.

Proofs show the method lands at a balance point that is also near-Pareto for all tasks under mild terms. Tests across varied multi-task sets beat rivals on score and speed alike, the team reports.

Catalog record

CREATORPeiyao Xiao, Chaosheng Dong, Shaofeng Zou, Kaiyi Ji
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-08585

Browse the full library · About the Tower of Babel