Optimal Task Order for Continual Learning of Multiple Tasks

Ziyan Li, Naoki Hiratani · 2025

Read Optimal Task Order for Continual Learning of Multiple Tasks by Ziyan Li, Naoki Hiratani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-03350.txt.

Description

Ziyan Li and Naoki Hiratani ask in what order a neural network should learn tasks in a 2025 paper. Networks trained task after task tend to forget earlier skills. The sequence itself, rarely studied, may ease or worsen that forgetting.

Working with a simplified teacher-student model, they derived a formula linking task similarity and order to final performance. Two rules emerged. Start with the least typical task and end with the most representative one, and make neighboring tasks dissimilar rather than alike. Tests on synthetic data and standard image sets, from fashion items to photos, backed both rules across two network types.

Catalog record

CREATORZiyan Li, Naoki Hiratani
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-03350

Browse the full library · About the Tower of Babel