Trust Region Continual Learning as an Implicit Meta-Learner

Zekun Wang, Anant Gupta, Christopher J. MacLellan · 2026

Read Trust Region Continual Learning as an Implicit Meta-Learner by Zekun Wang, Anant Gupta, Christopher J. MacLellan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02417.txt.

Description

Zekun Wang and 2 co-authors reinterpret a continual learning method as a hidden meta-learner, in a 2026 arXiv paper. Continual learning teaches a model tasks one after another without catastrophic forgetting of earlier tasks. Regularization methods can overconstrain learning, while replay methods can drift because replayed data is imperfect.

Their approach combines generative replay with a trust region, a limit on how far each update may move, weighted by Fisher information, a measure of which parameters matter. The authors show the update behaves like one inner step of meta-learning, the training style that prepares a model to adapt quickly. Replay supplies an old-task signal while the penalty shapes curvature efficiently. On image generation and robot control benchmarks, the method retained old skills best and relearned early tasks fastest after each switch.

Catalog record

CREATORZekun Wang, Anant Gupta, Christopher J. MacLellan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02417

Browse the full library · About the Tower of Babel