Putting a Face to Forgetting: Continual Learning meets Mechanistic Interpretability

Sergi Masip, Gido M. van de Ven, Javier Ferrando, Tinne Tuytelaars · 2026

Read Putting a Face to Forgetting: Continual Learning meets Mechanistic Interpretability by Sergi Masip, Gido M. van de Ven, Javier Ferrando, Tinne Tuytelaars (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22012.txt.

Description

Sergi Masip and three co-authors give forgetting a face. A neural net that learns task after task tends to lose the first tasks. This flaw is called catastrophic forgetting. Most tests score it by lost marks on old tests. That hides what breaks inside the net.

The team looks at the inner parts of the net as it learns. They show that forgetting is a change in how the net codes each trait it has learned. When new tasks twist that code, the old traits can no longer be read. Their work lets us watch traits live or die, one by one. That view can guide guards that shield the traits old tasks need most.

Catalog record

CREATORSergi Masip, Gido M. van de Ven, Javier Ferrando, Tinne Tuytelaars
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22012

Browse the full library · About the Tower of Babel