Knowledge Swapping via Learning and Unlearning

Mingyu Xing, Lechao Cheng ✉, Shengeng Tang, Yaxiong Wang, Zhun Zhong ✉, Meng Wang · 2025

Read Knowledge Swapping via Learning and Unlearning by Mingyu Xing, Lechao Cheng ✉, Shengeng Tang, Yaxiong Wang, Zhun Zhong ✉, Meng Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08075.txt.

Description

Mingyu Xing and co-authors introduce, in a 2025 paper, a new task for trained AI models: swapping knowledge in and out in one process. A user may want a model to forget specified facts, keep the essential ones, and learn new ones at the same time. Doing all three together is harder than doing any one alone.

The authors study how learning and forgetting move through a model's feature layers. New learning tends to build from low level features up to high level meaning. Forgetting runs the other way, starting at the top. From that pattern, they propose a strategy called learning before forgetting, and make it the benchmark approach for the task. Tests on image sorting, object detection, and scene labeling support the strategy. Code is released for others to use.

Catalog record

CREATORMingyu Xing, Lechao Cheng ✉, Shengeng Tang, Yaxiong Wang, Zhun Zhong ✉, Meng Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-08075

Browse the full library · About the Tower of Babel