Knowledge Swapping via Learning and Unlearning
Mingyu Xing, Lechao Cheng ✉, Shengeng Tang, Yaxiong Wang, Zhun Zhong ✉, Meng Wang · 2025
Read Knowledge Swapping via Learning and Unlearning by Mingyu Xing, Lechao Cheng ✉, Shengeng Tang, Yaxiong Wang, Zhun Zhong ✉, Meng Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08075.txt.
Description
Mingyu Xing and co-authors introduce, in a 2025 paper, a new task for trained AI models: swapping knowledge in and out in one process. A user may want a model to forget specified facts, keep the essential ones, and learn new ones at the same time. Doing all three together is harder than doing any one alone.
The authors study how learning and forgetting move through a model's feature layers. New learning tends to build from low level features up to high level meaning. Forgetting runs the other way, starting at the top. From that pattern, they propose a strategy called learning before forgetting, and make it the benchmark approach for the task. Tests on image sorting, object detection, and scene labeling support the strategy. Code is released for others to use.
Catalog record
| CREATOR | Mingyu Xing, Lechao Cheng ✉, Shengeng Tang, Yaxiong Wang, Zhun Zhong ✉, Meng Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-08075