One Mask to Rule Them All: On Hidden Facts after Editing and How to Find Them
Ali Holmov, Paul Youssef, Nandi Schoots, Christin Seifert · 2026
Read One Mask to Rule Them All: On Hidden Facts after Editing and How to Find Them by Ali Holmov, Paul Youssef, Nandi Schoots, Christin Seifert (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28839.txt.
Description
Ali Holmov and three colleagues ask whether edits share a common mechanism. Despite fact-specific changes, ROME and MEMIT target the same weights critical to maintaining edits. To isolate this subset they train a compact binary mask over edited weights. The mask reverses 80 percent of training-set edits and over 70 percent of test-set edits, confirming diverse edits share structure. Injecting the mask drops success from 98 percent to 38 percent, showing this mechanism is necessary for success. Edits suppress rather than overwrite knowledge, so related facts fail to update.
Catalog record
| CREATOR | Ali Holmov, Paul Youssef, Nandi Schoots, Christin Seifert |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51855 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.28839