Reversible Lifelong Model Editing via Semantic Routing-Based LoRA

Haihua Luo, Xuming Ran, Tommi Kärkkäinen, Zhonghua Chen, Jiangrong Shen, Qi Xu, Fengyu Cong · 2026

Read Reversible Lifelong Model Editing via Semantic Routing-Based LoRA by Haihua Luo, Xuming Ran, Tommi Kärkkäinen, Zhonghua Chen, Jiangrong Shen, Qi Xu, Fengyu Cong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11239.txt.

Description

Haihua Luo and coauthors make lifelong editing of large language models reversible, packaging each edit as its own frozen low-rank adapter that semantic routing switches on only for matching inputs. Existing editing schemes drift semantically or forget as updates accumulate, because edits share parameters or clusters keep moving. Freezing each adapter and routing by meaning avoids both failure modes. Removing an edit's routing key revokes it and restores the model's original behavior, a rollback the authors call a first.

Catalog record

CREATORHaihua Luo, Xuming Ran, Tommi Kärkkäinen, Zhonghua Chen, Jiangrong Shen, Qi Xu, Fengyu Cong
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40495
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.11239

Browse the full library · About the Tower of Babel