HiEdit: Lifelong Model Editing with Hierarchical Reinforcement Learning

Yangfan Wang, Tianyang Sun, Chen Tang, Jie Liu, Wei Cai, Jingchi Jiang · 2026

Read HiEdit: Lifelong Model Editing with Hierarchical Reinforcement Learning by Yangfan Wang, Tianyang Sun, Chen Tang, Jie Liu, Wei Cai, Jingchi Jiang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11214.txt.

Description

Wang and five colleagues edit language models over a lifetime of corrections with HiEdit, which picks the most relevant layers for each new fact instead of perturbing a fixed dense set. A hierarchical reinforcement learning controller chooses layers dynamically and rewards sparsity, giving precise local updates. Tests show it beats the strong RLEdit baseline by an average of 8.48 percent while touching only half the layers per edit.

Catalog record

CREATORYangfan Wang, Tianyang Sun, Chen Tang, Jie Liu, Wei Cai, Jingchi Jiang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64539
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.11214

Browse the full library · About the Tower of Babel