MetaKE: Meta-learning Aligned Knowledge Editing via Bi-level Optimization
Shuxin Liu, Ou Wu, Hangzhou Institute for Advanced Study · 2026
Read MetaKE: Meta-learning Aligned Knowledge Editing via Bi-level Optimization by Shuxin Liu, Ou Wu, Hangzhou Institute for Advanced Study (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-12677.txt.
Introduction
Shuxin Liu and co-authors improve knowledge editing in language models by joining its two stages. Locate-then-edit methods first plan a target representation, then fit parameters under constraints. Uniform regularization in the first stage can shrink strong requests too much and weak ones too little. Their MetaKE casts both stages as one bi-level problem. A structural gradient proxy passes downstream feedback upstream without costly backpropagation. Experiments showed a better trade-off between accuracy and editability than strong baselines.
Catalog record
| CREATOR | Shuxin Liu, Ou Wu, Hangzhou Institute for Advanced Study |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63237 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.12677
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MetaKE: Meta-learning Aligned Knowledge Editing via Bi-level Optimization Shuxin Liu, Ou Wu, Hangzhou Institute for Advanced Study Abstract Knowledge editing (KE) aims to precisely rectify specific knowledge in Large Language Models (LLMs) without disrupting general capabilities. State-of-the-art methods suffer from an open-loop control mismatch. We identify a critical “Semantic-Execution Disconnect” : the semantic target is derived independently without feedback from the downstream’s feasible region. This misalignment often causes valid semantic targets to fall within the prohibited space, resulting in gradient truncation and editing failure. To bridge this gap, we propose MetaKE ( Meta -learning Aligned K nowledge E diting), a new framework that reframes KE as a bi-level optimization problem. Departing from static calculation, MetaKE treats the edit target as a learnable meta-parameter: the upper-level optimizer seeks a feasible target to maximize post-edit performance, while the lower-level solver executes the editing. To address the challenge of differentiating through complex solvers, we derive a Structural Gradient Proxy , which explicitly backpropagates editability constraints to the target learning phase. Theoretical analysis demonstrates that MetaKE automatically aligns the edit direction with the model’s feasible manifold. Extensive experiments confirm that MetaKE significantly outperforms strong baselines, offering a new perspective on knowledge editing. † † footnotetext: Work in progress. 1 Introduction Large language models (LLMs) have become a core substrate for modern NLP systems [ 34 , 2 , 27 ] , yet their parametric memory inevitably contains factual errors and outdated knowledge [ 35 , 14 , 7 ] . Knowledge editing (KE) aims to rectify a set of targeted behaviors while preserving the model’s general capabilities [ 5 , 13 ] . Despite substantial progress, reliable editing under strong constraints remains elusive: edits that succeed semantically may still fail physically, and improvements in edit success often come at the expense of locality or stability [ 3 , 32 ] . Dominant KE methods such as ROME [ 22 ] , MEMIT [ 23 ] , and AlphaEdit [ 6 ] follow a decoupled Compute-then-Solve routine: a Semantic Planning stage first produces a semantic target \boldsymbol{v}^{*} , and a Editing Execution stage then solves a constrained least-squares update to realize this target in weights. We identify a fundamental limitation of this open-loop design, termed the Semantic-Execution Disconnect : \boldsymbol{v}^{*} is optimized without awareness of the preservation constraints enforced by the downstream [ 28 ] . Modern solvers preserve memories by suppressing sensitive update directions, e.g., via inverse-covariance regularization (MEMIT) or orthogonal projections (AlphaEdit). When the semantically ideal \boldsymbol{v}^{*} demands movement along these protected directions, the solver must dampen or truncate the effective update, causing the executed edit to deviate from \boldsymbol{v}^{*} and potentially fail. This reveals an implicit and often violated assumption: the semantically optimal direction lies within the solver’s feasible update set under preservation constraints, which can break down in dense, deep representations. While meta-editors (e.g., MEND [ 25 ] , ENN [ 29 ] ) and adaptive gradient guidance methods (e.g., AGRADE [ 11 ] ) alleviate parts of this tension, reliably achieving strong edits under preservation constraints without sacrificing locality and stability remains challenging. To bridge this gap, we propose MetaKE ( Meta -learning Aligned K nowledge E diting), which recasts knowledge editing as a bi-level optimization problem. MetaKE treats the edit target \boldsymbol{v}^{*} as a learnable meta-parameter: the upper level optimizes \boldsymbol{v}^{*} for edit success, while the lower level enforces the solver’s preservation constraints, providing gradient feedback that aligns \boldsymbol{v}^{*} with the feasible update manifold. To avoid expensive multi-layer unrolling, we introduce a closed-form Structural Gradient Proxy based on the Structural Consistency Hypothesis , which retains key constraint operators and efficiently exposes the feasibility boundary to the meta-optimizer. Our contributions are summarized as follows: • We propose a Bi-Level optimization framework MetaKE, identifying the “Semantic-Execution Disconnect” in existing editing paradigms. MetaKE treats the semantic target as a learnable meta-parameter , which enables the optimization process to proactively sense downstream physical constraints, resolving edit failures caused by conflict-induced signal attenuation. • We introduce the Structural Gradient Proxy. By distilling the closed-form solution of the constraints into a differentiable module, we convert physical barriers into a “Geometric Gating Gradient”. This mechanism efficiently filters out gradient components pointing towards the constraint space, automatically rectifying the optimization direction into the parameter’s feasible Range Space without the need for expensive full-solver unrolling. • We provide theoretical analysis demonstrating that the gradient flow guided by our structural proxy achieves asymptotic alignment with the Feasible Manifold of the parameter space, effectively mitigating the Information Truncation phenomenon observed in strong-constraint settings. Empirically, MetaKE significantly boosts editing success rates and generalization while maintaining preservation of unrelated knowledge. 2 Related Work Locate-then-Edit and Mass-Editing Constraints The “Locate-then-Edit” paradigm remains the standard for KE [ 22 , 4 ] . ROME localizes factual recall to rank-one updates [ 22 ] , while MEMIT scales least-squares editing across layers with inverse-covariance regularization to preserve general knowledge [ 23 ] . Beyond soft regularization, recent work increasingly imposes explicit geometric constraints: PMET and EMMET formulate equality-constrained solvers to reduce collateral damage and balance stability–plasticity [ 19 , 12 ] , and AlphaEdit enforces orthogonality via null-space projection [ 6 ] . Despite stronger constraints in Physical Execution , these methods remain open-loop: they accept an upstream semantic target without accounting for how constraints truncate semantically ideal updates, yielding Spectral Suppression . Meta-Learning and Objective-Driven Optimization Another line learns update mappings or improves objectives. Hypernetwork approaches (e.g., MEND; KE) predict weight updates from gradients [ 25 , 5 ] , and MALMEN approximates least-squares solutions under varying batch sizes [ 30 ] . More recently, target-centric methods optimize what to write: AdaEdit adds future sequence probability constraints [ 18 ] , AnyEdit extends this to long-form autoregressive editing via iterative key-token updates [ 15 ] , and REP dynamically optimizes robust editing keys to decouple edits from native representations [ 33 ] . In contrast, MetaKE is a meta-optimizer that closes the loop with the analytical structure of constraint-based solvers. While AdaEdit/AnyEdit mainly optimize targets for linguistic coherence (Semantic Disconnect), MetaKE optimizes targets for physical realizability under hard constraints (Physical Disconnect), aligning planned targets with the feasible geometry via gradient feedback through the solver. 3 Preliminaries 3.1 Knowledge Editing as Linear Associative Memory We denote an LLM as f(\cdot):\mathcal{X}\to\mathcal{Y} that associates an input x with its corresponding prediction y . KE typically treats Transformer FFNs as linear associative memories [ 8 , 16 , 1 ] . For a target layer l , the output mapping \boldsymbol{W}^{l}_{\text{out}}\in\mathbb{R}^{d_{1}\times d_{0}} of FFNs retrieves information \boldsymbol{m}_{l}\in\mathbb{R}^{d_{1}} via: \boldsymbol{m}_{l}\approx\boldsymbol{W}^{l}_{\text{out}}\boldsymbol{k}_{l},\quad\text{where}\quad\boldsymbol{k}_{l}=\sigma\!\left(\boldsymbol{W}^{l}_{\text{in}}\,\gamma(\cdot)\right), (1) where \gamma denotes the layer normalization, \boldsymbol{k}_{l}\in\mathbb{R}^{d_{0}} (key) represents the subject-relation (s,r) and \boldsymbol{m}_{l}\in\mathbb{R}^{d_{1}} (value) is the retrieved representation. Editing seeks a weight update \boldsymbol{\Delta} such that (\boldsymbol{W}^{l}_{\text{out}}+\boldsymbol{\Delta})\boldsymbol{k}_{l} aligns with a new desired object o^{*} . 3.2 Locate-then-Edit as Compute-then-Solve Before delving into the technical details, we establish a unified terminology. In this paper, we refer to the limitations imposed by the solver (e.g., preservation of pre-trained knowledge via covariance matrices) collectively as structural constraints . The ability of a semantic target to survive these constraints and manifest in the weight space is defined as its physical realizability . Most “Locate-then-Edit” methods [ 22 , 23 ] decouple