Fora : From Weight-Space to Function-Space Protection in Capability-Preserving Fine-Tuning

Rui Zhou, Tianci Xie · 2026

Read Fora : From Weight-Space to Function-Space Protection in Capability-Preserving Fine-Tuning by Rui Zhou, Tianci Xie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-31092.txt.

Introduction

Zhou and Xie tackle catastrophic forgetting in fine-tuned language models. Full fine-tuning teaches a model a new task, but it can erode skills the model already had. Older remedies guard the weights themselves, through distance penalties or output matching. The authors argue that a skill lives in activation patterns, not in weight geometry. What should be protected is the set of activation directions a skill actually uses.

Their method, Fora, works in function space. From label-free calibration inputs, it finds the main activation directions of the skill to preserve. Updates are then projected so they cannot read those directions, with a narrow spectral channel left open for controlled change. Tests on the Qwen3-1.7B model covered three learning setups. Fora preserved old skills better than weight-space projection and standard regularization, with only a small cost to the new task.

Catalog record

CREATORRui Zhou, Tianci Xie
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.31092

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fora : From Weight-Space to Function-Space Protection in Capability-Preserving Fine-Tuning Rui Zhou, Tianci Xie Abstract Full fine-tuning adapts large language models to new tasks but can erode capabilities they already possess. Existing remedies protect through proxies —parameter distances, importance penalties, output matching, or the dominant singular directions of the weights—none of which answers the operative question: which activation directions does the preserved capability rely on? We argue a capability is characterized more faithfully by the activation subspace it induces than by the singular geometry of the weight matrix, and on this view develop function-space protection , instantiated as Fora ( Function-space Orthogonal Residual Adaptation ). From label-free calibration inputs we estimate, per layer, the principal directions 𝐐 \mathbf{Q} of the input-activation covariance and form a right projector P 𝐐 = 𝐈 − 𝐐𝐐 ⊤ P_{\!\mathbf{Q}}=\mathbf{I}-\mathbf{Q}\mathbf{Q}^{\top} ; paired with a left projector P 𝐔 P_{\!\mathbf{U}} from the weight’s SVD, the Fora update is Δ ​ 𝐖 = P 𝐔 ​ 𝐌 ​ P 𝐐 + 𝐔 2 ​ 𝐃 δ ​ 𝐕 2 ⊤ \Delta\!\mathbf{W}=P_{\!\mathbf{U}}\mathbf{M}P_{\!\mathbf{Q}}+\mathbf{U}_{2}\mathbf{D}_{\delta}\mathbf{V}_{2}^{\top} —a high-capacity branch structurally barred from reading the capability’s function directions, plus a narrow spectral channel for controlled plasticity. The construction extends to parameter-efficient adaptation via 𝐌 → α r ​ 𝐁 ​ 𝒜 \mathbf{M}\to\tfrac{\alpha}{r}\mathbf{B}\mathcal{A} . Across three settings on Qwen3-1.7B (COGS and GSM8K learned while preserving translation, translation learned while preserving math), it consistently outperforms weight-space projection and standard regularization on preservation, with only a small new-task trade-off in the math-preservation setting. A controlled ablation isolating the projection source shows the advantage comes not from projection itself, but from projecting onto capability-derived rather than weight-derived directions. Code is available at https://github.com/zrui239/FORA . 1 Introduction Full fine-tuning—updating all parameters of a pre-trained model ( 26 ) under unconstrained gradients—remains the most expressive way to adapt a large language model to a new task ( 7 ) . This expressiveness is also a liability: unconstrained gradients are free to overwrite the functional pathways of capabilities the model already possesses. A model expected to retain translation quality while learning to parse semantics, or to retain arithmetic ability while learning a new language pair, must avoid this drift, yet the standard fine-tuning objective does nothing to discourage it. A long line of work mitigates such forgetting ( 17 ; 6 ; 20 ; 24 ) . Regularization methods anchor the weights through importance-weighted ( 10 ) or plain \ell_{2} ( 11 ) penalties; distillation methods keep the output distribution close to the original model’s ( 12 ) ; gradient-projection methods steer updates away from stored task subspaces ( 23 ; 29 ) ; and weight-decomposition methods restrict adaptation to chosen singular components of the pre-trained weight ( 18 ; 13 ) . Each of these protects a capability through a proxy : parameter importance, output behavior, gradient history, or weight geometry. None of them directly encodes the set of activation directions that the capability uses during inference. Our claim. A preserved capability is better characterized by the activation subspace it induces in each layer than by the dominant singular directions of the weight matrix. The top right-singular vectors \mathbf{V}_{1} of a weight \mathbf{W}_{0} summarize where that weight is large —an aggregate over everything the model has ever learned. They need not align with where a specific capability is functionally active: translation may rely on activation patterns spread across many moderate singular components, or oriented diagonally with respect to the SVD basis. Protecting \mathbf{V}_{1} therefore constrains a subspace that is largely misaligned with the capability. Method. We address this by deriving the protected subspace from the capability itself. Forwarding label-free calibration inputs of the preserved capability, we collect per-layer input activations, take the top- k eigenvectors \mathbf{Q} of their covariance, and form a function-space right projector P_{\!\mathbf{Q}}=\mathbf{I}-\mathbf{Q}\mathbf{Q}^{\top} . The full-rank update is \Delta\!\mathbf{W}\;=\;\underbrace{P_{\!\mathbf{U}}\,\mathbf{M}\,P_{\!\mathbf{Q}}}_{\text{high-capacity, function-protected}}\;+\;\underbrace{\mathbf{U}_{2}\mathbf{D}_{\delta}\mathbf{V}_{2}^{\top}}_{\text{controlled spectral channel}}, where P_{\!\mathbf{U}}=\mathbf{I}-\mathbf{U}_{1}\mathbf{U}_{1}^{\top} prevents the high-capacity branch from writing the principal output directions of \mathbf{W}_{0} , and P_{\!\mathbf{Q}} prevents it from reading the capability’s function directions. The two channels play complementary roles: on inputs aligned with the protected capability the dense branch contributes nothing and the response is determined solely by the narrow spectral channel—a small, calibrated adjustment rather than an outright freeze—while on all other inputs the dense branch retains full capacity. The same parameterization extends to low-rank adaptation by replacing \mathbf{M} with \tfrac{\alpha}{r}\mathbf{B}\mathcal{A} . Findings. We instantiate the method on Qwen3-1.7B across three full-rank settings (Section 4 ). Learning COGS while preserving translation, we hold perplexity at 4.39—within 0.04 of the 4.35 baseline—at 98.6% COGS exact match, while weight-space projection degrades perplexity to 4.86 at the same accuracy and is no better than unprotected fine-tuning. Learning GSM8K while preserving translation, we match the baseline perplexity exactly (4.35). Reversing the roles—learning translation while preserving math—we retain GSM8K within 0.9 points of the original model where full fine-tuning loses 2.3, confirming \mathbf{Q} is not a translation-specific artifact. A controlled ablation swapping only P_{\!\mathbf{V}} for P_{\!\mathbf{Q}} shows the gain comes from what is protected, not from projecting at all. Figure 1 summarizes all three settings on the preservation–adaptation plane. Figure 1 : Preservation–adaptation trade-off across all three settings (visualizing Tables 2 , 3 , and 4 ). Each panel plots a new-task metric (horizontal) against the preserved-capability metric (vertical); the dashed line marks the preserved-capability target and the shaded band the favorable region. (a) Trans \to COGS and (b) Trans \to GSM8K plot new-task EM against translation PPL (lower better, axis inverted); (c) Math \to Trans plots translation PPL against retained GSM8K EM (higher better). In all three, FProj / Fora (large outlined markers) achieve the strongest preservation while remaining competitive on the new task, whereas the weight-space and regularization baselines sacrifice preservation. Contributions. (i) We reformulate capability preservation as function-space protection : the protected object is the activation subspace induced by the retained capability, rather than parameter distance or the singular geometry of \mathbf{W}_{0} . (ii) We propose Fora ( Function-space Orthogonal Residual Adaptation ), a structurally constrained full-rank update \Delta\!\mathbf{W}=P_{\!\mathbf{U}}\mathbf{M}P_{\!\mathbf{Q}}+\mathbf{U}_{2}\mathbf{D}_{\delta}\mathbf{V}_{2}^{\top}, where P_{\!\mathbf{Q}} blocks reads from capability-sensitive directions, P_{\!\mathbf{U}} blocks writes to dominant output directions, and the spectral channel provides bounded plasticity. (iii) We characterize this parameterization through three operator-level properties and validate the mechanism with controlled P_{\!\mathbf{V}} -versus- P_{\!\mathbf{Q}} ablations, showing that the key factor is the source of the protected subspace. Section 3 develops the method, Section 4 evaluates the full-rank setting, and later sections present ablations and the low-rank extension. 2 Related Work Regularization and distillation. Classical continual-learning methods bound how far parameters or outputs may move. Importance-based regularizers such as EWC ( 10 ) , SI ( 32 ) , and MAS ( 1 ) estimate which parameters should remain stable; L2-SP ( 11 ) penalizes the \ell_{2} distance to the pre-trained weights; LwF ( 12 ) distills the frozen model’s output distribution on new-task inputs. All three rely on indirect signals—parameter importance, parameter proximity, output consistency—and none constrains which input directions an update may act on, leaving the capability’s functional pathway exposed. Under full-rank fine-tuning they degrade translation almost as much as no protection at all (Section 4.2 ). Subspace and gradient projection. A second family constrains gradients. Gradient Projection Memory ( 23 ) projects new gradients onto the orthogonal

Read the complete text