Fixed-Interface State Transfer Reveals Reuse in Controlled Routing
Yanzhen Lu Shanghai Qizhi Institute [email protected] Zhicheng Qian Southeast University [email protected] · 2026
Read Fixed-Interface State Transfer Reveals Reuse in Controlled Routing by Yanzhen Lu Shanghai Qizhi Institute [email protected] Zhicheng Qian Southeast University [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18158.txt.
Introduction
Lu, Qian, Jiang, and Zhou ask where prompt-based control of a language model actually lives. They test whether a behavior learned in one routing task can transfer through a fixed interface to another. On small GPT-2 routing tasks, exact transfer through an early interface passes strict necessity and sufficiency checks. Retrained prompts can relearn the same behavior elsewhere only with extra examples, so fixed-interface transfer is stronger evidence of reuse than training success alone.
Catalog record
| CREATOR | Yanzhen Lu Shanghai Qizhi Institute [email protected] Zhicheng Qian Southeast University [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48730 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.18158
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fixed-Interface State Transfer Reveals Reuse in Controlled Routing Yanzhen Lu Shanghai Qizhi Institute [email protected] Zhicheng Qian Southeast University [email protected] Abstract Prompt-based interventions can change model behavior, but trained success alone does not identify where the behaviorally relevant state is represented. We study this question in controlled routing tasks using interfaces chosen on support data, held-out query evaluation, and matched necessity, sufficiency, and wrong-interface controls. On GPT-2 triop, an early interface supports exact transfer under these tests. On GPT-2 add/sub, zero-retrain compiled transfer at the fixed interface recovers most of donor routing accuracy, while trainable prompt slots can relearn the same behavior at several other positions only after additional support examples and optimization. These results distinguish fixed-interface reuse from prompt relocation in a setting where the two can be tested directly. Qwen routing provides a cross-architecture consistency check for the same matched-interface pattern at the operator token, although donor-specific identity on the local V V -path remains unresolved. Generation and reasoning branches are used to map scope: they show broader transport or weaker controller identifiability once control depends on longer trajectories or harder selection. In controlled routing, fixed-interface transfer is therefore stronger evidence of reuse than trained prompt success alone. 1 Introduction Prompt tuning, prefix tuning, and representation steering can all change language-model behavior [ 2 , 3 , 1 , 6 , 7 ] , but trained success alone does not show where the endogenous control variable lives. A learned prompt can create a useful internal signal, relocate one, or reuse one that is already available at runtime. The central question of this paper is whether prompt-induced routing behavior can be traced to reuse of a state at a fixed internal interface before any retraining takes place. When a state chosen on support data can be transferred at one fixed interface and survives held-out necessity, sufficiency, and wrong-interface tests, it provides stronger causal evidence for reuse than any trained prompt that is allowed to learn a new state elsewhere. The strongest evidence appears in controlled routing: GPT-2 triop gives exact transfer at a single early interface, GPT-2 add/sub shows that zero-retrain transfer and learned prompt relocation are functionally distinct, and Qwen routing provides a cross-architecture consistency check for the same matched-interface pattern at the operator token. Generation and reasoning branches then delineate scope by showing how the picture changes once control depends on broader trajectory state or harder selection. We first define the evidence standard and locking protocol, then present the routing results, then examine generation and reasoning extensions, and finally collect unresolved issues in the limitations. A simple example. The core comparison is easiest to see in a small routing setting. Suppose a donor prompt produces the correct route and a receiver prompt does not. If copying one internal state from donor to receiver at one fixed interface makes the receiver route correctly on held-out queries, and the reverse replacement removes that behavior, then the evidence supports reuse of a pre-existing state at that interface. If the same endpoint can instead be recovered only after training a new prompt slot, then the result shows that the behavior can be rebuilt, but not that the original interface was already carrying the relevant state. The routing sections instantiate this comparison directly. 2 Related Work Prompt and prefix methods establish that compact control signals can steer model behavior [ 2 , 3 , 1 ] , while activation steering and related intervention methods show that latent directions can change model behavior without full finetuning [ 6 , 7 ] . Model editing and context-sensitivity studies further demonstrate that localized internal manipulations can have predictable behavioral effects [ 4 , 5 ] . Our closest antecedents are intervention-based studies that use internal manipulations to support mechanistic explanations. The difference here is evidential rather than operational. Prompt tuning, prefixes, activation steering, editing interventions, and other causal analyses can all reveal useful internal manipulations, but they do not by themselves distinguish between reusing an existing state and rebuilding a new signal elsewhere. The main novelty of this paper is therefore a stricter evidence standard: held-out transfer at one fixed interface together with matched necessity, sufficiency, and wrong-interface controls. The experiments are organized around the settings where that standard can be tested most directly. 3 What Counts As Evidence We use a schematic write/gate/read vocabulary only to describe the intervention sites studied below. The important point is simple: all interface search is done on support data, and the selected intervention is then evaluated once on held-out query data. Three result types. The experiments report three progressively weaker kinds of evidence. Single-interface transfer means that held-out query behavior is preserved by matched replacement at one fixed interface, destroyed by the reverse necessity test, and not reproduced by wrong-interface or random-distribution controls. Wider-interface transfer means that interface interventions remain useful on held-out data but do not satisfy the full single-interface standard, for example because the successful interface must be widened. Partial control effects means that useful internal signal or useful proposals are present, but the decisive controller is distributed or only partly identifiable. What counts as positive evidence. Within a fixed task family, we treat an interface-state variable as stronger evidence than prompt form only when it survives held-out evaluation, wrong-interface negatives, and distribution-matched random controls under support/query lock. The unit fixed in advance is the interface family and intervention grammar, not one pre-chosen head or neuron. The pseudo-patch controls are included to test whether success depends on state identity rather than only first- and second-moment matching. A positive result therefore identifies a strong intervention point within the audited family and intervention grammar. Locking protocol. Support/query lock blocks query-side retuning after support-stage search. It does not remove family choice, budget choice, or intervention-grammar choice. The appendix records those search axes explicitly. Recurring checks. Across branches we repeatedly ask three simple questions: 1. Reader-content asymmetry : K -only and V -only interventions should produce different partial drops, while joint KV replacement should satisfy full necessity/sufficiency at the matched interface. 2. Identity over moments : distribution-matched random/swap perturbations should fail to close behavior if state identity is broken, even when aggregate energy statistics are matched. 3. Trajectory load growth : mediator budget and transferable prefix demand should increase with rollout horizon in multi-step generation. These checks guide interpretation across the tested intervention families. The empirical program asks four questions, in descending order of strength. Can a writable interface family yield a localized selected interface? Can matched state replacement satisfy necessity and sufficiency at that interface? How much of that single-interface picture survives when multi-step generation requires broader query-side state? And how does the control picture change once the task becomes reasoning-heavy? The appendix summarizes the full evidence chain, while the main text follows the shorter routing-first argument. 4 Experimental Protocol Branch Support / query unit Frozen before query Matched negatives / baselines Role in the study Toy support examples / held-out query examples write site, inversion key, supervision scope deeper-layer controls, last-answer-only supervision inspectable localization and lock sanity GPT-2 routing support prompts / query prompts layer, site, position, head ranking, top- k budget wrong layer/site, permutation, random-head ablations main single-interface routing evidence on route_acc GPT-2 generation support rollouts / held-out