A Control Architecture for Training-Free Memory Use

Yanzhen Lu Shanghai Qizhi Institute [email protected] Muchen Jiang Nanjing Whale Cloud [email protected] · 2026

Read A Control Architecture for Training-Free Memory Use by Yanzhen Lu Shanghai Qizhi Institute [email protected] Muchen Jiang Nanjing Whale Cloud [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18206.txt.

Introduction

Lu, Jiang, Qian, and Zhou design a control system for using prompt-injected memory without retraining a model. Retrieved memory helps only when applied in the right state, so the system decides when to run a second memory-assisted pass and when to trust it. Uncertainty routing, confidence checks, and evidence-based upkeep of the memory bank govern the process. Under matched controls, arithmetic scores rise by 7 points on SVAMP and about 8 on ASDiv, with smaller gains on question-answering and agent tasks.

Catalog record

CREATORYanzhen Lu Shanghai Qizhi Institute [email protected] Muchen Jiang Nanjing Whale Cloud [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40945
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18206

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Control Architecture for Training-Free Memory Use Yanzhen Lu Shanghai Qizhi Institute [email protected] Muchen Jiang Nanjing Whale Cloud [email protected] Abstract Prompt-injected memory can improve reasoning without updating model weights, but it also creates a control problem: retrieved content helps only when it is applied in the right state. We study this problem in a strict training-free setting and formulate it as applicability control : when to trigger a memory-assisted second pass, when to trust it, and how to maintain the memory bank over time. Our method combines uncertainty-based routing, confidence-based selective acceptance, bank selection across rule and exemplar memory, and evidence-based governance of the memory bank over time. Under a locked training-free protocol with compute-matched controls, it improves two core arithmetic benchmarks by +7.0 points on SVAMP and +7.67 points on ASDiv over baseline. The same architecture also transfers to QA and agent benchmarks with smaller positive effects and shows the same positive direction on a second checkpoint for the main arithmetic tasks. On arithmetic, the main empirical pattern is that the control architecture, rather than raw memory exposure, drives the improvements on SVAMP and ASDiv. Mechanistically, confidence separates helpful from harmful rule-bank interventions, and under fixed retrieval the repair-versus-corrupt difference localizes to rows whose retrieved set actually contains the edited entries. 1 Introduction Training-free context optimization treats prompts and memory as the optimization object instead of model parameters. Its attraction is practical: no weight updates, no base-model drift, and direct deployment on top of existing systems. Prompt-injected memory is a natural instance of this idea, but it works only when retrieved content is applied under the right conditions. A rule or exemplar that is useful in one state can be irrelevant or harmful in another. This makes prompt memory a control problem as much as a retrieval problem. In addition to choosing what to retrieve, the system must decide when memory should be queried, which bank should be exposed, and whether the memory-conditioned answer should override the baseline. We therefore study prompt memory as an applicability-control problem under locked evaluation. The applicability-control challenge. Most prior work focuses on “what to retrieve” but gives less attention to “whether to apply retrieved content at all.” Inappropriate application both hurts quality and wastes compute. In our locked protocol, a compute-matched retry produces no lift on the strict reasoning benchmarks, and stronger retrieval-only or non-memory controls remain below the best gated memory policy on SVAMP and ASDiv. The main issue is therefore applicability control under fixed compute, not raw retrieval volume. We propose TAG as a training-free control stack with four coupled pieces: (1) uncertainty-based routing ; (2) confidence-based selective acceptance ; (3) bank selection across rule and exemplar memory; (4) evidence-based governance of the memory bank over time. Figure 1 illustrates the decision flow. Figure 1 : TAG decision flow. At each step, the baseline action is decoded and its confidence assessed. Low-confidence steps are routed to memory retrieval and a second-pass decode. The second-pass output is accepted only if it passes both a confidence-margin check and structural guards; otherwise the system rolls back to the baseline action. Over time, persistently harmful memory entries are retired. Contributions. 1. We formulate prompt-memory applicability as a control problem and evaluate it under locked, compute-matched comparison. 2. We introduce a training-free control architecture that combines uncertainty-gated routing, confidence-based selective acceptance, bank selection across rule and exemplar memory, and explicit memory governance. 3. We show that the main arithmetic gains are not retrieval-only and not retry-only: on SVAMP and ASDiv, the control layer outperforms weaker-control and non-memory alternatives built on the same prompt-memory substrate. 4. We provide mechanism evidence from bank asymmetry, bank-specific confidence separability, and fixed-retrieval counterfactual replay, which isolates retrieval drift and localizes the residual content-edit signal to edited-entry exposures. 5. We report supporting transfer and robustness evidence on QA, agent, second-checkpoint, and same-solver memory-quality comparisons. Scope. This paper focuses on the control layer rather than on designing a new retriever. Our goal is to separate memory content from memory-use policy under a locked protocol and identify robust operating points for memory use. 2 Related Work Selective prediction and abstention. Selective classification ( Geifman and El-Yaniv 2017 ; Kamath et al. 2020 ) , LLM self-assessment ( Kadavath et al. 2022 ; Lin et al. 2022 ; Xiong et al. 2024 ) , semantic uncertainty ( Kuhn et al. 2023 ) , and calibration ( Guo et al. 2017 ; Platt 1999 ) all motivate our use of confidence as a control signal. TAG turns that idea into a routing gate inside a memory-augmented pipeline. Retrieval-augmented generation and control. RAG ( Lewis et al. 2020 ) , REALM ( Guu et al. 2020 ) , Self-RAG ( Asai et al. 2024 ) , CRAG ( Yan et al. 2024 ) , FLARE ( Jiang et al. 2023 ) , and uncertainty-triggered retrieval ( Yao et al. 2025 ) study when retrieval should occur or how retrieval quality should improve. Our focus is more intervention-centric: whether and when retrieved memory should override the baseline action, with explicit rollback and retirement. Memory-augmented agents. Generative agents ( Park et al. 2023 ) , Voyager ( Wang et al. 2023a ) , Reflexion ( Shinn et al. 2023 ) , CLIN ( Majumder et al. 2023 ) , ExpeL ( Zhao et al. 2024 ) , and MemGPT ( Packer et al. 2023 ) show how memory can support long-horizon behavior. TAG complements this line by governing when stored knowledge should be applied. Prompt optimization. Prompt-optimization methods such as DSPy ( Khattab et al. 2024 ) , APE ( Zhou et al. 2023 ) , OPRO ( Yang et al. 2024 ) , and self-consistency ( Wang et al. 2023b ) improve content or reasoning quality; TAG instead governs when memory content is applied. Training-free experience libraries. Recent training-free prompt-memory systems, including Training-Free GRPO-style experience libraries (arXiv:2510.08191), collect natural-language experiences and reinject them at test time. Our paper is a control-layer study on top of that same substrate: when should memory be exposed, when should it override the baseline, and when should harmful memories be retired? 3 Method Problem formulation. At step t , a baseline policy proposes action a_{t} with confidence c_{t} ; if retrieval is triggered, a memory-conditioned second pass proposes a_{t}^{\prime} with confidence c_{t}^{\prime} . We optimize a quality–cost trade-off under training-free constraints: \max_{\pi\in\Pi_{\text{tf}}}\;\mathbb{E}[Q(\pi)]-\lambda\,\mathbb{E}[C(\pi)], (1) where Q is task quality, C is calls per query, and \Pi_{\text{tf}} forbids parameter updates. Applicability as latent intervention value. We separate retrieval exposure from useful applicability . Let e_{t} denote the retrieved memory item or bank shown at step t , and let A_{t}(e_{t})\in\{0,1\} indicate whether that memory is actually valid for the current local decision. Define the incremental utility of committing the memory-conditioned action as \Delta_{t}(e_{t})=u_{t}(a_{t}^{\prime};e_{t})-u_{t}(a_{t}), (2) where u_{t} is task utility at the current step or example. In this formulation, the sign of \Delta_{t}(e_{t}) is governed mainly by whether A_{t}(e_{t})=1 . Shared control target. All three controls approximate the sign of a single latent value. Let V_{t}(e_{t})=\mathbb{E}[\Delta_{t}(e_{t})-\lambda k_{t}\mid x_{t},e_{t}], (3) where k_{t} is the extra cost of intervention. Routing estimates whether exposure is worth buying; acceptance estimates whether the realized candidate should override the baseline; retirement estimates

Read the complete text