Context Training with Active Information Seeking

Zeyu Huang, Adhiguna Kuncoro, Qixuan Feng, Jiajun Shen, Lucio Dery, Arthur Szlam, Marc’Aurelio Ranzato · 2026

Read Context Training with Active Information Seeking by Zeyu Huang, Adhiguna Kuncoro, Qixuan Feng, Jiajun Shen, Lucio Dery, Arthur Szlam, Marc’Aurelio Ranzato (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13050.txt.

Introduction

Huang and six co-authors equip context optimizers for language models with Wikipedia search and browser tools for active information seeking. Naively adding tools to a standard step-by-step pipeline degrades performance. But paired with a search-based training procedure that keeps and prunes multiple candidate contexts, active seeking brings steady, large gains. Gains span low-resource translation, health scenarios and reasoning-heavy tasks, while the method stays data-thrifty and carries over across models.

Catalog record

CREATORZeyu Huang, Adhiguna Kuncoro, Qixuan Feng, Jiajun Shen, Lucio Dery, Arthur Szlam, Marc’Aurelio Ranzato
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68978
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13050

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Context Training with Active Information Seeking Zeyu Huang, Adhiguna Kuncoro, Qixuan Feng, Jiajun Shen, Lucio Dery, Arthur Szlam, Marc’Aurelio Ranzato Abstract Most existing large language models (LLMs) are expensive to adapt after deployment, especially when a task requires newly produced information or niche domain knowledge. Recent work has shown that, by manipulating and optimizing their context, LLMs can be tailored to downstream tasks without updating their weights. However, most existing methods remain closed-loop, relying solely on the model’s intrinsic knowledge. In this paper, we equip these context optimizers with Wikipedia search and browser tools for active information seeking. We show that naively adding these tools to a standard sequential context optimization pipeline can actually degrade performance compared to baselines. However, when paired with a search-based training procedure that maintains and prunes multiple candidate contexts, active information seeking delivers consistent and substantial gains. We demonstrate these improvements across diverse domains, including low-resource translation (Flores+), health scenarios (HealthBench), and reasoning-heavy tasks (LiveCodeBench and Humanity’s Last Exam). Furthermore, our method proves to be data-efficient, robust across different hyperparameters, and capable of generating effective textual contexts that generalize well across different models. \uselogo \reportnumber 0001 1 Introduction The rise of Large Language Models (LLMs) ( 42 ; 38 ) represents a fundamental shift away from task-specific AI. Unlike their predecessors that were trained on narrow domains, contemporary LLMs exhibit impressive general-purpose capabilities ( 51 ; 53 ) , allowing them to navigate diverse domains and scenarios ( 9 ; 4 ; 20 ; 33 ; 16 ; 17 ) . Yet, once deployed, these models remain difficult to adapt continuously when a task requires newly produced information, niche domain knowledge, or behavior specialized to unfamiliar settings ( 12 ; 10 ) . Retraining or fine-tuning models with new data is a plausible solution, but it incurs prohibitive training costs and risks catastrophic forgetting. Consequently, several works have proposed shifting the focus from updating model parameters to optimizing the model context , i.e. , constructing an evolving working memory to adapt to new tasks. ( 44 ; 7 ; 23 ) . Under this paradigm, learning is reformulated as the iterative refinement of the input context or a pluggable memory bank, rather than an update to the parameters. At each iteration, an LLM-based optimizer reflects on a data batch, such as past task attempts and feedback, and then refines the existing context. By selecting, abstracting, and refactoring experiences into a dynamic knowledge base or skill set, such systems can achieve positive transfer on relevant tasks without altering a single parameter ( 21 ) . Pioneering frameworks such as ProTeGi ( 32 ) , TextGrad ( 52 ) , and DSPy ( 19 ) demonstrate the promise of this approach for reasoning and code-generation tasks without manual prompt engineering. Despite their initial success, most existing approaches are constrained by a fundamental drawback: They are closed systems. Lacking external grounding and access to external sources of information, these frameworks primarily rearrange and refine the optimizer’s existing internal knowledge, making it difficult to incorporate task-relevant information that falls outside the model’s parametric memory. This creates a critical bottleneck: When the desirable information ( e.g. , a report released after training or a niche technical fact) lies outside the model’s frozen parametric knowledge, the optimizer cannot reliably discover it and make effective updates to the context. This issue is especially acute when the training feedback identifies that the executor is wrong, but does not itself contain the missing knowledge needed to repair the context. In that case, a closed optimizer can only reorganize or extrapolate from its existing knowledge, and the resulting update is written directly into the context used by future executor calls. Moreover, the system may amplify hallucinations rather than verify the ground truth. As noted in recent studies on the “curse of recursion” ( 37 ) , such self-consuming loops without external data could lead to context collapse ( 55 ) , where the diversity and utility of the optimized context suddenly degrade. Nevertheless, simply granting the optimizer access to the web does not guarantee success. We identify two critical failure modes in the standard sequential training pipeline: (1) Context Pollution : Given the uncontrolled nature of web content, the model risks injecting low-quality or misleading information into the context. According to our preliminary study, the optimizer agents struggle to recover from these context-polluting updates, especially when the context optimizer agent lacks an explicit backtracking mechanism. (2) Local Optima : During training, a greedy optimization strategy may commit to sub-optimal trajectories early on, achieving only marginal gains while missing better-performing alternative solutions. To address these two issues, we adopt a beam-search-style training process that maintains a pool of candidate contexts, explores diverse updates in parallel, and discards trajectories that are contaminated by low-quality external data or trapped in weak strategies. We also include the current best context in the candidate pool as a “Do Nothing” option. This ensures that, if all new explorations turn out to be noisy or unhelpful, the optimizer can simply retain the previous best state. We examine our proposed approach across diverse domains, including low-resource translation (Flores+), healthcare (HealthBench), and two reasoning-heavy tasks (LiveCodeBench & Humanity’s Last Exam). We observe consistent performance gains when active information seeking is paired with this search-based training procedure, compared to the sequential, closed-context training baseline, without applying any manual task-specific optimization or task-specific prompt tuning. Moreover, we present analysis and ablation studies showing that the method is data-efficient and robust to different hyperparameters, and that the context optimized for one model generalizes well to other models. 2 Related Work: from Context Engineering to Working-Memory Evolution LLMs’ in-context learning capability offers a promising way to enhance model performance and elicit desired behaviors without updating model parameters. We survey this progression from Context Engineering to Working-Memory Evolution ; the former focuses on the strategic composition of the model’s final input to maximize immediate performance, while the latter attempts to establish a dynamic workspace to enable efficient adaptation to new tasks and environments. Context Engineering Context engineering encompasses a broad spectrum of techniques designed to optimize the information distribution within the input of a frozen LLM ( 25 ) . Early research established the foundation of this paradigm through few-shot prompting. ( 5 ; 39 ; 8 ) . Prompt engineering then became popular ( 35 ; 34 ) and evolved along two distinct lines: (1) principled heuristics, such as the widely adopted Chain-of-Thought prompting ( 46 ) ; (2) automated optimization strategies that utilize the LLM itself to iteratively refine the prompt via genetic algorithms ( 11 ) and Beam Search ( 32 ) . Furthermore, context engineering extends to external augmentation such as Retrieval-Augmented Generation (RAG) ( 54 ; 1 ; 22 ) and tool-use that injects relevant documents or execution outputs into the context window. Overall, whether through the precise tuning of instructions or the integration of external knowledge pieces, the unified goal is to construct a composite input that maximizes inference capability. Retrieval-Augmented Generation typically assumes an existing corpus or database and focuses on retrieving the right evidence from it for a given query. Our work notably differs from RAG because our optimizer agent actively

Read the complete text