Preping : Building Agent Memory without Tasks
Yumin Choi, Sangwoo Park, Minki Kang, Jinheon Baek, Sung Ju Hwang, [0.5em] KAIST · 2026
Read Preping : Building Agent Memory without Tasks by Yumin Choi, Sangwoo Park, Minki Kang, Jinheon Baek, Sung Ju Hwang, [0.5em] KAIST (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13880.txt.
Introduction
Choi and four co-authors tackle the cold start of an agent placed in a new setting with no task past. Their PREPING setup builds task know-how before any real task shows up, from self-made practice runs alone. A proposer memory, a set control state, steers what the agent drills and keeps. That curb stops drills that repeat, fail, or teach nothing, and keeps stored runs from going stale fast.
Catalog record
| CREATOR | Yumin Choi, Sangwoo Park, Minki Kang, Jinheon Baek, Sung Ju Hwang, [0.5em] KAIST |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 89524 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13880
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Preping : Building Agent Memory without Tasks Yumin Choi, Sangwoo Park, Minki Kang, Jinheon Baek, Sung Ju Hwang, [0.5em] KAIST Abstract Agent memory is typically constructed either offline from curated demonstrations or online from post-deployment interactions. However, regardless of how it is built, an agent faces a cold-start gap when first introduced to a new environment without any task-specific experience available. In this paper, we study pre-task memory construction : whether an agent can build procedural memory before observing any target-environment tasks, using only self-generated synthetic practice. Yet, synthetic interaction alone is insufficient, as without controlling what to practice and what to store, synthetic tasks become redundant, infeasible, and ultimately uninformative, and memory further degrades quickly due to unfiltered trajectories. To overcome this, we present Preping , a proposer-guided memory construction framework. At its core is proposer memory , a structured control state that shapes future practice. A Proposer generates synthetic tasks conditioned on this state, a Solver executes them, and a Validator determines which trajectories are eligible for memory insertion while also providing feedback to guide future proposals. Experiments on AppWorld, BFCL v3, and MCP-Universe show that Preping substantially improves over a no-memory baseline and achieves performance competitive with strong playbook-based methods built from offline or online experience, with deployment cost 2.99 × 2.99\times lower on AppWorld and 2.23 × 2.23\times lower on BFCL v3 than online memory construction. Further analyses reveal that the main benefit does not come from synthetic volume alone, but from proposer-side control over feasibility, redundancy, and coverage, combined with selective memory updates. † † footnotetext: \dagger Equal advising. Project page . 1 Introduction LLM agents are increasingly deployed to solve tasks by acting in executable environments, from tool APIs and Model Context Protocol (MCP) servers to command-line interfaces [ 28 , 33 , 2 , 8 , 11 , 24 ] . In these environments, success requires more than knowing which tools are available: agents must learn environment-specific procedures, including how tool calls compose, which preconditions matter, and how to recover from state-dependent failures [ 20 , 18 , 19 ] . Reusable memory offers a practical pathway to capture such procedural knowledge as tool-use guidance, workflow rules, and playbook-style instructions. Prior work on agent memory shows that such memory can substantially improve downstream execution performance when useful task experience is available [ 21 , 31 , 4 , 12 ] . However, existing memory construction methods typically rely on target-environment task experience, either collected before deployment as demonstrations or trajectories, or accumulated after deployment from user interactions [ 25 , 15 , 37 ] . This requirement creates a practical gap for newly connected environments. Offline construction depends on humans to design, collect, or solve tasks per environment, which is costly and rarely available before deployment. Online construction avoids this upfront effort but starts from empty memory: the agent learns only after user-facing tasks arrive, exposing users to early failures, memory-update latency, and additional deployment-time costs. Memory is thus most needed precisely when the experience required to build it has not yet been collected. Figure 1: Preping builds memory before the first user task and mitigates online cold-start. Left: Unlike offline methods that require prior human tasks or online methods that start from empty memory, Preping constructs procedural memory through self-generated synthetic practice before deployment. Right: Preping establishes broad tool coverage before deployment, whereas ACE-Online must accumulate coverage from user-facing tasks, requiring 58 tasks to match Preping on AppWorld and still falling short after 200 tasks on BFCL v3. Motivated by this, we study pre-task memory construction : building reusable procedural memory before any target-environment task data is available. In this setting, the agent may inspect environment documentation, execute tools, and observe their outputs, but it has not seen human-provided tasks, demonstrations, solved trajectories, or deployment-time user interactions from the target environment. This makes the setting distinct from simply performing online memory construction earlier: without task instructions, the agent lacks a direct signal about which user goals will appear, which tools should be composed, or what successful task-level workflows should look like. Pre-task memory construction is challenging because access to the environment alone does not reveal reusable task-level procedures. Tool documentation and schemas specify callable interfaces, but often leave environment-specific preconditions, state-dependent constraints, and failure recovery strategies implicit; likewise, free-form exploration can reveal isolated tool-execution examples, but does not reliably produce reusable procedures for accomplishing task-level goals. The agent must therefore create and execute its own task-level objectives through self-generated synthetic practice. However, naive synthetic practice introduces two coupled control problems: tasks can be redundant, infeasible, or poorly grounded in the environment, and storing their trajectories can contaminate memory with misleading guidance. Therefore, pre-task memory construction is not merely a synthetic task generation problem, but a problem of jointly shaping what to practice and what to store . To address this, we introduce Preping ( Pre -Task RE usable P laybook Mak ING ), a framework that couples proposer-guided synthetic practice with validation-gated memory admission. Preping maintains proposer memory , a construction-time state, which tracks prior synthetic practice history and environment information. Conditioned on this state, a Proposer generates feasible synthetic tasks that expand coverage toward under-explored aspects of the environment, and a Solver executes these tasks to produce trajectories. A Validator then filters out infeasible task trajectories before memory insertion, and a memory update module distills the remaining trajectories into solver memory , the reusable procedural memory used for future tasks. In this way, Preping builds memory by shaping both the practice distribution and the quality of trajectories admitted into memory. We evaluate Preping on AppWorld [ 23 ] , BFCL v3 [ 17 ] , and MCP-Universe [ 8 ] , covering stateful app execution, structured function calling, and realistic MCP-server tool use. The results show three main findings. First, Preping builds effective pre-task memory across all benchmarks, improving over a no-memory baseline by 17.1 points on AppWorld, 19.3 points on BFCL v3, and 5.4 points on MCP-Universe, while remaining competitive with methods that rely on human-defined or deployment-time target tasks, even though Preping requires no such target-task experience. Second, ablations show that these gains come not from synthetic task generation alone, but from validation-gated memory admission and proposer-side control over feasibility, tool coverage, and downstream relevance. Third, Preping offers deployment benefits as an initialization for the online memory construction approach (ACE [ 33 ] ) and as frozen pre-task memory. In particular, Preping +ACE improves performance on AppWorld from 71.3 to 76.3 while reducing early cold-start failures and tool-coverage shortfall ( Figure 1 , Right); when frozen, Preping avoids deployment-time memory-update calls, reducing cost by 2.99\times on AppWorld and 2.23\times on BFCL v3 relative to ACE-Online. 2 Related Work Memory for LLM Agents. Reusable memory enables LLM agents to adapt across tasks while keeping the underlying model fixed. As external context, memory can be inspected, revised, and transferred across models or modules, making it attractive for tool-using agents and compound AI systems [ 10 , 33 , 6 ] . Prior work stores experience in various forms, including persistent memory, workflow knowledge, playbook-style guidance, or long-term context distilled from prior interactions [ 21 , 15 , 31 , 4 ,