ReCreate: Reasoning and Creating Domain Agents Driven by Experience

Zhezheng Hao, Hong Wang, Jian Luo, Jianqing Zhang, [3pt] Yuyan Zhou, Qiang Lin, Can Wang, Hande Dong, Jiawei Chen, [3pt] Zhejiang University · 2026

Read ReCreate: Reasoning and Creating Domain Agents Driven by Experience by Zhezheng Hao, Hong Wang, Jian Luo, Jianqing Zhang, [3pt] Yuyan Zhou, Qiang Lin, Can Wang, Hande Dong, Jiawei Chen, [3pt] Zhejiang University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-11100.txt.

Introduction

Zhezheng Hao and co-authors present ReCreate, a system that builds domain agents from experience. Language model agents are reshaping industry. Yet most working agents are still designed by hand, because tasks differ so widely. Building each one is labor-intensive. The authors ask the central question directly: can agents be created and adapted automatically in the wild?

ReCreate drives both reasoning and creation with accumulated experience. Past runs become the material for better agents. If the loop holds, agent design shifts from craft to cultivation. The work speaks to teams that deploy agents across many niches and cannot hand-tune each one.

Catalog record

CREATORZhezheng Hao, Hong Wang, Jian Luo, Jianqing Zhang, [3pt] Yuyan Zhou, Qiang Lin, Can Wang, Hande Dong, Jiawei Chen, [3pt] Zhejiang University
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-11100

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ReCreate: Reasoning and Creating Domain Agents Driven by Experience Zhezheng Hao, Hong Wang, Jian Luo, Jianqing Zhang, [3pt] Yuyan Zhou, Qiang Lin, Can Wang, Hande Dong, Jiawei Chen, [3pt] Zhejiang University Abstract Large Language Model (LLM) agents are reshaping the industrial landscape. However, most practical agents remain human-designed because tasks differ widely, making them labor-intensive to build. This situation poses a central question: can we automatically create and adapt domain agents in the wild? While several recent approaches have sought to automate agent creation, they typically treat agent generation as a black - box procedure and rely solely on final performance metrics to guide the process. Such strategies overlook critical evidence explaining why an agent succeeds or fails, and often require high computational costs. To address these limitations, we propose ReCreate , an experience - driven framework for the automatic creation of domain agents. ReCreate systematically leverages agent interaction histories, which provide rich concrete signals on both the causes of success or failure and the avenues for improvement. Specifically, we introduce an agent - as - optimizer paradigm that effectively learns from experience via three key components: (i) an experience storage and retrieval mechanism for on-demand inspection; (ii) a reasoning–creating synergy pipeline that map execution experience into scaffold edits; and (iii) hierarchical updates that abstract instance-level details into reusable domain patterns. In experiments across diverse domains, ReCreate consistently outperforms human-designed agents and existing automated agent generation methods, even when starting from minimal seed scaffolds. 1 1 1 Code is available at https://github.com/zz-haooo/ReCreate . 1 Introduction As the capabilities of large language models (LLMs) continue to improve ( 32 ; 7 ; 1 ; 26 ) , LLM-based agents have demonstrated striking competence on complex, long-horizon tasks, such as software engineering ( 59 ; 60 ) , scientific discovery ( 42 ; 53 ) , and web navigation ( 11 ; 43 ) . These LLM-based agent systems are typically built on scaffolds that specify how the model is prompted, how tasks are decomposed and executed, and how tools and environment feedback are integrated ( 27 ; 54 ) . The success of these LLM-based agents shows that designing agent scaffolds is a critical step toward unlocking raw LLMs’ capabilities and grounding raw LLMs in practical deployments ( 46 ; 22 ) . Yet in practice, LLM agents still rely on human-designed scaffolds, since different domains call for distinct knowledge and priors ( 55 ; 28 ; 20 ; 21 ) . Designing scaffolds manually is labor-intensive and hard to scale to numerous open-world scenarios. This tension raises a central question: can we automatically create domain agents from scratch in real-world environments? In this work, we refer to this problem as the domain agent creation . A growing line of work studies automated agent generation — replacing human - crafted scaffolds with a meta - agent that iteratively proposes, evaluates, and refines task-agent scaffolds ( 14 ; 39 ; 65 ; 23 ; 50 ) . The generation in these methods is typically driven by performance metrics (such as pass rates or LLM-judged scores), which are used to select and update candidate agents. While this strategy has yielded promising progress, relying solely on performance metrics presents two limitations: 1) Performance metrics do not provide evidence about why and how the agent succeeds or fails. Consequently, agent optimization is typically treated as a black - box process, relying on exhaustive trial - and - error to uncover effective directions for scaffold improvement, thereby undermining both efficiency and effectiveness. 2) Obtaining this metric value is often costly. Each candidate scaffold typically requires large - scale evaluation to yield a stable and reliable performance measure. For example, ADAS ( 14 ) spends about \$500 for a single agent generation on ARC dataset ( 4 ) with only 20 task samples. These limitations stem from treating domain agent creation as a black - box optimization driven purely by performance scores. Motivated by this, we shift towards a white - box optimization paradigm that leverages the agent’s interaction experience — including execution trajectories, evaluation logs, and environment state — as primary evidence for scaffold refinement. Such experience provides insight into why an agent succeeds or fails, offering semantic and concrete evidence for adding rules, updating tools, and revising workflows (Section 3 provide illustrative examples). To implement this idea, we introduce ReCreate , an experience - driven framework for automatically creating domain agents. ReCreate explicitly exploits rich interaction experiences on tasks to guide scaffold updates. However, this process faces three key challenges: (i) The large scale of interaction and environment information is challenging for LLMs to tackle; (ii) Extracting meaningful evidence from complex experiences and converting it into suitable scaffold updates is inherently nontrivial. (iii) Scaffold updates may easily overfit to single - task experiences rather than capture broader domain patterns, thus hindering domain - level generalization. We address these challenges through an agent - as - optimizer design comprising three components: 1) an experience storage and retrieval mechanism that enables on - demand evidence inspection within the ReCreate environment; 2) a reasoning–creation synergy pipeline that maps execution evidence into scaffold updates; 3) a hierarchical update mechanism that aggregates instance - level refinements into reusable domain - level patterns. Empirical validations on diverse domains confirms the effectiveness of the ReCreate, which achieves superior and low-cost domain adaptation even when starting from trivial seed scaffolds. Overall, the major contributions are: • The ReCreate framework: We highlight the importance of interaction-experience information and propose ReCreate, a framework that automatically creates agent scaffolds by learning from interaction experience rather than relying solely on performance metrics. • Agent-as-optimizer design: Within ReCreate, we introduce an agent-as-optimizer design that efficiently processes large - scale experience logs, infer actionable scaffold modifications from execution evidence, and extract reusable domain - level patterns. • Comprehensive evaluation: We evaluate ReCreate on thirteen benchmarks across four domains, showing consistent performance gains over human-designed agents and existing agent creating methods. 2 Preliminaries 2.1 Agent Scaffolds LLM agent can be viewed as the composition of a base model \phi and an agent scaffold \mathcal{A} ( 41 ; 54 ) . Formally, given a base LLM \phi , an agent scaffold \mathcal{A} denotes the surrounding software layer that makes the base LLM \phi executable in an environment ( 2 ; 30 ) . To make agent scaffold editable, we systematically examined recent open-source, general-purpose agent scaffolds and abstracted their common design patterns ( 60 ; 48 ; 24 ) . Based on their functions, we decompose \mathcal{A} into the following complementary modular components: • Role & Object : the system instruction that defines the agent’s identity, domain priors, and high-level goals; • Process & Strategy : the procedure that guides step-by-step reasoning, intermediate checks, and termination criteria; • Action & Tool : the action space exposed to the agent, implemented as reusable tools and scripts, including memory tools, search tools, etc; • Memory & Retrieval : the mechanism that controls how the agent stores, retrieves memory. We therefore decompose agent scaffold \mathcal{A} into a tuple \mathcal{A}=\bigl(\mathcal{A}^{\text{role}},\mathcal{A}^{\text{proc}},\mathcal{A}^{\text{tool}},\mathcal{A}^{\text{mem}}\bigr) , with each component editable. In our implementation, other components, such as the action–observation format and error format, are ignored as they are non-essential to

Read the complete text