Agentic-Ideation: Sample Efficient Agentic Trajectories Synthesis for Scientific Ideation Agents

Keyu Zhao, Lingyan Kong, Fengli Xu, Yong Li · 2026

Read Agentic-Ideation: Sample Efficient Agentic Trajectories Synthesis for Scientific Ideation Agents by Keyu Zhao, Lingyan Kong, Fengli Xu, Yong Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-31229.txt.

Introduction

Zhao and three colleagues build Agentic-Ideation, a way to train language model agents that propose scientific ideas. Good ideation means searching huge literature and reasoning spaces, yet fixed workflows limit flexibility. Training flexible agents needs example trajectories, records of tool use and reasoning, and making them by trial and error is costly.

Their pipeline uses a reference idea as oracle guidance to steer a multi-agent system toward that target. The system rebuilds the reasoning path and tool calls directly instead of wandering. Masking tool outputs during training keeps the model focused on decision logic. Tests beat the best workflow baseline by 11.91 percent in overall quality, with far better sample efficiency for high-grade trajectories.

Catalog record

CREATORKeyu Zhao, Lingyan Kong, Fengli Xu, Yong Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.31229

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Agentic-Ideation: Sample Efficient Agentic Trajectories Synthesis for Scientific Ideation Agents Keyu Zhao, Lingyan Kong, Fengli Xu, Yong Li Abstract Ideation plays a pivotal role in scientific discovery. Recent LLM, especially AI Scientist systems, show promising potential for automated ideation. However, existing approaches predominantly rely on pre-defined agentic workflows. This constraint severely limits the flexibility required to navigate the vast search space of scientific literature and the complex action space of research reasoning. Recently, training Agentic LLMs has emerged as a promising direction, offering flexible reasoning frameworks and the capability for autonomous tool utilization. However, there remains a non-trivial challenge: applying previous agentic data synthesis methods to scientific ideation suffers from prohibitively high data synthesis cost. To bridge this gap, we propose Agentic-Ideation, a novel framework comprising an automated trajectory synthesis pipeline and a specialized agentic LLM trained for scientific ideation. Specifically, we first define a comprehensive tool space incorporating three external tools and three cognitive tools. Then we introduce an Oracle-Guided Data Synthesis strategy. By leveraging a reference idea as oracle guidance, this approach steers the multi-agent system to efficiently reconstruct the logical reasoning and tool invocation paths, transforming aimless trial-and-error into directed trajectory generation. Finally, we train the agent on these synthesized trajectories, employing a masking strategy on tool execution results. This ensures the model focuses on decision-making logic without interference from external feedback. Experimental results demonstrate that our method outperforms the SOTA workflow-based baseline by 11.91% in overall quality. Furthermore, our approach improves the sample efficiency of high-quality data synthesis by over 10 × \times . 1 Introduction Scientific ideation serves as the genesis of the entire research lifecycle, fundamentally determining the novelty and potential impact of downstream discoveries. Recently, the rapid evolution of Large Language Models (LLMs) has catalyzed the vision of an "AI Scientist" ( 22 ; 14 ; 19 ) , capable of automating complex research tasks ranging from initial idea generation ( 31 ; 16 ) to final manuscript preparation ( 26 ; 29 ; 13 ) . Despite this priority, previous approaches predominantly rely on pre-defined workflows ( 12 ; 34 ) . These methods typically constrain Large Language Models (LLMs) to execute pre-defined, linear sequences, such as literature retrieval followed by template filling. Crucially, the efficacy of these rigid pipelines depends heavily on complex, human-designed prompts meticulously crafted to guide the model through each step. This reliance on static, hand-crafted engineering restricts flexibility ( 20 ; 8 ) , failing to navigate the vast search space of literature where researchers must adaptively select tools and refine reasoning. To transcend these limitations, training Agentic LLMs has emerged as a promising frontier. Unlike static workflows, agentic models offer a flexible reasoning framework with the potential to autonomously orchestrate tools and adaptively navigate the research space without being bound by brittle scripts ( 9 ; 4 ) . However, training such agentic models is non-trivial, primarily due to the challenge of efficiently synthesizing high-quality agentic trajectory data. Existing data synthesis frameworks for agents generally focus on tasks with definite answers, such as multi-hop Question Answering (QA) ( 23 ; 10 ) . In these scenarios, high-quality trajectories are typically filtered via rejection sampling ( 11 ) , where the correctness of the final answer serves as a clear ground truth signal to validate the reasoning path. Unfortunately, this paradigm is ill-suited for scientific ideation. Unlike QA, ideation involves a vast and open-ended answer space where no single "correct" solution exists ( 32 ; 2 ) . Consequently, applying standard rejection sampling leads to prohibitively low sample efficiency, as unguided models struggle to navigate this immense search space to yield high-quality ideas, rendering the data synthesis process computationally expensive and ineffective. To tackle these challenges, we introduce Agentic-Ideation, a comprehensive framework designed for efficient agentic data synthesis and robust model training. We first meticulously define the agent’s hybrid tool space, which comprises three external tools and three thinking tools. The external tools, including Search , Get_References and Get_Cited , empower the agent to access external APIs, thereby proactively expanding its knowledge boundaries beyond its internal parameters. Complementing these, the thinking tools, including Analyse_Gap , Ideation and Reflection , enable the agent to perform critical cognitive tasks, such as identifying research voids and iteratively refining ideas. To synthesize high-quality trajectories based on this action space, we construct a hierarchical multi-agent system consisting of a Planner, a Controller, and six specialized tool agents. In this architecture, the Planner orchestrates the high-level ideation strategy, while the Controller manages fine-grained tool selection and execution at each step. Notably, we endow agents with an oracle view of the high-quality "reference idea," acting as a navigational beacon to maximize sample efficiency. Instead of aimlessly exploring the vast action space, this guidance transforms the synthesis process from a stochastic search into a directed trajectory reconstruction. By leveraging this "foresight," the system can generate a valid, logically coherent reasoning path in a single pass. This fundamentally circumvents the massive computational waste inherent in traditional rejection sampling, where valid trajectories are sparsely distilled only after exhaustive, undirected "hindsight" trial-and-error. Finally, we utilize these high-quality trajectories to train the target agent, equipping it with the capability to perform grounded reasoning and autonomous exploration for open-ended scientific ideation. During this phase, we apply a strategic masking technique to the results returned by external tools. This critical design forces the model to focus on the reasoning behind tool invocation rather than memorizing specific return values, thereby avoiding interference from external feedback during the learning process and ensuring the generalization and robustness of the trained agent. Extensive experiments demonstrate the superiority of our proposed framework. Quantitatively, our trained agentic LLM consistently outperforms all competitive baselines, achieving an 11.91% improvement in overall score compared to the state-of-the-art method, which empirically validates the effectiveness of our proposed agentic training paradigm. In terms of data construction, our approach achieves a remarkable efficiency boost, accelerating the synthesis of high-quality agentic trajectories by over tenfold compared to previous rejection sampling strategies. Furthermore, a comprehensive human evaluation confirms that the ideas generated by our agent exhibit higher novelty, feasibility, and scientific value, validating the practical utility of our method in real-world research scenarios. Our contributions can be summarized as follows: 1. We pioneer the application of agentic LLMs to scientific ideation, offering a flexible and autonomous alternative to existing rigid, workflow-based approaches. This paradigm shift enables the model to adaptively navigate the complex search space of scientific ideas. 2. We propose a novel oracle-guided multi-agent data synthesis framework. By leveraging a global view to guide trajectory generation, we address the challenge of data scarcity and significantly enhance sample efficiency in the open-ended ideation domain. 3. We achieve SOTA results across all metrics, outperforming strong baselines and improving synthesis efficiency by over tenfold. Furthermore, human evaluation confirms our method generates more novel and feasible ideas. 2 Related Works 2.1 Scientific Ideation Figure 1 : Overview of the proposed AgenticIdeation includes Oracle-Guided Agentic Data Synthesis and Agentic Supervised Fine-Tuning . The system utilizes Oracle guidance to synthesize high-quality research trajectories, which are subsequently used to fine-tune the model with a masking strategy applied to tool execution results. The pursuit of AI Scientists envisions systems capable of automating

Read the complete text