EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery Conference: The 32th International ACM SIGKDD Conference on Knowledge Discoveryand Data Mining; August 9–13, 2026; Jeju, Korea CCS: Computing methodologies Multi-agent systems CCS: Computing methodologies Intelligent agents CCS: Computing methodologies Multi-agent planning

Yougang Lyu, Xi Zhang, Xinhao Yi, Yuyue Zhao, Shuyu Guo, Wenxiang Hu, Jan Piotrowski, Jakub Kaliski, Jacopo Urbani, Zaiqiao Meng, Lun Zhou, Xiaohui Yan · 2026

Read EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery Conference: The 32th International ACM SIGKDD Conference on Knowledge Discoveryand Data Mining; August 9–13, 2026; Jeju, Korea CCS: Computing methodologies Multi-agent systems CCS: Computing methodologies Intelligent agents CCS: Computing methodologies Multi-agent planning by Yougang Lyu, Xi Zhang, Xinhao Yi, Yuyue Zhao, Shuyu Guo, Wenxiang Hu, Jan Piotrowski, Jakub Kaliski, Jacopo Urbani, Zaiqiao Meng, Lun Zhou, Xiaohui Yan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08127.txt.

Introduction

Lyu and colleagues present EvoScientist, a multi-agent AI scientist framework that keeps improving its research plans instead of following a fixed pipeline. Static, hand-designed AI scientist systems miss promising directions, repeat failed tests, and chase infeasible ideas because they never learn from past work. EvoScientist splits the work among three agents: a Researcher Agent generating ideas, an Engineer Agent running tests, and an Evolution Manager Agent turning lessons from prior work into reusable knowledge. Two memory modules store feasible directions and effective test methods.

Catalog record

CREATORYougang Lyu, Xi Zhang, Xinhao Yi, Yuyue Zhao, Shuyu Guo, Wenxiang Hu, Jan Piotrowski, Jakub Kaliski, Jacopo Urbani, Zaiqiao Meng, Lun Zhou, Xiaohui Yan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55108
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08127

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery Conference: The 32th International ACM SIGKDD Conference on Knowledge Discoveryand Data Mining; August 9–13, 2026; Jeju, Korea CCS: Computing methodologies Multi-agent systems CCS: Computing methodologies Intelligent agents CCS: Computing methodologies Multi-agent planning Yougang Lyu, Xi Zhang, Xinhao Yi, Yuyue Zhao, Shuyu Guo, Wenxiang Hu, Jan Piotrowski, Jakub Kaliski, Jacopo Urbani, Zaiqiao Meng, Lun Zhou, Xiaohui Yan Abstract . The increasing adoption of Large Language Models (LLMs) has enabled AI scientists to perform increasingly complex end-to-end scientific discovery tasks. Such tasks required the coordination of specialized roles, including idea generation and experimental execution. Despite this complexity, most state-of-the-art AI scientist systems rely on static, hand-designed pipelines and fail to adapt their idea- or code-generation strategies based on accumulated interaction histories. As a result, these systems systematically overlook promising research directions, repeat previously failed experiments, and pursue infeasible ideas. To address this limitation, we introduce EvoScientist , an evolving multi-agent AI scientist framework that continuously improves its research strategies through persistent memory and self-evolution. EvoScientist comprises three specialized agents: a Researcher Agent ( RA ) responsible for scientific idea generation, an Engineer Agent ( EA ) responsible for experiment implementation and execution, and an Evolution Manager Agent ( EMA ) that distills insights from prior agent interactions into reusable knowledge. Specifically, EvoScientist contains two persistent memory modules: (i) an ideation memory, which summarizes feasible research directions from top-ranked ideas while recording previously unsuccessful directions identified during idea validation; and (ii) an experimentation memory, which captures effective data processing and model training strategies derived from code search trajectories and best-performing implementations. These memory modules enable the RA and EA to retrieve relevant prior strategies, thereby improving idea quality and increasing code execution success rates over time. Experiments show that EvoScientist outperforms 7 open-source and commercial state-of-the-art systems in scientific idea generation, achieving higher performance in terms of novelty, feasibility, relevance, and clarity through automatic and human evaluation. Furthermore, EvoScientist substantially improves code execution success rates through multi-agent evolution, demonstrating the effectiveness of persistent memory for end-to-end scientific discovery. 1 1 1 Code is available on EvoScientist 1. Introduction Scientific discovery progresses through a recurring cycle of observation, hypothesis formation, experimental testing, and application, in which researchers systematically explore existing knowledge, synthesize new ideas, and refine their understanding through empirical feedback ( 20 ; 16 ; 38 ) . Traditionally, this process has been driven by expert scientists who read extensive literature, formulate hypotheses, and validate them through rigorous experimentation, gradually accumulating experience into scientific expertise ( 17 ; 19 ; 37 ) . However, the vast and rapidly expanding space of possible concepts, mechanisms, and experimental conditions fundamentally limits how quickly humans can explore, evaluate, and verify new ideas ( 10 ; 43 ) . This challenge is further amplified by the explosive growth of scientific publications, making it increasingly difficult and time-consuming to keep up with the literature, generate novel yet feasible ideas, and execute validation experiments ( 63 ; 49 ) . To substantially accelerate research, AI-driven scientific discovery has progressed from applying Large Language Models (LLMs) to isolated sub-tasks to building agentic systems that support coordinated scientific reasoning and action across the discovery process ( 4 ) . One line of work focuses on early-stage idea generation, where LLMs and multi-agent collaboration are used to propose, critique, and iteratively refine hypotheses ( 52 ; 9 ; 22 ; 8 ; 39 ; 36 ; 3 ; 45 ; 54 ) . Representative work such as Virtual Scientist (VirSci) ( 54 ) and Co-Scientist ( 9 ) organizes multiple agents to simulate collaborative scientific ideation through proposal, critique, and refinement ( 54 ) . In parallel, a second line of work develops end-to-end AI scientist systems that automate the workflow from ideation and literature review to experiment implementation, analysis ( 25 ; 65 ; 14 ; 47 ; 62 ; 48 ; 56 ; 55 ) . Examples include AI Scientist-v2 ( 65 ) , which employs agentic tree search to improve end-to-end research trajectories, AI-Researcher ( 55 ) , which orchestrates structured collaboration across the full research pipeline, and InternAgent ( 56 ) , which incorporates human expert feedback into the agent workflow. Although these systems demonstrate encouraging progress, they largely treat end-to-end scientific discovery as a static execution pipeline. Agent roles, decision strategies, and interaction patterns are typically fixed after deployment, and accumulated outcomes and failures are rarely distilled into reusable experience. As a result, such system may repeatedly explore known failure patterns, overlook promising research directions, or invest substantial resources in infeasible ideas. These limitations highlight a missing capability in existing AI scientist systems: the ability to learn from accumulated outcomes and failures and to continuously improve both idea generation and experiment execution over time. This motivates the formulation of multi-agent evolution as a core requirement for end-to-end scientific discovery, where interaction histories are treated as a first-class resource rather than discarded execution traces. Accordingly, we study the following research question: How can we formulate end-to-end scientific discovery as a learning problem in which multi-agent systems evolve their idea-generation and-code generation by learning from prior successes and failures? To answer this question, we propose EvoScientist , a multi-agent evolution framework designed to solve the above end-to-end scientific discovery problem. EvoScientist decomposes scientific discovery into three specialised agents: a Researcher Agent ( RA ) that generates scientific ideas and research proposals, an Engineer Agent ( EA ) that executes experiments and produces code and analysis, and an Evolution Manager Agent ( EMA ) that distills interaction histories into persistent memories to guide future decision-making. Specifically, EvoScientist implements multi-agent evolution through two memory modules: (i) an ideation memory , which summarizes high-quality research directions from top-ranked ideas while recording directions that failed during idea validation; and (ii) an experimentation memory , which captures effective data processing and model training strategies derived from code search trajectories and the best-performing implementations. For each new task, the RA and EA retrieve relevant strategies from these memories and append them to their prompts, enabling continuous improvement in idea quality and code execution success rates over time. We conduct experiments on scientific idea generation, code generation, and end-to-end scientific discovery. EvoScientist outperforms 7 open-source and commercial baselines in idea generation quality (measured in terms of novelty, feasibility, relevance, and clarity) under both automatic and human evaluation, and achieves higher code execution success rates through multi-agent evolution. In an end-to-end evaluation, all six full papers generated by EvoScientist were accepted to ICAIS 2025 ( 1 ) ( AI Scientist Track ), and two received major awards (the Best Paper Award and the AI Reviewer’s Appraisal Award ). In summary, our main contributions are: ❶ We propose EvoScientist, a self-evolving multi-agent system with three specialized agents and two persistent memory modules, aiming to improve both the quality of generated research ideas and the reliability of code generation and execution. ❷ We introduce three multi-agent self-evolution mechanisms, namely idea direction evolution, idea validation evolution, and experiment strategy evolution, that enable EvoScientist to learn from accumulated outcomes and failures and to continuously improve both idea generation and experiment execution over time. ❸ We provide empirical evidence that EvoScientist generates

Read the complete text