A Survey of AI Scientists
Guiyao Tie, Pan Zhou, Lichao Sun · 2025
Read A Survey of AI Scientists by Guiyao Tie, Pan Zhou, Lichao Sun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-23045.txt.
Introduction
Guiyao Tie, Pan Zhou, and Lichao Sun survey the rise of AI scientists, systems meant to run the full research cycle on their own. Such a system would form hypotheses, run studies, and write up findings for publication. Systems have spread fast and in many forms, leaving the field fragmented and hard to compare.
The survey organizes the landscape, tracing shared methods and trends across designs. It clarifies what current systems can truly do, from idea generation to final synthesis. For researchers and funders, the map helps judge claims about automated discovery and spot the gaps that still need human judgment.
Catalog record
| CREATOR | Guiyao Tie, Pan Zhou, Lichao Sun |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-23045
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Survey of AI Scientists Guiyao Tie, Pan Zhou, Lichao Sun Abstract A new scientific paradigm, the AI Scientist, has coalesced at the intersection of artificial intelligence and epistemology, promising a fundamental shift from AI-assisted analysis to end-to-end autonomous discovery. Catalyzed by rapid advances in large language models, multi-agent orchestration, and robotic automation, these systems are architected to emulate the complete scientific workflow—from initial hypothesis generation to the final synthesis of publishable findings. This transition moves beyond using AI as an instrument of inquiry, positioning it as a potential originator of scientific knowledge. However, the rapid and unstructured proliferation of these systems has created a fragmented research landscape, obscuring overarching methodological principles and developmental trends. This survey provides a systematic and comprehensive synthesis of this emerging domain by introducing a unified, six-stage methodological framework that deconstructs the scientific process into: Literature Review, Idea Generation, Experimental Preparation, Experimental Execution, Scientific Writing, and Paper Generation. Through this analytical lens, we systematically map and analyze dozens of seminal works from 2022 to late 2025, revealing a clear three-phase evolutionary trajectory. Our analysis charts the field’s progression from an initial phase of Foundational Modules, focused on task-specific automation, through a period of Closed-Loop Integration, to the current frontier of Scalability, Impact, and Collaboration. By synthesizing these developments, this survey identifies key architectural patterns and highlights the dual research thrusts toward both greater machine autonomy and more sophisticated human-in-the-loop synergy. We conclude by presenting a forward-looking agenda that addresses critical open challenges in robustness, generalizability, and ethical governance. Ultimately, this work provides a critical roadmap for the field, intended to guide the next generation of systems toward becoming trustworthy, verifiable, and indispensable partners in human scientific inquiry. Project Github: https://github.com/Mr-Tieguigui/Survey-for-AI-Scientist . 3 3 footnotetext: Latest Update: Oct., 2025. K eywords AI Scientist, Autonomous Science, Large Language Models, Multi-Agent Systems. 1 Introduction Over the past few years, a new paradigm has coalesced at the intersection of artificial intelligence and the philosophy of science: AI Scientist . Distinct from earlier "AI for Science" efforts that leveraged machine learning to accelerate discrete tasks like data analysis or simulation [ 1 , 2 , 3 ] , the AI Scientist represents a transformative ambition toward end-to-end autonomous discovery . Rather than serving as computational assistants, these systems are architected to emulate and, in some cases, fully execute the roles of human researchers—formulating novel hypotheses, designing and conducting experiments, interpreting results, and generating publishable insights [ 4 , 5 , 6 ] . This vision has been catalyzed by a confluence of recent breakthroughs, including the sophisticated reasoning capabilities of large language models (LLMs) [ 7 , 8 ] , advances in multi-agent orchestration [ 9 , 10 ] , and the maturation of automated laboratory systems [ 11 , 12 ] . Together, these developments are driving a fundamental transition from automation —where AI assists predefined steps—to autonomy —where an AI agent designs, validates, and executes its own scientific workflow. This conceptual shift not only reshapes how research is conducted but also poses profound epistemological questions: AI is evolving from an instrument of inquiry into a potential originator of scientific knowledge . Historically, the idea of machine-driven science can be traced to early symbolic reasoning and automated theorem proving [ 13 , 14 ] . Yet, it was constrained by domain specificity and limited generalization. Modern AI Scientists, powered by foundation models and reasoning frameworks, have broken this bottleneck. They integrate symbolic reasoning, natural language understanding, and multi-modal perception to create a self-improving research loop: observe–hypothesize–experiment–analyze–publish . Recent systems such as The AI Scientist [ 15 ] , Curie [ 11 ] , and PiFlow [ 16 ] exemplify this progression, combining agentic planning, principle-aware inference, and iterative self-correction. This evolution parallels milestones in autonomous experimentation—ranging from closed-loop chemical discovery [ 17 ] and bioinformatics workflows [ 18 ] to equation discovery [ 19 ] . The integration of these components points to an emerging research discipline, where scientific reasoning and empirical validation converge in fully autonomous frameworks. Since 2024, the research community has seen an exponential rise in literature addressing AI-based scientific autonomy. Comprehensive surveys such as [ 4 ] , [ 5 ] , and [ 20 ] have highlighted this shift, while specialized frameworks such as The AI Scientist-v2 [ 6 ] and AI-Researcher [ 21 ] have demonstrated near-human performance in research ideation and experimental reasoning. Complementary efforts—e.g., Auto-Bench [ 22 ] , ResearchBench [ 23 ] , and IdeaBench [ 24 ] —have established benchmarks to measure the novelty, causality, executability, and reproducibility (NCER) of AI-driven discoveries. Despite this progress, existing studies remain fragmented. Most works either focus on specific domains (e.g., chemistry, biology, physics) or individual capabilities (e.g., hypothesis generation [ 25 , 26 ] , literature synthesis [ 27 , 28 ] ) rather than holistic frameworks. No prior survey has yet offered a unified taxonomy linking scientific tasks, AI capabilities, agentic systems, and evaluation protocols. This survey therefore aims to synthesize these disparate threads and establish a coherent foundation for the field. This survey focuses on research between 2022 and 2025 that enables autonomous or near-autonomous execution of the scientific method. To ensure conceptual clarity and structural coherence, we adopt the comprehensive architectural landscape illustrated in Figure 1 as the central organizing principle for our analysis. This structure is defined by two primary axes. The horizontal axis delineates the six sequential methodological stages of the scientific workflow: (1) Literature Review focuses on extracting, structuring, and reasoning over scientific corpora to establish prior knowledge foundations [ 27 ] ; (2) Idea Generation addresses hypothesis formation and creative scientific reasoning [ 25 , 26 ] ; (3) Experimental Preparation encompasses data selection, variable definition, simulation setup, and statistical initialization [ 29 , 30 ] ; (4) Experimental Execution integrates protocol orchestration, robotic control, feedback-based iteration, and tool-use reasoning [ 12 , 11 , 31 ] ; (5) Scientific Writing involves multi-modal evidence organization, figure and table generation, and result articulation [ 27 , 32 ] ; and (6) Paper Generation targets the synthesis of publishable, verifiable manuscripts that combine reasoning, visualization, and scholarly consistency [ 21 , 33 ] . The vertical axis defines four distinct layers of abstraction in a top-down hierarchy, flowing from high-level Application Domains , through concrete Scientific Tasks & Products and enabling System Architectures & Methods , down to the foundational Models & Capabilities . This 4x6 matrix provides a unified map for situating any given work by cross-referencing its methodological focus with its layer of contribution. Complementing this matrix, the figure also includes a timeline at the bottom that summarizes the field’s three-phase historical evolution, providing a chronological perspective on the progression from foundational modules to fully integrated systems. Figure 1: The Architectural Landscape of the Survey of AI Scientist for Automatic Research. The main 4x6 matrix maps the six methodological stages of the scientific workflow (horizontal axis) against four top-down layers of abstraction, from Applications to Models (vertical axis). The panel at the bottom illustrates the field’s three-phase historical evolution, categorizing representative works to provide a chronological perspective on the development of AI Scientist systems. 1.1 Contributions This paper represents the first comprehensive survey on AI