The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning
Max Zimmer, Nico Pelleriti, Christophe Roux, Sebastian Pokutta · 2026
Read The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning by Max Zimmer, Nico Pelleriti, Christophe Roux, Sebastian Pokutta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-15914.txt.
Introduction
Zimmer and co-authors write a hands-on guide to AI-assisted research work. Many researchers still lack a clear map for daily AI use. The guide sorts AI integration into a five-level taxonomy. An open-source framework then turns CLI coding agents into research aides. Method rules, phrased as agent prompts, steer the aides. The setup runs sandboxed and fits any frontier model. One session ran over 20 hours across many nodes alone. The authors stress support for researchers, not replacement.
Catalog record
| CREATOR | Max Zimmer, Nico Pelleriti, Christophe Roux, Sebastian Pokutta |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85552 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.15914
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning Max Zimmer, Nico Pelleriti, Christophe Roux, Sebastian Pokutta Abstract AI tools and agents are reshaping how researchers work, from proving theorems to training neural networks. Yet for many, it remains unclear how these tools fit into everyday research practice. This paper is a practical guide to AI-assisted research in mathematics and machine learning : We discuss how researchers can use modern AI systems productively, where these systems help most, and what kinds of guardrails are needed to use them responsibly. It is organized into three parts: (I) a five-level taxonomy of AI integration, (II) an open-source framework that, through a set of methodological rules formulated as agent prompts, turns CLI coding agents (e.g., Claude Code, Codex CLI, OpenCode) into autonomous research assistants, and (III) case studies from deep learning and mathematics. The framework runs inside a sandboxed container, works with any frontier LLM through existing CLI agents, is simple enough to install and use within minutes, and scales from personal-laptop prototyping to multi-node, multi-GPU experimentation across compute clusters. In practice, our longest autonomous session ran for over 20 hours, dispatching independent experiments across multiple nodes without human intervention. We stress that our framework is not intended to replace the researcher in the loop, but to augment them. Our code is publicly available at github.com/ZIB-IOL/The-Agentic-Researcher . Figure 1: A command-line interface (CLI) agent during an autonomous research session: over 8 hours in, managing six parallel GPU training runs and three scheduled monitoring tasks. The same framework supports mathematical derivations, proofs, and verification alongside computational experiments. The agent is idle, consuming no tokens while waiting for a status check to complete. 1 Introduction In 2024, DeepMind’s AlphaProof ( 43 ) combined with AlphaGeometry ( 94 ) became the first AI system to achieve medal-level performance at the International Mathematical Olympiad (IMO), reaching silver-medal standard by solving four of the six competition problems through reinforcement learning and formal verification. AlphaEvolve ( 73 ) demonstrated that LLM-guided evolutionary search can discover new mathematical constructions, rediscovering best-known solutions across a broad collection of problems and improving on them in several cases ( 31 ) . Most recently, Aletheia ( 25 ) , an autonomous mathematical research agent, resolved several open problems originally posed by Erdős while operating with minimal human intervention. Aletheia also solved several open problems from First Proof ( 1 ) , a benchmark of previously unpublished research-level mathematics questions drawn from the authors’ own research process, within weeks of its release. These results are remarkable, and recent systems now address not only well-defined benchmarks but also genuine open mathematical problems. In parallel, the Machine Learning (ML) community has seen a surge in agentic experimentation: for instance, Karpathy’s autoresearch ( 49 ) demonstrated how agents can run automated ML experiment pipelines through iterative code modification, and such pipelines are becoming increasingly common. Most of the current literature, including the works discussed above, focuses on what AI systems can achieve . Much less attention has been given to the complementary practical question of how researchers should integrate such systems into everyday research. In practice, research rarely proceeds by pursuing a fixed objective from the outset: researchers must decide which questions to ask, which experiments to run, when to reformulate a conjecture, and how to respond to unexpected results. Supporting this kind of work requires workflows that accommodate shifting objectives, iterative experimentation, and sustained human guidance, yet how to build and use such workflows remains an open question. For most researchers, the challenge is not building a discovery pipeline from scratch but understanding which tools are available and how to use them effectively. A growing body of work has begun to map this landscape, including conceptual frameworks for human-AI co-creativity ( 35 ) , visions of the “augmented mathematician” ( 40 ) , formal-proof assistants ( 109 ; 90 ) , and numerous first-hand accounts of AI-assisted research ( 11 ; 20 ; 3 ; 44 ; 23 ; 83 ; 21 ; 86 ) . 7 make this point especially clearly: mathematicians should not merely react to AI but should take an active role in deploying and shaping it for their own purposes. Yet none of these works provides actionable, end-to-end guidance that a researcher could follow today. We hope to make some progress on these questions and aim to fill parts of that gap. The frameworks, approaches, and insights presented here have been developed over roughly the last one and a half years in the context of the MATH+ project Agentic AI in Mathematics 1 1 1 https://iol.zib.de/project/agentmath.html but apply beyond mathematics and have proven to be very powerful, e.g., in ML research. This also explains our choice of use cases in machine learning and mathematics. The four authors approached AI-assisted research from complementary directions: some built on existing CLI coding agents with either an experimental or a theoretical and proof-oriented focus, while others developed a custom multi-agent system from scratch. The insights gained from these diverse experiences form the basis of the unified framework we present here. Contributions. Our contributions are as follows. 1. A practical taxonomy ( Section 2 ). We identify five levels of AI integration into mathematical and ML research, ranging from full human control to high agent autonomy. 2. An open-source, sandboxed agentic research framework ( Section 3 ). We present a set of methodological rules, formulated as agent prompts, which we call commandments , together with a sandboxed container environment and reporting conventions that turn general-purpose CLI coding agents into autonomous research assistants. The commandments encode the norms of scientific practice and guide the agent throughout the research workflow. The framework is model- and harness-agnostic, supports any frontier LLM through existing CLI agents (such as Claude Code ( 6 ) , Codex CLI ( 74 ) , or OpenCode ( 5 ) ), and can be set up within minutes. 3. Case studies ( Section 4 ). We demonstrate the framework in action across diverse domains, including deep learning as well as pure and applied mathematics, illustrating both successes and failure modes. We provide screenshots of the agent’s reports as they were produced. We want to emphasize what this paper is not : we do not claim that AI replaces research creativity, insight, or the researcher. Rather, we demonstrate that specific parts of the research workflow can be significantly accelerated when a researcher directs an AI agent in a structured way. Unlike approaches that seemingly remove the human from the research process entirely ( 63 , cf., e.g.,) , our framework keeps the researcher as the principal investigator, who can now operate at greater scale and speed. We believe that mathematical research is not a fully automatable task, and we will not speculate on whether this will change in the future. What we do claim is that mathematicians and researchers in general should take an active role in this partial transformation of the field and, echoing 7 , should own the technology. The rest of this paper is organized as follows. Section 2 presents our taxonomy of integration levels. Section 3 describes the agentic research framework in detail, the core contribution of this