One Reflection Is Not Enough: Self-Correcting Autonomous Research via Multi-Hypothesis Failure Attribution
Jie Ma, Binfei Chu, Jie Gao, Jinlu Zhang, Yiwei Ma, Yi Tan, Jiayi Ji, Xiaoshuai Sun, Rongrong Ji · 2026
Read One Reflection Is Not Enough: Self-Correcting Autonomous Research via Multi-Hypothesis Failure Attribution by Jie Ma, Binfei Chu, Jie Gao, Jinlu Zhang, Yiwei Ma, Yi Tan, Jiayi Ji, Xiaoshuai Sun, Rongrong Ji (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-31478.txt.
Introduction
Ma and eight colleagues present SAGE, a self-correcting research agent built to recover well when experiments fail. Today's autonomous agents draft hypotheses, code, and papers, yet a failed run usually triggers one free-form reflection. That single critique crushes rich logs into a paragraph, causing either timid local tweaks or hard pivots that waste context.
SAGE instead runs multi-hypothesis failure attribution. It drafts several evidence-grounded explanations for a failure, scores their severity apart, and routes the verified cause to the right level: hypothesis, design, or implementation. A grounded reporting rule pins drafted results to measured values and cuts invented numbers. On a twelve-topic benchmark, outputs bearing real metrics jump from 42 to 92 percent against a reflection baseline.
Catalog record
| CREATOR | Jie Ma, Binfei Chu, Jie Gao, Jinlu Zhang, Yiwei Ma, Yi Tan, Jiayi Ji, Xiaoshuai Sun, Rongrong Ji |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.31478
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
One Reflection Is Not Enough: Self-Correcting Autonomous Research via Multi-Hypothesis Failure Attribution Jie Ma, Binfei Chu, Jie Gao, Jinlu Zhang, Yiwei Ma, Yi Tan, Jiayi Ji, Xiaoshuai Sun, Rongrong Ji Abstract Autonomous research agents can now draft hypotheses, write code, run experiments, and produce papers, but they remain brittle when experiments fail. Under the prevailing paradigm, failure recovery is usually delegated to a single free-form reflection: a rich trajectory of metrics, logs, and design choices is compressed into one verbal critique, which often leads either to localized trial-and-error or to hard pivots that discard useful context. We propose SAGE , a Self-correcting, Autonomous, Grounded Experimenter , to tackle this failure-recovery bottleneck. Its core mechanism, Multi-Hypothesis Failure Attribution (MHFA) , treats recovery as a structured causal diagnosis. By analyzing dynamic trajectory features, MHFA systematically generates multiple evidence-grounded explanations for a failure, independently evaluates their severity, and deterministically routes the verified root cause to the correct intervention level (hypothesis, experimental design, or implementation). To guarantee scientific honesty, SAGE further employs a grounded reporting mechanism that explicitly constrains drafted results to actual measured values, redacting hallucinated numbers. On a 12-topic, 5-domain benchmark, SAGE increases metrics-bearing outputs from 42% to 92% over a reflection baseline, improves artifact quality from 5.00 to 6.75/10, and blindly outscores AI-Scientist-v2 (52.0 vs. 48.2), with gains concentrated in code development and execution. While fully autonomous scientific writing and generating conference-ready papers remain notoriously difficult open problems for the entire field, SAGE successfully produces significantly more reliable and higher-quality scientific artifacts. Ultimately, by coupling structured recovery with explicit grounding constraints, SAGE significantly outperforms monolithic reflection paradigms, establishing a highly trustworthy foundation for future autonomous research. † † affiliation: Xiamen University † † affiliation: Hello Inc. † † affiliation: Xiaohongshu Inc. † † date: August 10, 2026 † † correspondence: [email protected] , [email protected] † † Code: https://github.com/JieMaMagic/SAGE.git 1 Introduction Figure 1 : The Failure Recovery Bottleneck. (a) Monolithic Reflection: Existing agents compress failure logs into a single guess, trapping them in blind, localized trial-and-error. (b) SAGE (Ours): SAGE leverages failure trajectories to generate and rank multiple causal hypotheses. A deterministic router maps the highest-scoring cause to the correct abstraction level (e.g., Design instead of Code). Through structured diagnosis and iterative self-correction, SAGE successfully escapes local optima to rescue deeply flawed experiments. Autonomous research agents are moving beyond tool-use demonstrations toward end-to-end scientific workflows: they can formulate hypotheses, implement experiments, analyze results, and draft papers with limited human intervention ( Lu et al. 2024 ; Jiang et al. 2025 ; Chan et al. 2025 ; InternScience Team 2026 ; Tang et al. 2025 ; Novikov et al. 2025 ; Yang et al. 2025 ; Weng et al. 2025 ) . This progress makes an old scientific problem newly central for agents: experiments often fail. A model may plateau, a metric may be insensitive, a protocol may test the wrong claim, or the code may silently emit no usable measurement. In such cases, autonomy depends not only on executing a planned pipeline, but on navigating failure : diagnosing the level at which the run broke down and redirecting the research trajectory accordingly ( Trehan and Chopra 2026 ; Zhang et al. 2025 ; Yang et al. 2023 ; Liu et al. 2024 ; Wang et al. 2026 ; Liu et al. 2026 ; Team et al. 2025 ; Huang et al. 2025 ) . Existing agents usually recover through monolithic reflection inherited from Reflexion ( Shinn et al. 2023 ; Yao et al. 2023b ) and Self-Refine ( Madaan et al. 2023 ; Yang et al. 2024b ; Wang et al. 2025a ; Wang et al. 2025b ) . This is effective for many self-contained coding tasks, but it is a poor fit for open-ended research because the same symptom can have causes at different abstraction levels. Under a single-attribution, single-action paradigm, agents tend to fall into two failure modes (as shown in fig. 1 (a)). They perform localized trial-and-error, such as repeatedly tuning hyperparameters of a fundamentally flawed design ( Gao et al. 2026 ; Nam et al. 2025 ; Weng et al. 2025 ; Liu et al. 2026 ) , or they make a hard pivot that resets the pipeline and discards accumulated evidence ( Trehan and Chopra 2026 ; Zhou et al. 2024b ; Yang et al. 2023 ; Liu et al. 2024 ) . The underlying difficulty is structural credit assignment : a flat learning curve, degenerate metric, or runtime error can arise from a weak hypothesis, a misaligned evaluation design, or an implementation defect ( Wang et al. 2026 ; Shao et al. 2024 ; Skarlinski et al. 2024 ; Asai et al. 2026 ) . An experienced researcher responds by entertaining competing explanations and seeking discriminating evidence, a process formalized as strong inference ( Platt 1964 ) . Monolithic reflection instead compresses this multi-level causal ambiguity into a single verbal summary. The agent may then settle on the most salient, easily editable symptom while missing a deeper methodological problem ( Trehan and Chopra 2026 ; Li et al. 2025 ; Qiao et al. 2025 ; Zhang et al. 2025 ) . We propose Multi-Hypothesis Failure Attribution (MHFA) , a recovery framework that operationalizes the method of multiple working hypotheses ( Chamberlin 1965 ; Platt 1964 ) for autonomous research agents. As illustrated in fig. 1 (b), MHFA structures recovery as a three-stage process of divergent generation, convergent scoring, and deterministic routing. A divergent generator first synthesizes distinct, evidence-grounded explanations of the failure trajectory. An independent critic then scores the severity and evidential support of each explanation. Finally, rather than letting the model hallucinate a fix, a deterministic routing rule maps the verified structural cause to a hierarchy-aware intervention, such as method refinement, protocol redesign, or hypothesis pivoting. Low-level zero-metric execution failures are handled by a separate explicit repair path before structural attribution. MHFA is orthogonal to multi-path solution search, such as Tree-of-Thoughts ( Yao et al. 2023a ) or multi-agent debate ( Du et al. 2024 ; Yang et al. 2026a ) . Those methods diversify candidate actions or opinions, whereas MHFA diversifies causal explanations of an observed failure and routes recovery at the appropriate abstraction level. We realize MHFA in SAGE , an autonomous research system built on a multi-stage pipeline. To support diagnosis, a TrajPivot component supplies trajectory features for attribution. To support faithful reporting, a two-stage numeric grounding mechanism, consisting of a proactive manifest and a strict sanitizer, checks table values against measured result registries and redacts unverified cells. This mechanism is deliberately narrower than full paper verification. It constrains numeric tables, but does not by itself guarantee that prose-level method descriptions, dataset names, libraries, or statistical tests match the executed code. On a twelve-topic benchmark spanning five domains (machine learning, statistics, quantum computing, biology, and high-energy physics), SAGE improves metrics-bearing recovery from 42% (5/12 topics) under a reflection baseline to 92% (11/12 topics). Under a blind, uniform evaluation of complete artifacts, SAGE scores 52.0 out of 100, compared with 48.2 for AI-Scientist-v2 and 24.8 for the host-pipeline reflection baseline, with gains heavily concentrated in code development and execution. Crucially, while generating fully conference-ready papers remains a notoriously difficult open challenge for the entire