STAR-PólyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervision
Jiaao Wu, Xian Zhang, Hanzhang Liu, Sophia Zhang, Fan Yang, Yinpeng Dong, [0.6ex] Tsinghua University · 2026
Read STAR-PólyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervision by Jiaao Wu, Xian Zhang, Hanzhang Liu, Sophia Zhang, Fan Yang, Yinpeng Dong, [0.6ex] Tsinghua University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19338.txt.
Introduction
Jiaao Wu and colleagues build STAR-PólyaMath, a multi-agent system for long math reasoning that fights hallucination buildup and memory loss. Its orchestrator runs challenge, step, and replan loops, while a persistent Meta-Strategist keeps memory across attempts and issues guidance or mandatory orders. That supervision lets the system escape dead loops instead of stagnating or leaning too hard on tools. It tops eight elite contest benchmarks, with perfect scores on several and a wide margin over the strongest baseline on one flagship set.
Catalog record
| CREATOR | Jiaao Wu, Xian Zhang, Hanzhang Liu, Sophia Zhang, Fan Yang, Yinpeng Dong, [0.6ex] Tsinghua University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 80224 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.19338
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
STAR-PólyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervision Jiaao Wu, Xian Zhang, Hanzhang Liu, Sophia Zhang, Fan Yang, Yinpeng Dong, [0.6ex] Tsinghua University Abstract Frontier AI models and multi-agent systems have led to significant improvements in mathematical reasoning. However, for problems requiring extended, long-horizon reasoning, existing systems continue to suffer from fundamental reliability issues: hallucination accumulation, memory fragmentation, and imbalanced reasoning-tool trade-offs. In this paper, we introduce STAR-PólyaMath , a multi-agent framework that systematically addresses these challenges through meta-level supervision and structured Reasoner-Verifier interaction. STAR-PólyaMath is structured as an orchestrated state machine with nested challenge-step-replan loops, governed by a reasoning-free Python orchestrator that separates control from inference and bounds error propagation through trace-back and re-planning. Our key innovation is a persistent Meta-Strategist that maintains cross-attempt memory and exercises meta-level control by issuing high-level strategic guidance or mandatory directives, so the system can escape unproductive loops rather than stagnate or over-rely on tools. STAR-PólyaMath achieves state-of-the-art results on all eight top-tier competition benchmarks: AIME 2025-2026, MathArena Apex Shortlist, MathArena Apex 2025, Putnam 2025, IMO 2025, HMMT February 2026, and USAMO 2026. It obtains perfect scores on AIMEs, Putnam, and HMMT, and shows its largest margin on Apex 2025, scoring 93.75% compared with 80.21% by the strongest baseline GPT-5.5. Ablation studies show that the gains arise from the framework’s orchestration rather than from model-level diversity since removing key components or substituting in mixed backbones consistently weakens performance. Code is available at https://github.com/Julius-Woo/STAR-PolyaMath . 1 Introduction Large Language Models (LLMs) now perform strongly on competition mathematics, with frontier systems reaching near-perfect scores on Olympiad-style benchmarks and delivering strong results on the Putnam and FrontierMath [ 22 , 11 , 6 , 10 ] . Progress has come from two complementary directions: natural-language reasoning strengthened by chain-of-thought prompting and reinforcement learning with verifiable rewards [ 33 , 4 ] , and tool-augmented reasoning via theorem provers or executable code [ 3 , 15 , 2 , 12 , 9 ] . Nevertheless, long-horizon problems remain challenging because free-form reasoning is difficult to verify, while tool use often incurs substantial computational and temporal costs. A central limitation lies in the difficulty of reliable self-correction: LLMs often fail to revise flawed reasoning without external feedback, and explicit self-correction can even degrade performance [ 13 ] . This limitation has motivated multi-agent frameworks that decompose reasoning into specialized roles, typically pairing a solution generator with a verifier that provides critique signals [ 17 ] . Such verification-centered workflows, including training-free verify-and-refine pipelines [ 14 ] and multi-agent debate [ 16 ] , have demonstrated strong performance on competition-level mathematics. Related agentic systems further incorporate tool use [ 35 ] , enabling code execution or formal verification during problem solving. Collectively, recent training-free and training-based agentic frameworks [ 29 , 2 , 27 ] , together with frontier proprietary models [ 22 , 11 ] , suggest that multi-agent systems have become a leading paradigm for complex mathematical reasoning. Despite these advances, existing systems continue to exhibit three recurring failure modes: • Hallucination accumulation. Errors in intermediate reasoning propagate across long solution trajectories, as models tend to generate confident but incorrect arguments. Although debate [ 16 ] and self-verification [ 26 ] can mitigate this effect, reliably discriminating superficially plausible reasoning from ultimately invalid derivations remains difficult [ 20 ] . • Memory fragmentation. Difficult problems often require repeated backtracking across multiple unsuccessful lines of attack, yet most agentic systems either retain excessive context or fail to preserve salient information about prior attempts. Although certain formal systems address this through lemma caching and recursive decomposition [ 2 , 29 ] , these solutions are specialized for formal verification and do not generalize to open-ended mathematical reasoning. • Imbalanced reasoning-tool trade-offs. Although code execution is reliable, excessive reliance on brute-force search can obscure mathematical structure and lead to intractable exploration. Prior work shows that models trained on tool-use trajectories develop a systematic bias toward code [ 31 ] . Existing remedies typically require additional training or ensemble overhead [ 27 , 7 ] . In practice, agents often lack metacognition , the ability to step back and revise their strategy, leading to inefficient computation and failures on abstract problems. Frontier agentic AI models have already possessed the knowledge and capacity to solve long-horizon mathematical competition problems. We argue that the missing ingredient is persistent meta-level supervision . In human problem-solving, a strong supervisor does not carry out every technical step, but guides at a meta level: selecting promising proof strategies, tracking failed approaches, and intervening when progress stalls. We instantiate this role as a persistent Meta-Strategist that retains global oversight throughout the entire problem-solving process. It maintains strategic memory across attempts and issues meta-strategies : decisions about the problem-solving strategy, formed as either high-level guidance grounded in domain knowledge or mandatory directives when the agents enter unproductive loops, such as repeatedly generating code instead of actively reasoning. Based on this design, we introduce STAR-PólyaMath 1 1 1 The name pays homage to George Pólya’s How to Solve It [ 24 ] , which decomposes problem solving into understanding the problem , devising a plan , carrying out the plan , and looking back , and emphasizes heuristics such as working on analogous or auxiliary problems and revising the plan when it stops making progress. Our exploration , planning , step-wise execution with verification , and re-plan phases instantiate the first three; the persistent Meta-Strategist enacts the “look back” stage by examining the trajectory across attempts and switching to an auxiliary plan when the current one stalls. , an agentic framework with three LLM roles: a Reasoner , a Verifier , and a persistent Meta-Strategist , all coordinated by a reasoning-free Python orchestrator, as illustrated in Figure 1 . The orchestrator controls execution flow: it advances a problem through an explicit state machine with nested challenge-step-replan loops, dispatching the Reasoner and Verifier through structured bidirectional debate loops, while the Meta-Strategist supervises the entire trajectory and intervenes through strategic guidance or mandatory directives. Empirically, this combination yields consistent gains across both final-answer and proof-based benchmarks: STAR-PólyaMath achieves the best reported scores across AIME 2025, MathArena Apex Shortlist, MathArena Apex 2025, Putnam 2025, IMO 2025, AIME 2026, HMMT February 2026, and USAMO 2026, with its largest margin on MathArena Apex 2025 (93.75 vs. 80.21 by the strongest baseline GPT-5.5). We further conduct systematic ablation studies to demonstrate that each component of the framework contributes meaningfully to the overall performance, and that swapping the standard shared backbone for mixed-model configurations does not improve results, indicating the gains from the framework’s orchestration rather than from model selection. Figure 1: STAR-PólyaMath system workflow. STAR-PólyaMath advances each problem with four phases: exploration , planning and decomposition , step-wise execution with challenge loops , and solution generation . A Python orchestrator dispatches the LLM agents and decides advance, trace-back, re-plan, and abort transitions. The Reasoner probes the problem, proposes a step-wise plan, and executes each step with hierarchical verification tags ( [verified] / [easy-verify] / [hard-verify] ). The Verifier reviews via logic and goal gates, and emits Accept , Challenge , Trace-Back , or Propose-Replan ; persistent Reasoner-Verifier debate resolves disagreements within a step, while trace-back and re-planning