Knowing What to Solve Before How: Preplan Empowered LLM Mathematical Reasoning
Shaojie Wang, Liang Zhang {shaojiewang, liangzhang}@hkustgz.edu.cn · 2026
Read Knowing What to Solve Before How: Preplan Empowered LLM Mathematical Reasoning by Shaojie Wang, Liang Zhang {shaojiewang, liangzhang}@hkustgz.edu.cn (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30245.txt.
Introduction
Shaojie Wang and Liang Zhang propose PPC, a preplan method for mathematical reasoning with language models. Plan-based methods plan before execution but leave what to solve, problem type, tools and pitfalls implicit. PPC adds an explicit problem-understanding stage, the preplan, before plan and chain-of-thought. A pipeline with a spoiler-score detector builds clean preplan supervision by filtering leakage, and a reward enforces that plans follow from preplans. Across four backbones and five maths benchmarks, PPC tops 39 of 40 metrics with no extra token overhead.
Catalog record
| CREATOR | Shaojie Wang, Liang Zhang {shaojiewang, liangzhang}@hkustgz.edu.cn |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56207 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30245
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Knowing What to Solve Before How: Preplan Empowered LLM Mathematical Reasoning Shaojie Wang, Liang Zhang {shaojiewang, liangzhang}@hkustgz.edu.cn Abstract Current plan-based reasoning methods improve large language models (LLMs) by inserting a planning stage before execution, giving rise to the question → \rightarrow plan → \rightarrow cot paradigm. While effective, a closer examination reveals an inherent paradigm-level gap: both the planning and its execution stages decide how to solve a problem, while the prior question of what to solve ; recognizing the problem type, the applicable tools, and the foreseeable pitfalls; remains entirely implicit. To bridge this gap, we propose PPC ( P replan- P lan- C oT), a framework that introduces an explicit problem-understanding stage, the preplan , yielding a new question → \rightarrow preplan → \rightarrow plan → \rightarrow cot paradigm. Realizing this paradigm requires safeguarding the conceptual integrity of preplan at both ends. Specifically, we design a three-stage synthesis pipeline with a spoiler-score detector that filters out leakage and spoiler failures to build clean preplan supervision, and a composite GRPO reward enforces that the generated plan genuinely follows from the preplan. Experiments across four backbones and five mathematical reasoning benchmarks show that PPC achieves the best results on 39 of 40 metrics, improving maj@16 and pass@16 by +2.23 and +3.06 over the strongest baseline without introducing additional inference token overhead. 1 Introduction Large language models (LLMs) have made remarkable progress on mathematical reasoning tasks, driven by the Chain-of-Thought (CoT) paradigm ( 22 ; 14 ) . Under this question \rightarrow cot paradigm, the model produces, in a single forward pass, a long sequence that interleaves intermediate reasoning steps with the final answer. Combined with supervised fine-tuning (SFT) on CoT trajectories ( 27 ) and reinforcement learning (RL) from verifiable rewards ( 9 ) , this paradigm has achieved strong results across a wide range of mathematical benchmarks ( 1 ) . As problems grow more complex, however, single-pass CoT reveals a structural limitation: operating as an autoregressive, token-level process, it confines reasoning to step-level execution and lacks higher-level organization, yielding redundant or incoherent trajectories. Recent work addresses this issue by inserting an intermediate planning stage, giving rise to the question \rightarrow plan \rightarrow cot paradigm: Plan-Tuning ( 18 ) distills planning trajectories from large models and fine-tunes smaller LLMs on (question, plan, solution) triples, while PTA-GRPO ( 4 ) introduces plan-level guidance rewards during reinforcement learning. Their shared insight is that an explicit plan-level layer above step-level execution supplies the global organization that single-pass CoT lacks. However, a closer examination of the question \rightarrow plan \rightarrow cot paradigm reveals that its two stages, planning and execution, differ in granularity but share the same underlying role: both decide how to solve the problem—the plan organizes the solution, and the execution carries it out. What neither stage addresses is the prior question of what to solve : such as recognizing what type of problem it is, which tools or concepts may apply, which boundary conditions matter, and which pitfalls to anticipate. For example, given a problem 12x^{2}-xy-6y^{2}=0 , recognizing it as a homogeneous quadratic immediately signals the model to prioritize factorization over the more cumbersome discriminant method, while also indicating that each linear factor produces a family of solutions. Consequently, the subsequent plan can follow these hints and count solutions correctly. Existing methods implicitly assume that such understanding emerges for free during plan generation, leaving a paradigm-level gap : how to solve is modeled explicitly, whereas what to solve remains implicit. We refer to this missing stage as the preplan : an explicit problem-understanding stage that precedes planning. Figure 1: Number of what-to-solve errors on MATH-500 across four backbones. Each wrong answer (under greedy decoding) is attributed to its root cause by an LLM judge, here we use DeepSeek-V4. Figure 1 illustrates the cost of this paradigm-level gap. We diagnose the errors made by two representative question \rightarrow plan \rightarrow cot methods on MATH-500 ( 16 ) , using an LLM judge to attribute each wrong answer to its root cause (see Appendix A for more details). Across four backbones, a large fraction of their errors stem not from calculation, but from a failure to understand what to solve . This exposes the cost of leaving problem understanding implicit and motivates introducing it as an explicit stage prior to planning. While conceptually intuitive, bridging this gap by directly introducing a problem-understanding stage faces two concrete challenges. Challenge 1 (data construction). No existing reasoning dataset provides supervision for such a preplan stage, and directly prompting a strong LLM to generate it tends to fail in two ways. The output either rehearses the forthcoming plan ( leakage failure ), or quietly carries out intermediate computation under the guise of analysis ( spoiler failure ). Both collapse the stage back into how to solve , defeating its purpose. Challenge 2 (training-time adherence). Even given clean supervision, a model trained with standard outcome rewards may learn to emit a superficially well-formed analysis while ignoring it during plan generation, capturing the mere form of problem understanding without its practical utility. A successful framework must therefore enforce that the downstream plan genuinely follows from the preceding preplan. Figure 2: An example comparing the two paradigms on the same problem. Top : a question \rightarrow plan \rightarrow cot solver commits to the discriminant route and undercounts ( 84 ). Bottom : a preceding preplan recognizes the homogeneous form, chooses factoring over the fragile discriminant route, and notes that each factor is a whole family of lattice points; the plan inherits this and the count is correct ( 117 ). Full trace in Appendix B . To address these challenges, we propose PPC ( P replan- P lan- C oT), a framework that explicitly introduces a problem-understanding stage, the preplan , into both data construction and reinforcement learning, giving rise to the new question \rightarrow preplan \rightarrow plan \rightarrow cot paradigm. A preplan is a comprehensive analysis about the problem that identifies the problem type, surveys relevant tools and concepts, flags the boundary conditions that matter, and anticipates pitfalls—it settles what to solve and leaves how to solve to the subsequent planning and execution stages. To address Challenge 1, we design a three-stage synthesis pipeline guarded by a spoiler-score detector that filters out leakage and spoiler failures, yielding a clean reasoning dataset with explicit preplan supervision. For Challenge 2, we extend GRPO with a composite reward that jointly optimizes final-answer correctness and plan-preplan alignment , while enforcing structural compliance across the three stages and penalizing preplan style degradation through the same spoiler score. Figure 2 makes this new paradigm concrete: on the same problem, a question \rightarrow plan \rightarrow cot solver commits to a fragile route without analyzing what the problem requires, whereas an explicit preplan first recognizes the structure and selects a reliable route, guiding the subsequent plan toward the correct solution. This mirrors the aggregate trend in Figure 1 . Our main contributions are as follows: • Conceptually: We identify and formalize a paradigm-level gap in existing plan-based reasoning: current methods model how to solve explicitly but leave what to solve implicit. To bridge it, we propose the question \rightarrow preplan \rightarrow plan \rightarrow cot paradigm for