Let’s Reason Formally: Natural-Formal Hybrid Reasoning Enhances LLM’s Math Capability
Ruida Wang, Yuxin Li, Yi R. (May) Fung, Tong Zhang · 2025
Read Let’s Reason Formally: Natural-Formal Hybrid Reasoning Enhances LLM’s Math Capability by Ruida Wang, Yuxin Li, Yi R. (May) Fung, Tong Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23703.txt.
Introduction
Ruida Wang and co-authors introduce, in a 2025 paper, a hybrid reasoning framework that teaches language models to solve math problems by mixing plain language with formal proof language. Each style has strengths: natural reasoning is flexible, formal reasoning is checkable. Pure reinforcement learning in either style struggles to give the model abilities it never had.
The gap is structural: the two styles format problems and arguments differently. Their alignment trick rewrites a question answering problem as an existence theorem in the formal language. A mixed input method then lets the formal reasoner handle both shapes of problem. Formal experts can coach the natural reasoner inside one end to end system. The aim is math capability that gains formal rigor without losing plain language fluency. For verified reasoning, a hybrid that can fall back on proof is a promising direction.
Catalog record
| CREATOR | Ruida Wang, Yuxin Li, Yi R. (May) Fung, Tong Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-23703
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Let’s Reason Formally: Natural-Formal Hybrid Reasoning Enhances LLM’s Math Capability Ruida Wang, Yuxin Li, Yi R. (May) Fung, Tong Zhang Abstract Enhancing the mathematical reasoning capabilities of LLMs has garnered significant attention in both the mathematical and computer science communities. Recent works have made substantial progress in both Natural Language (NL) reasoning and Formal Language (FL) reasoning by leveraging the potential of pure Reinforcement Learning (RL) methods on base models. However, RL approaches struggle to impart new capabilities not presented in the base model Yue et al. (2025) , highlighting the need to integrate more knowledge like FL into NL math reasoning effectively. Yet, this integration is challenging due to inherent disparities in problem structure and reasoning format between NL and FL Wang et al. (2024) . To address these challenges, we introduce NL-FL HybridReasoning (NFL-HR) , an end-to-end framework designed to incorporate the FL expert into NL math problem-solving. To bridge the NL and FL input format gap, we propose the NL-FL Problem Alignment method, which reformulates the Question-Answering (QA) problems in NL as existence theorems in FL. Subsequently, the Mixed Problem Input technique we provide enables the FL reasoner to handle both QA and existence problems concurrently. Lastly, we mitigate the NL and FL output format gap in reasoning through an LLM-based Answer Extraction mechanism. Comprehensive experiments demonstrate that the NFL-HR framework achieves 89.80% and 84.34% accuracy rates on the MATH-500 and the AMC benchmarks, surpassing the NL baseline by 4.60% and 4.82%, respectively. Notably, some problems resolved by our framework remain unsolved by the NL baseline model even under a larger number of trials. 1 Introduction The capability of performing rigorous mathematical reasoning has always been regarded as a cornerstone of human intelligence and a fundamental goal of machine learning systems Newell and Simon (1956) . Among these tasks, mathematical reasoning is considered crucial for evaluating the capabilities of Large Language Models (LLMs). Recently, both academia and industry have been actively working on two branches of LLM math reasoning, namely Natural Language (NL) reasoning and Formal Language (FL) reasoning. In the NL math reasoning, taking advantage of the vast NL data during pre-training, researchers have been continuously making progress in the field during the last few years. Many works tried to enhance LLMs’ Math capability from various perspective Hendrycks et al. (2021) ; LI et al. (2024) ; Rafailov et al. (2023) ; Wei et al. (2022) . Recent progress in pure Reinforcement Learning (RL) training on base models has notable success in solving IMO-level problems through reflection capability in Long Chain-of-Thought (CoT) Guo et al. (2025) . However, the latest works have shown that while RL methods fail to introduce novel capabilities beyond the base model Gandhi et al. (2025) . Consequently, integrating knowledge from other domains, such as FL reasoning, has emerged as a promising direction to enhance LLM’s mathematical reasoning abilities. Figure 1: NL-FL HybridReasoning (NFL-HR) framework: (a) NL-FL Problem Alignment: We first translate the QA-style NL problem into the NL existence problem using a general LLM, followed by converting the problem into an FL existence theorem through an autoformalizer. (b) FL Reasoner Problem Solving: We then apply the mixed problem input technique to ask the FL reasoner to concurrently address the QA problem in NL and the existence problem in FL within a unified Long CoT thinking process. (c) Answer Extraction: Finally, we use the LLM to extract the implicit NL answer from the FL prover’s Long CoT output. On the other end, FL reasoning leverages the inherent verifiability of formal systems like Lean De Moura et al. (2015) ; Moura and Ullrich (2021) , Coq Coq (1996) , and Isabelle Paulson (1994) . They provide a rigorous framework for defining solutions and verifying their correctness. This reliability facilitates large-scale and risk-free data generation Lin et al. (2025) ; Wang et al. (2025b) ; Xin et al. (2024b) ; Dong and Ma (2025) , which enables the use of synthetically generated data for stable RL/SFT training Wang et al. (2024) ; Xin et al. (2024a) ; Wu et al. (2024) . With the advancements in Long CoT reasoning models, pure RL methods have proven to be particularly effective for FL reasoners Ren et al. (2025) ; Wang et al. (2025a) . However, despite rapid progress in enhancing FL reasoning capabilities, most efforts remain confined to FL theorem-proving tasks, limiting the broader application of FL-derived knowledge to NL math problems. A substantial gap persists between NL and FL reasoning due to the differences in problem structure and reasoning format. FL tasks are typically structured as closed-ended theorems with fixed conditions and goals. Whereas NL problems are often Question-Answering (QA) style, as those in MATH-500 Lightman et al. (2023) . Furthermore, FL training frequently biases models’ final outputs toward FL code, reducing their effectiveness in directly addressing NL questions, which are often expressed in more concise and less structured formats. In summary, in the context of NL math reasoning requiring broader knowledge integration to extend LLM capabilities, it is a natural idea to integrate FL reasoning to enhance that. However, FL reasoning remains constrained by its rigid problem structure and reasoning format. Addressing these challenges collectively presents a promising research direction in leveraging FL to enhance NL math problem-solving. To solve the problems above, we propose NL-FL HybridReasoning (NFL-HR) , an end-to-end framework that augments LLMs’ NL math reasoning by enabling them to tackle problems that are otherwise difficult under a purely NL context. The framework overview is presented in Fig. 1 . The core methodology of our framework can be summarized into three stages that works synergistically together: 1. NL-FL Problem Alignment: We develop a method to establish a non-ambiguous alignment between the NL problem and FL problem. It is done by firstly converting QA problems into NL existence problems 1 1 1 The QA problems seek a specific answer while the existence problems ask for the proof of existence of the answer. using a general LLM, followed by formalizing the existence problem into FL through an autoformalizer. 2. FL Reasoner Solving: At this stage, we implement the Mixed Problem Input technique, allowing the FL reasoner to concurrently address both the FL existence problem and the QA problem in NL in its Long CoT thinking, thereby applying FL knowledge to solve NL tasks. 3. Answer extraction: The final stage involves extracting the implicit NL answer from the Long CoT output generated by the FL reasoner. This step effectively unifying the output format of FL-derived reasoning with NL question-answering. We summarize our contributions as follows: (1) We introduce NFL-HR , a comprehensive framework that effectively incorporates FL reasoning to address NL math problems. (2) The proposed NL-FL Problem Alignment and Answer Extraction methods relatively effectively reduce the disparity between NL and FL reasoning in both problem structure and reasoning format, broadening the capability of FL methods. (3) We conduct comprehensive experiments using the NFL-HR framework, achieving accuracy rates of 89.80% on the MATH-500 dataset and 84.34% on the AMC dataset, surpassing the NL baseline of Qwen3-8B by 4.60% and 4.82% , respectively. Notably, the problems successfully solved by our framework are hard for the NL reasoner even with a larger number of trials, highlighting the