MA-LoT: Model-Collaboration Lean-based Long Chain-of-Thought Reasoning enhances Formal Theorem Proving
Ruida Wang, Rui Pan, Yuxin Li, Jipeng Zhang, Yizhen Jia, Shizhe Diao, Renjie Pi, Junjie Hu, Tong Zhang · 2025
Read MA-LoT: Model-Collaboration Lean-based Long Chain-of-Thought Reasoning enhances Formal Theorem Proving by Ruida Wang, Rui Pan, Yuxin Li, Jipeng Zhang, Yizhen Jia, Shizhe Diao, Renjie Pi, Junjie Hu, Tong Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03205.txt.
Introduction
Ruida Wang and co-authors split the work of proving math theorems between two model roles in this 2025 paper. The setting is Lean, a language where proofs can be checked by computer. Single models either write a whole proof at once or search step by step, and each style has weak spots.
Their framework, MA-LoT, lets one role draft full proofs in long chains of thought while another studies the checker's errors and guides fixes. A training pipeline teaches this long-form thinking without hand-labeled data. On a standard test set, the system proved about sixty-one percent of theorems. That score beat strong single-model rivals by wide margins.
Catalog record
| CREATOR | Ruida Wang, Rui Pan, Yuxin Li, Jipeng Zhang, Yizhen Jia, Shizhe Diao, Renjie Pi, Junjie Hu, Tong Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-03205
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MA-LoT: Model-Collaboration Lean-based Long Chain-of-Thought Reasoning enhances Formal Theorem Proving Ruida Wang, Rui Pan, Yuxin Li, Jipeng Zhang, Yizhen Jia, Shizhe Diao, Renjie Pi, Junjie Hu, Tong Zhang Abstract Solving mathematical problems using computer-verifiable languages like Lean has significantly impacted the mathematical and computer science communities. State-of-the-art methods utilize a single Large Language Model (LLM) to generate complete proof or perform tree search, but they fail to balance these tasks. We propose MA-LoT : M odel-Coll A boration L ean-based Long Chain- o f- T hought , a comprehensive framework for Lean4 theorem proving to solve this issue. It separates the cognition tasks of general NL for whole-proof generation and error analysis for proof correction using the model-collaboration method. We achieve this by structured interaction of the LLM and Lean4 verifier in Long CoT. To implement the framework, we propose the novel LoT-Transfer Learning training-inference pipeline, which enables the Long CoT thinking capability to LLMs without special data annotation. Extensive experiment shows that our framework achieves a 61.07% accuracy rate on the Lean4 version of the MiniF2F-Test dataset, largely outperforming DeepSeek-V3 (33.61%), single-model tree search (InternLM-Step-Prover, 50.70%), and whole-proof generation (Godel-Prover, 55.33%) baselines. Furthermore, our findings highlight the potential of combining Long CoT with formal verification for a more insightful generation in a broader perspective. † † affiliationnotice: * First Authors 1 Introduction Formal reasoning is a cornerstone of human intelligence and a key objective in machine learning ( Newell & Simon, 1956 ) , often evaluated through rigorous mathematical derivations ( Yang et al., 2024a ) . With the rise of Large Language Models (LLMs), Chain-of-Thought (CoT) prompting has emerged to formalize reasoning by generating intermediate steps. This approach improves interpretability and enhances reasoning performance ( Wei et al., 2022 ) . Figure 1: Two main directions of FL theorem proving using LLMs: Single model tree-search and whole-proof generation with their advantages/disadvantages. However, the ambiguity of Natural Language (NL) complicates verifying intermediate steps, particularly in advanced mathematics, where there is no answer to check but theorems to prove. This challenge is exacerbated by the growing complexity of modern mathematics, which makes proof verification highly demanding and can lead to errors, as seen in the prolonged validation of Fermat’s Last Theorem ( Wang et al., 2024 ) . Researchers propose grounding reasoning in rigorous first-order logic to address this, enabling automated verification via Formal Language (FL) verifiers. This framework ensures rigor and has led to the development of tools like Lean ( De Moura et al., 2015 ; Moura & Ullrich, 2021 ) , Isabelle ( Paulson, 1994 ) , and HOL Light ( Harrison, 2009 ) for verifiable theorem proving. Figure 2: MA-LoT Framework: (a) Model-collaboration Lean4 theorem proving framework: The LoT-Solver model functions as the prover to generate initial Lean4 proofs with emergent NL planning for Lean proof in Long CoT (orange block); then it acts as corrector to analyze error from Lean executor in Long CoT to output a refined proof. (b) LoT-Transfer Learning (TL): The novel training-inference pipeline enables formal reasoning ability to emerge in Long CoT (L-CoT) without the need for specifically annotated data. This is achieved by adjusting the system prompt to control the on/off of L-CoT in training and inference. (c) Training procedure of LoT-Solver : We use normal SFT to train general NL L-CoT, use LoT-TL to train on the Lean SFT, and correction data to make Lean L-CoT an emergent capability in LLM. However, writing mathematical proofs in FL requires significant expertise and effort, as most proofs involve extensive repetition and application of low-resource functions ( Jiang et al., 2022 ) . With the rapid progress of LLMs, research has explored LLMs’ application in FL reasoning to automate theorem proving ( Polu & Sutskever, 2020 ; Polu et al., 2022 ; Jiang et al., 2021 ; Jiang et al., 2022 ; Yang et al., 2024b ; Xin et al., 2024b ; Wang et al., 2024 ; Wu et al., 2024a ; Kumarappan et al., 2024 ; Lin et al., 2024 ) . Prior research follows two main approaches, namely, tree-search ( Jiang et al., 2021 ; Jiang et al., 2022 ; Lin et al., 2024 ; Xin et al., 2024b ; Wang et al., 2024 ) and whole-proof generation ( Polu & Sutskever, 2020 ; Polu et al., 2022 ; Yang et al., 2024b ; Wu et al., 2024a ; Kumarappan et al., 2024 ) . The summary of dis/advantages of these two methods can be found in Figure 1 . Tree-search methods train an LLM to iteratively generate proof steps by predicting the next tactic based on the current proof state. This is achieved through either direct code writing ( Polu & Sutskever, 2020 ; Polu et al., 2022 ; Xin et al., 2024b ; Wu et al., 2024a ; Lin et al., 2024 ) or retrieval-based techniques ( Yang et al., 2024b ; Kumarappan et al., 2024 ) . Tree-search methods apply an FL executor to verify after each generation step and can discover some non-trivial proofs. However, as proof complexity increases, tree-search methods become computationally expensive and lack high-level NL planning to control the overall structure of the proof. The lack of overall planning causes the tree-search method to be unable to find some structured proof that requires high-level NL planning to answer the question. In contrast, whole-proof generation treats theorem proving like the code generation problem, where LLMs generate the entire proof in a single attempt using either supervised training ( Wang et al., 2024 ; Xin et al., 2024b ) or prompt engineering ( Jiang et al., 2021 ; Jiang et al., 2022 ) . This approach leverages LLMs’ NL reasoning and high-level planning capabilities with predictable computation costs, but it lacks intermediate feedback from FL executors. As a result, the generated proofs often lack post-hoc analysis of errors and tend to perform badly on tedious questions that require non-trivial or tedious tricks. In summary, existing single-model approaches struggle to balance the NL reasoning with the FL verifiability, motivating the need for a more comprehensive framework. To address the above challenges in Lean4 theorem proving, we introduce MA-LoT : M odel-Coll A boration Lean-based Long Chain- o f- T hought , a comprehensive framework designed to coordinate multiple models for effective formal reasoning. As illustrated in Figure 2 (a), MA-LoT separates the cognitive process into two distinct tasks: high-level proof planning and writing, as well as fine-grained correction based on verifier feedback. This separation is enabled by a collaborative model architecture and the emergent reasoning capability of Long CoT, which was developed during training. The framework consists of two core components: a prover model, responsible for generating well-structured proofs, and a corrector model, which interprets feedback from the Lean4 verifier to refine the output. Both models are enhanced with Lean4 field-specific Long CoT capability, allowing them to reason more thoroughly before producing outputs. Moreover, we integrate Lean verification results into Long CoT to improve the system’s self-reflection and correction abilities. To implement the MA-LoT framework, we propose a novel training-inference pipeline called LoT-Transfer Learning (LoT-TL), which is used to train the LoT-Solver model, as shown in Figure 2 (b) and (c). This pipeline enables the emergence