AutoGPS: Automated Geometry Problem Solving via Multimodal Formalization and Deductive Reasoning
Bowen Ping, Minnan Luo, Zhuohang Dang, Chenxi Wang, Chengyou Jia · 2025
Read AutoGPS: Automated Geometry Problem Solving via Multimodal Formalization and Deductive Reasoning by Bowen Ping, Minnan Luo, Zhuohang Dang, Chenxi Wang, Chengyou Jia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23381.txt.
Introduction
Bowen Ping and four co-authors built AutoGPS in twenty twenty-five, a system that solves geometry problems with readable, reliable proofs. Geometry demands both reading a diagram and reasoning rigorously; neural methods can be unreliable, symbolic ones brittle. AutoGPS pairs the two in a neuro-symbolic loop.
A multimodal formalizer translates the problem, diagram included, into a structured formal language, guided by feedback from the reasoner. The deductive reasoner then treats solving as expanding a hypergraph of facts, producing minimal step-by-step derivations a human can audit. On benchmark data sets it reached top performance. Human judges of the reasoning steps found ninety-nine percent stepwise logical coherence. The authors pitch the system as a model for trustworthy AI mathematics.
Catalog record
| CREATOR | Bowen Ping, Minnan Luo, Zhuohang Dang, Chenxi Wang, Chengyou Jia |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-23381
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AutoGPS: Automated Geometry Problem Solving via Multimodal Formalization and Deductive Reasoning Bowen Ping, Minnan Luo, Zhuohang Dang, Chenxi Wang, Chengyou Jia Abstract Geometry problem solving presents distinctive challenges in artificial intelligence, requiring exceptional multimodal comprehension and rigorous mathematical reasoning capabilities. Existing approaches typically fall into two categories: neural-based and symbolic-based methods, both of which exhibit limitations in reliability and interpretability. To address this challenge, we propose AutoGPS, a neuro-symbolic collaborative framework that solves geometry problems with concise, reliable, and human-interpretable reasoning processes. Specifically, AutoGPS employs a Multimodal Problem Formalizer (MPF) and a Deductive Symbolic Reasoner (DSR). The MPF utilizes neural cross-modal comprehension to translate geometry problems into structured formal language representations, with feedback from DSR collaboratively. The DSR takes the formalization as input and formulates geometry problem solving as a hypergraph expansion task, executing mathematically rigorous and reliable derivation to produce minimal and human-readable stepwise solutions. Extensive experimental evaluations demonstrate that AutoGPS achieves state-of-the-art performance on benchmark datasets. Furthermore, human stepwise-reasoning evaluation confirms AutoGPS’s impressive reliability and interpretability, with 99% stepwise logical coherence. The project homepage is at https://jayce-ping.github.io/AutoGPS-homepage/ . 1 Introduction Mathematical reasoning constitutes a fundamental component of human intelligence. Among various mathematical domains, geometry problem solving (GPS) has attracted significant attention due to its intrinsic elegance and deductive completeness [ 39 , 40 ] . Distinct from other mathematical disciplines such as algebra [ 16 , 8 , 49 ] , geometric problem solving inherently involves the analysis and comprehension of multimodal information, including visual diagrams and textual descriptions [ 4 , 35 , 28 , 45 , 33 , 19 ] . This process necessitates not only the understanding of multimodal problem formulation but also rigorous mathematical deduction to derive solutions [ 29 , 12 , 18 , 50 , 4 , 26 ] . Recently, many methods have been proposed for this challenging task, which are primarily fall into two categories: (1) Neural-based methods , including specialized neural geometry solvers [ 52 , 23 ] and multimodal large language models (MLLMs) [ 12 , 31 , 32 , 34 , 18 , 7 , 6 , 14 , 44 , 5 , 54 , 36 , 37 ] , demonstrate superior multimodal comprehension capabilities. However, as shown in Figure 1 (left), such methods are unreliable and prone to generating plausible but logically flawed reasoning steps due to hallucination [ 17 ] , leading to erroneous conclusions. (2) Symbolic approaches [ 28 , 33 , 45 ] operate on formal language inputs through predefined rules and algebraic computations with basic mathematical rigor. However, as exemplified in Figure 1 (right), they struggle to completely formalize given multimodal problem input, leading to unreliable problem-solving results. Furthermore, neural methods inherently lack interpretability [ 55 ] , and existing symbolic methods fail to provide explicit human-interpretable reasoning steps [ 28 , 33 , 45 ] as shown in Figure 1 (left). This naturally leads us to pose a significant research challenge: Can we develop an automated geometry problem solving methodology that demonstrates reliable and interpretable reasoning capabilities? Figure 1: Failure cases of current methods. Left: Qwen2.5-VL-32B-Instruct exhibits hallucination-induced errors during reasoning, producing an incorrect conclusion. The symbolic method (Inter-GPS) also fails and lacks traceable steps for error diagnosis. Right: Inadequate cross-modal understanding leads to incomplete formalization, further obstructing symbolic solving. Blue/red annotations indicate correct/erroneous reasoning or answers. Figure 2: Performance comparison among existing methods. To address this challenge, we propose AutoGPS, a neuro-symbolic collaborative framework that solves geometry problems with concise, reliable, and human-interpretable reasoning processes. Specifically, AutoGPS comprises two principal components: the Multimodal Problem Formalizer (MPF) and the Deductive Symbolic Reasoner (DSR). The MPF is a formalization agent that processes image-text pairs of geometric problems. By enhancing multimodal large language models with domain-specific parsing tools, it executes pre-formalization and multimodal alignment operations to transform geometric problems into formal language representations. The DSR is a symbolic computation engine based on predefined rules, accepting formal problem descriptions as input. It validates the formalization and provides feedback to the MPF for refinement until the formalization is error-free. Subsequently, the DSR formulates the problem-solving process as a hypergraph expansion task, where the formal language literals are treated as nodes and derivation steps are treated as hyperedges. It iteratively applies two complementary strategies to expand the hypergraph until the solution node is reached. Upon solution attainment, it identifies the minimal sub-hypergraph for solution derivation and generates a syllogistic-structured reasoning process. Therefore, the proposed AutoGPS effectively solves the geometry problem with rigorous, concise, and human-readable derivation, maintaining both reliability and interpretability. Experimental results on two GPS benchmarks [ 28 , 52 ] demonstrate that our AutoGPS outperforms the existing methods by margins of 4.1% and 9.2% and the state-of-the-art mathematical reasoning MLLMs by 18.0% and 26.4%. Human stepwise reasoning evaluations validate that AutoGPS achieves 99% stepwise accuracy, surpassing the 71% accuracy of the best-performing MLLM [ 56 ] , demonstrating absolute superiority in reliability and interpretability over existing methods. 2 Related Work 2.1 Mathematical Reasoning with MLLMs Recent advancements in MLLMs have demonstrated significant potential for mathematical reasoning in visual contexts, as evidenced by multiple benchmark studies. The research community has developed specialized datasets to systematically assess these capabilities: MathVista [ 29 ] serves as the pioneering benchmark for evaluating visual mathematical reasoning, while MATH-Vision [ 43 ] provides comprehensive assessments across core mathematical domains, including algebra, statistics, and geometry. MathVerse [ 53 ] contributes 2,612 human-annotated visual mathematical problems spanning planar geometry, solid geometry, and functional analysis. Complementing these efforts, GeoEval [ 50 ] specifically targets geometric reasoning evaluation through plane and solid geometry problems. Building upon these foundational works, our research involves a comprehensive evaluation of MLLMs’ performance in plane geometry contexts. We utilize two larger-scale datasets: Geometry3K [ 28 ] and PGPS9K [ 52 ] , with particular emphasis on both formalization and solution-generation. 2.2 Geometry Problem Solving Geometry problem solving remains a critical research focus [ 28 , 33 , 45 , 23 , 12 , 18 , 35 , 15 , 51 , 52 , 38 ] , with existing approaches falling into three main categories: neural-based, symbolic-based, and neural-symbolic methods. Neural methods leverage trained networks (PGPSNet [ 52 ] and LANS [ 23 ] ) or fine-tuned multimodal LLMs (LLaVA [ 25 , 26 , 27 ] , G-LLaVA [ 12 ] , Vision-R1 [ 18 ] ) for geometric reasoning, while symbolic systems (Inter-GPS [ 28 ] , E-GPS [ 45 ] ) employ formal language [ 48 , 47 ] and deductive rules. Neural-symbolic approaches such as GeoDRL [ 33 ] integrate neural components with symbolic solvers using reinforcement learning for heuristic search, reducing the search space to enhance efficiency. These methods, however, exhibit limitations in reliability and interpretability. Neural methods suffer from hallucination issues, leading to incorrect reasoning and answers, while symbolic methods produce algebraic solutions lacking procedural transparency. Our framework first translates multimodal problems into formal language representations, then executes symbolic deduction to generate human-readable reasoning steps, ensuring reliability and interpretability. 3 Methodology 3.1 Problem Formulation Following [ 28 ] , given a predefined theorem set \mathcal{T} , we aim to solve geometry problems formalized as \mathcal{D}=\{(D_{i},T_{i})_{i=1}^{N}\} . Here, (D_{i},T_{i}) is the i -th multimodal geometry