Faithful and Robust LLM-Driven Theorem Proving for NLI Explanations

Xin Quan, Marco Valentino, Louise A. Dennis, André Freitas · 2025

Read Faithful and Robust LLM-Driven Theorem Proving for NLI Explanations by Xin Quan, Marco Valentino, Louise A. Dennis, André Freitas (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24264.txt.

Introduction

Xin Quan, Marco Valentino, Louise Dennis, and André Freitas present a 2025 method for checking machine-written logic with a theorem prover. Language tasks ask whether a claim follows from a set of facts, and good answers show their steps. Provers can certify steps, but only in formal code. Turning prose into code can drop meaning or break form. The team attack both faults: guard the meaning in the turn, auto-fix form slips, and let the code steer the model's proof drafts.

Prover feedback then feeds repair rounds. On three data sets, gains over the best past system ran large on both the turn step and the polish step. Faithful steps matter when AI explains itself in court or clinic. This loop keeps the story and the proof in step.

Catalog record

CREATORXin Quan, Marco Valentino, Louise A. Dennis, André Freitas
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24264

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Faithful and Robust LLM-Driven Theorem Proving for NLI Explanations Xin Quan, Marco Valentino, Louise A. Dennis, André Freitas Abstract Natural language explanations play a fundamental role in Natural Language Inference (NLI) by revealing how premises logically entail hypotheses. Recent work has shown that the interaction of large language models (LLMs) with theorem provers (TPs) can help verify and improve the validity of NLI explanations. However, TPs require translating natural language into machine-verifiable formal representations, a process that introduces the risk of semantic information loss and unfaithful interpretation, an issue compounded by LLMs’ challenges in capturing critical logical structures with sufficient precision. Moreover, LLMs are still limited in their capacity for rigorous and robust proof construction within formal verification frameworks. To mitigate issues related to faithfulness and robustness, this paper investigates strategies to (1) alleviate semantic loss during autoformalisation, (2) efficiently identify and correct syntactic errors in logical representations, (3) explicitly use logical expressions to guide LLMs in generating structured proof sketches, and (4) increase LLMs’ capacity of interpreting TP’s feedback for iterative refinement. Our empirical results on e-SNLI, QASC and WorldTree using different LLMs demonstrate that the proposed strategies yield significant improvements in autoformalisation (+18.46%, +34.2%, +39.77%) and explanation refinement (+29.5%, +51.5%, +41.25%) over the state-of-the-art model. Moreover, we show that specific interventions on the hybrid LLM-TP architecture can substantially improve efficiency, drastically reducing the number of iterations required for successful verification. 1 1 1 Code and data are available at: https://github.com/neurosymbolicai/faithful_and_robust_nli_refinement 1 Introduction Recent studies in Natural Language Inference (NLI) have developed models to leverage natural language explanations as a mechanism for reasoning in support of a hypothesis ( Wiegreffe and Marasović, 2021 ; Chen et al., 2021 ; Thayaparan et al., 2020 ; Valentino et al., 2022 ) . Providing sound and logically valid natural language explanations lies at the core of NLI, as such transparent justifications enhance both interpretability and reliability for downstream tasks ( Camburu et al., 2018 ; Valentino et al., 2022 ; He et al., 2024 ) . Recent methods, in particular, have leveraged the inferential and linguistic capabilities of large language models (LLMs) by integrating them with external theorem provers (TPs) to automatically verify the logical validity of explanations for NLI ( Pan et al., 2023 ; Olausson et al., 2023 ; Quan et al., 2024b ; Dalal et al., 2024 ) . However, these integrated neuro-symbolic approaches still face notable challenges. First, automated theorem provers (ATP) require a machine-verifiable formal language, yet LLMs often fail to produce precise autoformalisations, underscoring their limited capacity to faithfully convert complex natural language inputs into rigorous formal representations ( Wu et al., 2022 ; Jiang et al., 2024 ; Quan et al., 2024b ) . Second, syntactic errors are frequently introduced during the autoformalisation process, leading to reduced theorem-proving success rates when dealing with more complex material inferences ( Pan et al., 2023 ; Olausson et al., 2023 ; Zhang et al., 2024 ) . Third, when provided with external feedback on complex explanations, LLMs often struggle to combine axioms (explanations) into cohesive proofs and effectively self-correct, limiting their effectiveness in more complex NLI settings ( Quan et al., 2024a ; Quan et al., 2024b ) . Figure 1: An illustration of our proposed interventions for improving LLM-driven theorem proving for NLI. The interventions employ different techniques including syntactic parsing, quantifier refinement, logical consistency refinement, and logical expression extraction to guide LLMs in generating more faithful and robust proof sketches for NLI and effectively refine natural language explanations. This approach provides more structured and explicit feedback by pinpointing the exact logical errors identified in the explanations. In this paper, we build upon the state-of-the-art LLM-based theorem proving framework for NLI, Explanation-Refiner ( Quan et al., 2024b ) . In particular, we explore methodologies to improve the faithfulness of autoformalisation and deliver a more robust way to effectively and efficiently provide logically valid explanations. We further examine how varying degrees of dataset complexity in multi-hop reasoning affect the reliability of proof step generation in LLM-Driven theorem proving. In general, we implement a neuro-symbolic framework to address the following research questions: RQ1: "To what extent can we deliver faithful autoformalisation that preserves semantic information?" RQ2: "What types of syntactic errors commonly appear in formal representations, and how effectively can state-of-the-art LLMs refine these errors?" RQ3: "Can state-of-the-art LLMs generate structured proof steps that can effectively provide feedback to refine explanations with complex sentences and logical relations?" To answer these questions, we investigate how to systematically leverage syntactic parsing during autoformalisation to guide LLMs generate logical representation of explanations. In addition, we define the general autoformalisation error types and use LLMs to refine these errors explicitly from the output message of a TP. Furthermore, we propose a method to extract the logical propositions, relations and implications to guide LLMs to generate proof sketches for automated theorem proving and explanation refinement. Our empirical evaluation on e-SNLI ( Camburu et al., 2018 ) , QASC ( Khot et al., 2019 ) , and WorldTree ( Jansen et al., 2018 ) shows that the proposed framework improves the faithfulness of autoformalisation by 18.46%, 34.2%, 39.77%, respectively, compared to Explanation-Refiner. Additionally, the number of refined explanations produced by our framework exceeds that of Explanation-Refiner across all LLMs: raising refinement rates from 41% to 95%, 17% to 90%, and 7% to 73% across all three datasets. To summarise, the main contributions of this paper are: 1. We introduce Faithful-Refiner, a novel neuro-symbolic framework that provides more robust and faithful verification and refinement of explanations in NLI, surpassing existing LLM-driven theorem-proving approaches. 2. We conduct a quantitative evaluation of explanation refinement and autoformalisation across different LLMs, achieving an average improvement of 29.5%, 51.5%, and 41.25% more refined explanations, as well as 5.06%, 6.86%, and 32.16% on syntactic errors reduction compared to the state-of-the-art. 3. We adopt a range of automatic metrics to measure the quality of explanations and autoformalisation, showing that the proposed framework significantly improve the faithfulness of the autoformalisation process. 4. We also perform a manual evaluation to assess the perceived quality of the formalised logical forms and conduct an extensive ablation study, elucidating the role of each proposed component and identifying key factors influencing automated theorem proving for NLI. 2 Automated Theorem Proving for Explanation-Based NLI In this paper, we define an explanation E_{i} as a set of facts \{f_{1},f_{2},\ldots,f_{n}\} that establish a logically valid entailment between premises p_{i} and a hypothesis h_{i} , such that p_{i}\cup E_{i}\models h_{i} holds. In this work, we leverage an external theorem prover TP to systematically verify these entailments in an automated manner. Specifically, given the set of input sentences S=p_{i}\cup\{h_{i}\}\cup E_{i} , we aim to build a set of logical forms \phi=\{\Phi(s)\mid s\in S\} , where \Phi is the autoformalisation process that converts natural language sentences into symbolic representations. From these logical forms, we construct a theory \Theta=(A,\tau) , where A=\{a_{1},a_{2},\ldots,a_{n}\} is the set of axioms derived from formalising E_{i} , and \tau is the theorem to be proven, composed of p_{i} and h_{i} . If an automated theorem prover ( ATP ) can derive a valid proof for \Theta , we conclude that E_{i} is sound and logically valid . Otherwise, we refine E_{i}

Read the complete text