Neurosymbolic Learning for Inference-Time Argumentation

Gabriel Freedman, Adam Dejl, Adam Gould, Mansi, Junqi Jiang, Francesca Toni · 2026

Read Neurosymbolic Learning for Inference-Time Argumentation by Gabriel Freedman, Adam Dejl, Adam Gould, Mansi, Junqi Jiang, Francesca Toni (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20098.txt.

Introduction

Gabriel Freedman and six co-workers build a neurosymbolic system for claim checking that allows uncertain verdicts. When evidence is incomplete or conflicting, a ternary true, false or uncertain answer may beat a binary one, and faithful explanations matter. Their argument system used at run time trains language models to make arguments and score their own strength, then computes verdicts from those scored arguments by formal rules. Because verdicts derive by rule from explicit argument structures, they stay faithful by construction rather than resting on post-hoc reasoning traces.

Catalog record

CREATORGabriel Freedman, Adam Dejl, Adam Gould, Mansi, Junqi Jiang, Francesca Toni
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59288
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20098

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Neurosymbolic Learning for Inference-Time Argumentation Gabriel Freedman, Adam Dejl, Adam Gould, Mansi, Junqi Jiang, Francesca Toni Abstract Claim verification is an important problem in high-stakes settings, including health and finance. When information underpinning claims is incomplete or conflicting, uncertain answers may be more appropriate than binary true or false classifications. In all cases, faithful explanations of the considerations determining the final verdict are crucial. We introduce inference-time argumentation (ITA) , a trainable neurosymbolic framework for ternary claim verification in which a formal argumentation semantics giving the strength of claims is used both (i) to guide LLM training as models learn to generate arguments and assign them base scores (representing intrinsic strengths) and (ii) to compute ternary (true/false/uncertain) predictions from generated, scored arguments. As a result, at training time, argument generation and scoring can be optimised according to the quality of the induced argumentative predictions. Moreover, at inference time, the final prediction is faithful, by construction, to the arguments and scores determining the verdict, rather than being justified by a potentially unfaithful post-hoc reasoning trace as in conventional reasoning models. We finally show that, on two datasets for ternary claim verification, ITA improves upon argumentative baselines and can perform competitively against non-argumentative direct-prediction baselines, while providing verdicts that are computed deterministically from explicit, inspectable argumentative structures. 1 Introduction Claim verification amounts to ascertaining the veracity of textual claims. It is a widely studied problem, recently as a potential application for LLMs ( 9 ) , and is used in many high-stakes settings, including healthcare ( 27 ) , finance ( 32 ) and scientific discovery ( 1 ) . In all settings, information underpinning the claims is crucial in ascertaining their veracity, but when this information is incomplete or conflicting, uncertain answers may be more appropriate than true or false classifications. For example FEVER ( 25 ) uses Supported, Refuted, and NotEnoughInfo labels, while AVeriTeC ( 22 ) distinguishes between Supported, Refuted, Not Enough Evidence, and Conflicting Evidence/Cherry-picking. No matter the veracity labels, faithful explanations of the considerations determining the labels are crucial in claim verification ( 10 ) . Figure 1: An example argumentative structure for a claim adapted from DEBATunE ( 17 ) . Arguments 1-3 attack the claim and 4-6 support it. For claim/argument x , \tau(x) is the base score and \sigma(x) the argumentative strength computed by the DF-QuAD semantics ( 21 ) . ITA classifies this claim as Uncertain as its strength is close to the midpoint of [0,1]. In this paper we consider claim verification as a three-valued prediction problem. Given a natural language claim, we aim to automatically predict a verdict \hat{y}\!\in\!\{\emph{True},\emph{False},\emph{Uncertain}\} . The Uncertain label is not treated as failure to classify, but as a substantive verdict for cases in which the available information does not warrant accepting or rejecting the claim, as in Figure 1 . To support this form of ternary claim verification while also guaranteeing faithful explanations for veracity verdicts, we introduce inference-time argumentation (ITA) , a novel neurosymbolic framework for training LLMs to argue about the veracity of claims. Rather than treating veracity outcomes as labels to be predicted directly, ITA derives them from the formal evaluation of generated supporting and attacking arguments, making prediction an argumentative verdict rather than a bare classification. In ITA, similarly to ArgLLMs ( 10 ) , verdicts are obtained by applying thresholds to a continuous argumentative strength computed with a (deterministic) argumentation semantics ( 21 ) . The final verdicts are thus derived based on the argumentative structure of supporting and attacking arguments and the associated base scores for all arguments and the claim, representing their intrinsic strength. As in ArgLLMs, the argumentative structure serves as a faithful explanation for the verdict. However, rather than using off-the-shelf LLMs for generating and scoring arguments as ArgLLMs do ( 10 ; 33 ) , ITA is based on training them so that LLMs learn how to generate and/or score arguments optimally for the downstream prediction. Thus, in ITA, the argumentation semantics also informs training. Specifically, it supervises the arguments’ base score generation and provides feedback for argument generation with reinforcement learning. ITA differs from (non-argumentative) inference-time reasoning approaches based on reinforcement learning from verifiable rewards ( 14 ) in its focus on a task where outcomes may be uncertain, rather than exact and automatically checkable with certainty (e.g. as in mathematics or programming), and in its guarantees of faithful explainability, rather than with reasoning traces understood post-hoc as explanations, with several documented limitations ( 5 ; 7 ; 31 ) . In summary, our contributions are as follows. First, we introduce ITA, a trainable neurosymbolic framework for three-valued claim verification in which verdicts are computed from argumentative structures (see Figure 2 ). Second, we introduce two training strategies for ITA, respectively based on (i) learning base scores for generated arguments through objectives defined over the downstream argumentative verdict, rather than relying only on base scores provided by base LLMs as in 10 , and (ii) optimising the argument generator using feedback induced by formal argumentation semantics, turning argumentation from an inference-time decision layer into a training signal. Finally, we evaluate ITA on two claim-verification datasets against non-argumentative direct-prediction baselines and argumentative baselines, showing that we outperform all faithfully explainable baselines while performing competitively against others. We obtain the datasets by adapting three human-curated datasets: AVeriTeC ( 22 ) , StrategyClaim ( 10 ) and DEBATunE ( 17 ) . 2 Related Work Abstention. Several LLM-based claim verification methods exist ( 9 ) . Here we focus on methods aware of their knowledge boundaries, that honestly say “I do not know” for non-answerable questions, known as abstention ( 18 ; 29 ) . Existing approaches teach LLMs to perform abstention through fine-tuning strategies ( 2 ; 16 ) . 6 further improves this line of research by introducing a special [IDK] (“ I don’t know ”) token into the model’s vocabulary. While these approaches all focus on training models to refuse to answer certain queries, they do not provide faithful explanations for why these refusals are the appropriate response. Nor do they seek to explicitly surface their reasoning when conflicting evidence, rather than just lack of knowledge, is the cause for their uncertainty. Learning and Argumentation. Argumentation has been advocated in combination with learning in several settings (as recently surveyed by 19 ; 20 ). In the context of RL, 12 use reasoning with argumentation frameworks to shape rewards, in a multi-agent simulated game setting, and 28 replace human feedback in RL with reasoning in preference-based argumentation, in a maze environment. Neither of these approaches generates arguments or uses gradual argumentation semantics as we do. In the context of neurosymbolic, end-to-end learning, 13 adopt gradual argumentation semantics as well as, like in our approach, base score model learning. However, in their approach arguments are given rather than generated by LLMs, and no RL takes place. LLMs and Argumentation. Closest to our work are the proposals by 10 ; 34 , both using argumentation in combination with LLMs, and highlighting its benefits in terms of faithfulness of explanations. However, both approaches focus on generation of arguments and base scores from off-the-shelf LLMs rather than training them. Also,

Read the complete text