Position: Logical Soundness is not a Reliable Criterion for Neurosymbolic Fact-Checking with LLMs

Jason Chan, Robert Gaizauskas & Zhixue Zhao · 2026

Read Position: Logical Soundness is not a Reliable Criterion for Neurosymbolic Fact-Checking with LLMs by Jason Chan, Robert Gaizauskas & Zhixue Zhao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-04177.txt.

Introduction

Jason Chan, Robert Gaizauskas, and Zhixue Zhao argued that logical soundness is an unreliable yardstick for neurosymbolic fact-checking with language models. Such systems translate claims into logical formulas and check whether they follow validly from verified premises. The authors showed that sound conclusions can still mislead, since human inferences often diverge from strict logic. Drawing on cognitive science and pragmatics, they offered a typology of such cases and urged using models' human-like reasoning tendencies to validate formal outputs.

Catalog record

CREATORJason Chan, Robert Gaizauskas & Zhixue Zhao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19702
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.04177

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Position: Logical Soundness is not a Reliable Criterion for Neurosymbolic Fact-Checking with LLMs Jason Chan, Robert Gaizauskas & Zhixue Zhao Abstract As large language models (LLMs) are increasing integrated into fact-checking pipelines, formal logic is often proposed as a rigorous means by which to mitigate bias, errors and hallucinations in these models’ outputs. For example, some neurosymbolic systems verify claims by using LLMs to translate natural language into logical formulae and then checking whether the proposed claims are logically sound, i.e. whether they can be validly derived from premises that are verified to be true. We argue that such approaches structurally fail to detect misleading claims due to systematic divergences between conclusions that are logically sound and inferences that humans typically make and accept. Drawing on studies in cognitive science and pragmatics, we present a typology of cases in which logically sound conclusions systematically elicit human inferences that are unsupported by the underlying premises. Consequently, we advocate for a complementary approach: leveraging human-like reasoning tendencies of LLMs as a feature rather than a bug, and using these models to validate the outputs of formal components in neurosymbolic systems against potentially misleading conclusions. 1 Introduction Large language models (LLMs) have enabled substantial progress in automated fact-checking and claim verification ( 12 ; 3 ; 16 ) . However, their outputs remain vulnerable to hallucinations, bias, and logical inconsistency ( 17 ; 40 ; 39 ) . To mitigate these limitations, a growing body of work has proposed neurosymbolic approaches that use formal logic to constrain or validate LLM outputs. In some architectures, for example, LLMs act as semantic parsers that translate natural-language statements, e.g. from user input or model-generated text into logical formulae such as in first-order logic (FOL) that are then evaluated against a verified knowledge base or external source ( 51 ; 2 ) . A common underlying assumption is that if a claim is logically sound, i.e. validly derivable from true premises in a verified knowledge base under formal inference rules such as those of FOL, then the claim is supported and acceptable. We argue that existing work relying on this approach has a critical blind spot: logical soundness is not a reliable criterion for detecting misleading information, because human inferences often diverge from formal logical operations such that logically sound conclusions can be systematically misleading . This yields three implications that challenge the current paradigm: (a) as opposed to using formal logic to validate LLM outputs, LLMs also have the potential of modeling human inference and detecting misleading conclusions otherwise unrecognized by systems relying on formal logic; (b) research on LLM reasoning should investigate these models’ human-like tendencies not only as bugs (i.e., models committing human-like genuine errors and biases in logical tasks) but also as features (i.e., models predicting inferences that humans would typically accept despite being unsound in formal logic); and (c) if LLMs are to model human reasoning effectively, they should not be trained or optimized to conform strictly to formal logic in their reasoning processes. 2 Misleading Information and Logic-Based Approaches to Fact-Checking In the context of recognizing and mitigating misinformation, fact-checking aims to identify not only explicitly false statements but also those that are technically true yet misleading ( 5 ; 23 ; 12 ; 1 ) . In line with existing literature, we use “misleading” to mean factually correct content that nonetheless conveys an implied meaning that is false or unsupported ( 48 ) . Within this paradigm, the starting point of our position is that “implied meaning” includes inferences that human readers would typically draw or accept. Consider the sentence “John had a fight with Marilyn and decided to break up with her.” As predicted by the theory of conjunction buttressing, readers would typically interpret this compound statement as (i) a temporal sequence (fight first, breakup decision second) and often (ii) a causal relation (the fight contributed to the decision) ( 27 ) . Accordingly, if John had already decided to break up with Marilyn before the fight, the sentence should be considered misleading despite being literally compatible with the facts. In parallel, existing research combines LLMs with explicit logic-based verification to improve faithfulness and robustness in fact-checking. Example methods include using LLMs to decompose complex natural language claims into formulae composed of FOL predicates whose truth values are individually verified by external knowledge sources ( 51 ; 50 ; 2 ) . Other methods rely on natural logic, using LLMs to segment claims and evidence into corresponding text spans, and then relying on automated theorem-provers in natural logic to determine whether the claims are logically entailed by the evidence ( 24 ; 46 ) . More generally, this approach of using LLMs to translate natural language into logical formulae which are then checked with a symbolic solver has also been proposed to ensure that LLMs’ own reasoning processes and resulting outputs are logically sound, i.e. based on true premises and derived in a logically valid manner ( 38 ; 54 ) . Likewise, formal logic underpins other verification paradigms, including knowledge-graph-based methods ( 35 ; 13 ) (e.g. to infer unstated relationships between entities in graph) and program-based approaches ( 36 ) . The underlying assumption across these logic-based approaches is that if a claim can be derived in a logically valid manner from premises that are trusted or assumed to be true, then the claim itself should be treated as supported and verified by that system. 3 The divergence between human reasoning and formal logic Existing work in cognitive science has shown that humans accept and make inferences in ways that diverge from what is considered valid under formal logical systems ( 20 ; 22 ; 41 ) . For example, consider a premise in disjunctive form: “ A or B ”. According to the theory of mental models, humans represent a disjunctive statement as a conjunction of possibilities that hold in default to the contrary. This account explains why, on hearing that “ A or B ”, humans tend to accept the inferences “ it is possible that A ” and “ it is possible that B ” as intuitive and correct, even though both these inferences are invalid ( and therefore unsound regardless of whether the premises are true ) in standard modal logic that is introduced to reason with statements about possibilities and necessities ( 18 ) . We now illustrate why such divergences between human inference and formal logic are problematic for logic-based approaches in fact-checking. While we present an example statement in disjunctive form (“ A or B ’’) commonly found in official announcements 1 1 1 See e.g. “ [i]f you look at the Summary of Economic Projections, things are moving by just a tick or even a semi tick between now and March ” ( https://www.federalreserve.gov/mediacenter/files/FOMCpresconf20180613.pdf ) and news reports 2 2 2 See e.g. “ fire […] may have spread through the plane and caused the explosion, or the jet could have caught fire after colliding with an object on the ground ” ( https://www.bbc.co.uk/news/articles/ckgky7djx5eo ); “ Sometimes that’s human error, someone misconfiguring something somewhere, or in extreme cases a cyber attack ” ( https://www.bbc.co.uk/news/articles/cev1en9077ro ) (thus making them realistic

Read the complete text