Abductive Reasoning with Probabilistic Commonsense

Joseph Cotnareanu, Chiara Roverato, Han Zhou, Didier Chetelat, Yingxue Zhang, Mark Coates · 2026

Read Abductive Reasoning with Probabilistic Commonsense by Joseph Cotnareanu, Chiara Roverato, Han Zhou, Didier Chetelat, Yingxue Zhang, Mark Coates (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08011.txt.

Introduction

Joseph Cotnareanu and five coauthors tackle a gap in how language models reason with everyday knowledge. Formal logic solvers are exact, but they lack the common sense steps that people find obvious. Earlier systems let a language model supply the missing assumptions, yet they treated common sense as if everyone agreed on it.

The team proposes PACS, a method that samples many proofs and treats each one as one person's set of beliefs. It then combines the samples to judge whether most people would call a statement true or false. In tests, PACS beat chain-of-thought reasoning, older combined systems, and search-based methods on several benchmarks.

Catalog record

CREATORJoseph Cotnareanu, Chiara Roverato, Han Zhou, Didier Chetelat, Yingxue Zhang, Mark Coates
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08011

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Abductive Reasoning with Probabilistic Commonsense Joseph Cotnareanu, Chiara Roverato, Han Zhou, Didier Chetelat, Yingxue Zhang, Mark Coates Abstract Recent efforts to improve the reasoning abilities of Large Language Models (LLMs) have focused on integrating formal logic solvers within neurosymbolic frameworks. A key challenge is that formal solvers lack commonsense world knowledge, preventing them from making reasoning steps that humans find obvious. Prior methods address this by using LLMs to supply missing commonsense assumptions, but these approaches implicitly assume universal agreement on such commonsense facts. In reality, commonsense beliefs vary across individuals. We propose a probabilistic framework for abductive commonsense reasoning that explicitly models this variation, aiming to determine whether most people would judge a statement as true or false. We introduce Probabilistic Abductive CommonSense (PACS), a novel algorithm that uses an LLM and a formal solver to sample proofs as observations of individuals’ distinct commonsense beliefs, and aggregates conclusions across these samples. Empirically, PACS outperforms chain-of-thought reasoning, prior neurosymbolic methods, and search-based approaches across multiple benchmarks. 1 Introduction Much research in recent years has been centered on improving the abilities of Large Language Models (LLMs) to reason formally. One particularly promising approach revolves around providing the LLM access to a formal logic solver ( 20 ; 8 ; 9 ; 6 ) . Fueled by LLMs’ strong abilities to translate between natural language and formalized logic ( 18 ) , this revival of neurosymbolic approaches in AI has the potential to finally lead to human-level ability on reasoning benchmarks. In the simplest possible approach, the LLM translates the reasoning problem into a set of formal logic premises S and a query c , and a solver is called to determine whether S entails c or \neg c ( 20 ; 18 ) . However, this naive approach is often brittle, as solvers are often incapable of solving the problem because they lack access to necessary commonsense information, such as “white is a color” or ”rabbits are animals”. LLM-Tres and ARGOS ( 12 ; 1 ) attempt to solve this problem by using the LLM to build an additional set of commonsense propositions L that complete the problem, in the sense that anybody would agree L is true ( \vdash\!L ) and S\wedge L\vdash c or S\wedge L\vdash\neg c . This turns the problem from deductive to abductive reasoning, where not only the truth value of c must be found, but also the missing information L necessary to pin down this value. While this approach is very valuable in some settings where the concepts in question are uncontroversial (e.g., “hot sauce is spicy”), it often fails in more complex or ambiguous domains. Indeed, when a question might involve more fluid topics, there might simply not be any single set of additional facts L that completes the problem and that everybody would agree is true ( \vdash\!L ). In these domains, two people might disagree about the truth value of a query c not because of errors in reasoning, but rather because one holds a set of commonsense beliefs L_{1} such that S\wedge L_{1}\vdash c , while the other holds a different set of commonsense beliefs L_{2} such that S\wedge L_{2}\vdash\neg c , and those belief sets are both defensible yet incompatible with each other. Another clear down-side of assuming a monolithic commonsense is that expressing clearly a probability of the truth of a proposition becomes difficult. In LLM-Tres, for example, a probability of entailment between two variables is invoked frequently, and relied upon heavily by the method. However, since the source of the randomness of the truth is never described, this probability is not interpretable or understandable and is in truth more of a confidence-score. In this work, we propose a novel neurosymbolic and probabilistic framework for abductive reasoning problems which utilizes both the strengths of LLMs and formal logic solvers, but without the problematic assumption that everybody would agree on the missing assumptions. Instead, we propose to define the “abductive probability” of a query being true as its average over the commonsense set L(R) of every human being R\in\text{Humans} : \displaystyle\text{AP}(S,c)\equiv\text{E}_{R}\big[1[S\wedge L(R)\vdash c]\big], and say the query c is “abductively true” given the premises S if more people would conclude it is true than false. Then, we propose to derive an algorithm that aims to determine whether a query c is abductively true or false, so that it can be presented to the user as the “correct” answer. In detail, we devise a sampling algorithm that uses a large language model and a logic solver to produce plausible commonsense vectors L_{1},L_{2},\dots,L_{K} which indicate personal belief. This algorithm involves sampling successive propositions, and prioritizes reaching a conclusion ( S\wedge L_{k}\vdash c or S\wedge L_{k}\vdash\neg c ) as fast as possible, so as to minimize computational cost. Given these sampled commonsenses, we then approximate the probability of a query being true or false by a Monte-Carlo estimate, \displaystyle\widehat{\text{AP}}(S,c)=\frac{1}{K}\sum_{k=1}^{K}\,1[S\wedge L_{k}\vdash c], and conclude the query being true or false based on whether this estimate is greater or smaller than 0.5. On various abductive reasoning benchmarks, we show that this approach, which we call Probabilistic Abductive CommonSense (PACS) 1 1 1 Get our code on GitHub . , improves accuracy compared to both chain-of-thought ( 16 ) and prior neurosymbolic approaches, demonstrating its value as a reasoning algorithm as well as the credibility and value of the underlying assumptions and framework used for its derivation. 2 Related Work Our work is closely related to the prior literature on using LLMs to solve reasoning problems, both with and without logic solvers. In addition, our sampling algorithm is closely related to methods that employ an LLM to search for optimal reasoning steps in a tree-like fashion. Neural Methods 16 presented the first framework for LLM-based reasoning. In the work, it was shown that providing examples of rationales for answers to questions can induce the LLM to do the same, leading to improved accuracy. 5 demonstrated that a simple prompt can have a similar effect as providing examples of reasoning to induce such reasoning: prepending the sentence “Let’s think step by step” before generating an answer. This is known as “Chain of Thought” (COT). Following this, 15 proposed self-consistency (SC), using COT multiple times and taking the vote as the prediction. However, 11 observed that COT and SC suffer from challenges in proof planning — steps in the COT tend to be factual but do not always actually contribute to the answering of the problem. This motivates guidance of the LLM at a step-level. 4 and 6 proposed more logic-focused methods, with reverse reasoning, starting at the answer and ending at the problem. These back-chaining methods, however, underperform symbolic approaches. Symbolic Methods Considering that LLMs are poor proof-planners, a series of methods, including F-COT ( 8 ) and SAT-LM ( 20 ) , proposed to execute the reasoning with more specialized, logical tools. In these works, the LLM converts the text to symbolic logic, and a solver is then employed. Logic-LM ( 10 ) extended this to include a self-refinement step. While these methods perform well on simple or extremely logically structured datasets, they fail to account for ambiguity and the exclusion of common knowledge. Addressing this,

Read the complete text