Humans and LLMs Diverge on Probabilistic Inferences
Gaurav Kamath, Sreenath Madathil, Sebastian Schuster, Marie-Catherine de Marneffe, Siva Reddy, [1em] McGill University · 2026
Read Humans and LLMs Diverge on Probabilistic Inferences by Gaurav Kamath, Sreenath Madathil, Sebastian Schuster, Marie-Catherine de Marneffe, Siva Reddy, [1em] McGill University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-23546.txt.
Introduction
Gaurav Kamath and four co-authors show humans and large language models diverge on probabilistic inferences. These are judgments that are likely, but not strictly forced, given a premise. Thinking models excel at logical and math tasks. Yet their conduct on open-ended, fixed-rule-free guessing has been little studied.
Their ProbCOPA dataset holds 210 handmade chance-based guesses in English. Each was rated for odds by 25 to 30 human raters. Human answers prove graded and varied, showing genuine chance-based judgment. Against eight state-of-the-art thinking models, the models always fail to match human-like spreads. Analysis of model thinking chains reveals a common pattern for judging such guesses. The findings stress the need to test thinking beyond fixed-rule settings.
Catalog record
| CREATOR | Gaurav Kamath, Sreenath Madathil, Sebastian Schuster, Marie-Catherine de Marneffe, Siva Reddy, [1em] McGill University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-23546
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Humans and LLMs Diverge on Probabilistic Inferences Gaurav Kamath, Sreenath Madathil, Sebastian Schuster, Marie-Catherine de Marneffe, Siva Reddy, [1em] McGill University Abstract Human reasoning often involves working over limited information to arrive at probabilistic conclusions. In its simplest form, this involves making an inference that is not strictly entailed by a premise, but rather only likely given the premise. While reasoning LLMs have demonstrated strong performance on logical and mathematical tasks, their behavior on such open-ended, non-deterministic inferences remains largely unexplored. We introduce ProbCopa , a dataset of 210 handcrafted probabilistic inferences in English, each annotated for inference likelihood by 25--30 human participants. We find that human responses are graded and varied, revealing probabilistic judgments of the inferences in our dataset. Comparing these judgments with responses from eight state-of-the-art reasoning LLMs, we show that models consistently fail to produce human-like distributions. Finally, analyzing LLM reasoning chains, we find evidence of a common reasoning pattern used to evaluate such inferences. Our findings reveal persistent differences between humans and LLMs, and underscore the need to evaluate reasoning beyond deterministic settings. 1 1 1 All data and code can be found at github.com/McGill-NLP/probabilistic-reasoning \noautomath Figure 1: High-level overview of our paper. We use ProbCOPA , a novel dataset of probabilistic inferences, to collect judgments of inference likelihood from humans and models, and study how well their respective judgment distributions align with one another. 1 Introduction Much of the day-to-day reasoning that humans do involves working over partial information to arrive at probabilistic conclusions ( 55 ) . Consider: {exe} \ex There was an accident on the highway. \xrightarrow{} Traffic was worse than usual. \ex There was an accident on the highway. \xrightarrow{} Traffic was largely unaffected. In the absence of any further context, ( 1 ) and ( 1 ) involve conclusions that may or may not be true given the information presented. Instead, the two conclusions are only likely or unlikely to varying degrees, given the first statement as well as background knowledge about highways and car accidents. Although ( 1 ) is likely, it is not guaranteed—perhaps everyone avoided the highway after hearing the news, leading to less traffic. Conversely, although ( 1 ) is unlikely, it cannot be ruled out completely—maybe the vehicles involved were swiftly moved out of the way, leading to minimal impact on traffic. We refer to such reasoning as probabilistic reasoning , and individual inferences of the kind in ( 1 ) and ( 1 ) as probabilistic inferences . What does such reasoning look like in humans and large language models (LLMs)? In this paper, we provide initial insights into this question. We compare probabilistic reasoning in humans and LLMs, in terms of their respective judgments towards a range of commonsense probabilistic inferences. Overall, we find that while models generally align with human judgments for probabilistic inferences deemed highly likely or highly unlikely, they consistently struggle to align with human judgments towards probabilistic inferences where annotators show more uncertainty (i.e., inferences that were deemed neither highly unlikely nor highly likely) and almost never show human-level judgment variation across sampled responses. We make the following contributions: • We introduce ProbCOPA , a novel dataset of 210 handcrafted probabilistic inferences in English, with at least 25 human annotations per item. • We highlight persistent differences between humans and LLMs in their judgments towards such probabilistic inferences. • We identify patterns in LLM reasoning chains that shed light on how they arrive at their final responses in these contexts. 2 The ProbCOPA Dataset 2.1 Data Construction We aim to study inferences that are not strictly logically entailed, but rather those that lie on a range of likelihood given a premise. Due to the limitations of existing NLI datasets in this regard (see Section 7 ), we construct our own corpus of probabilistic inferences. We begin with the Choice of Plausible Alternatives ( COPA ) dataset ( 66 ) , which consists of 1,000 manually handcrafted items that probe commonsense reasoning. {exe} \ex Premise: A drought occurred in the region. What happened as a result? {xlist} \ex Alternative 1: The crops perished. \ex Alternative 2: The water became contaminated. As the example in ( 2.1 ) illustrates, each COPA item consists of a single premise together with two possible effects or causes. For each pair of alternatives, one alternative is more plausible than the other; accordingly, the original task formulation involves choosing the more likely alternative among the two (( 2.1 ) in this example). Importantly, however, both alternatives are designed to be at least slightly plausible given the premise. To construct our dataset, we therefore split each COPA item into two NLI-style items, such as ( 2.1 ) and ( 2.1 ): {exe} \ex P: A drought occurred in the region. H: The crops perished. \ex P: A drought occurred in the region. H: The water became contaminated. Crucially, although the alternatives are designed to yield clear preferences when evaluated against each other, when each is evaluated in isolation, they constitute probabilistic inferences with varying degrees of plausibility or likelihood. Due to frequently-attested complexities in people’s estimation of causal likelihood ( 14 ; 78 ; 31 ; 71 ) , we exclude COPA items that ask participants to reason over possible causes, and only include those that elicit judgments on effect likelihood given a premise. We take a random sample of 105 such items from the COPA test set and split each of these as described above, resulting in 210 probabilistic inferences framed as NLI-style datapoints. 2.2 Human Annotation Procedure We conducted online crowdsourced experiments via Prolific 2 2 2 https://www.prolific.com to obtain human annotations for our dataset. We recruited 328 native English speakers based in the U.K., U.S. or Canada; these participants each annotated up to 30 ProbCOPA items under the procedure described below. All experimental protocols with humans were approved by our institution’s Research Ethics Board, and participants were paid an average of US$15.00/hr. The annotation procedure involved crowdworkers being presented with one premise-hypothesis pair at a time, and rating the likelihood of the hypothesis as a result of the premise (using a sliding scale to return a numerical rating between 0 and 100). Given attested variation in how humans express likelihood and uncertainty ( 7 ; 83 ; 76 ) , the sliding scale was shown to participants along with an aid suggesting how to partition values along it. Participants began with five instructional examples for which they received feedback—this was meant to both explain the task format to them, as well as calibrate their responses within broad ranges of the numerical scale. Following these examples, participants were presented with a sample of up to 30 test stimuli, with five attention checks interspersed in between. The order of test stimuli was randomly shuffled for each participant, and all responses from participants who failed more than one attention check were discarded. After discarding data from participants who failed the attention checks, we were left with between 25-30 likelihood score annotations (each from a unique participant) for each of our 210 items, with a median of 28 annotations per item. Appendix A describes the human annotation set-up in further detail, and includes screenshots of the user interface