Inferring Latent Intentions: Attributional Natural Language Inference in LLM Agents
Xin Quan, Jiafeng Xiong, Marco Valentino, André Freitas · 2026
Read Inferring Latent Intentions: Attributional Natural Language Inference in LLM Agents by Xin Quan, Jiafeng Xiong, Marco Valentino, André Freitas (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08742.txt.
Introduction
Xin Quan and three co-authors test if large chat models can guess why a person acted. To work well with others, a model has to guess aims that are not said out loud. Old tests of logic in text do not check this skill. They ask what a text says, not what a person meant to do.
The team sets up tasks where a model must infer a hid aim from acts it can see. They call this skill attributional inference. It is key for groups of agents that must plan and talk. A reader who builds such groups gets a clear test of a weak spot. The work shows why plain text logic scores are not enough for team work.
Catalog record
| CREATOR | Xin Quan, Jiafeng Xiong, Marco Valentino, André Freitas |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-08742
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Inferring Latent Intentions: Attributional Natural Language Inference in LLM Agents Xin Quan, Jiafeng Xiong, Marco Valentino, André Freitas Abstract Attributional inference, the ability to predict latent intentions behind observed actions, is a critical yet underexplored capability for large language models (LLMs) operating in multi-agent environments. Traditional natural language inference (NLI), in fact, fails to capture the nuanced, intention-driven reasoning essential for complex interactive systems. To address this gap, we introduce Attributional NLI (Att-NLI), a framework that extends NLI with principles from social psychology to assess an agent’s capacity for abductive intentional inference (generating hypotheses about latent intentions), and subsequent deductive verification (drawing valid logical conclusions). We instantiate Att-NLI via a textual game, Undercover-V, experimenting with three types of LLM agents with varying reasoning capabilities and access to external tools: a standard NLI agent using only deductive inference, an Att-NLI agent employing abductive-deductive inference, and a neuro-symbolic Att-NLI agent performing abductive-deductive inference with external theorem provers. Extensive experiments demonstrate a clear hierarchy of attributional inference capabilities, with neuro-symbolic agents consistently outperforming others, achieving an average win rate of 17.08%. Our results underscore the role that Att-NLI can play in developing agents with sophisticated reasoning capabilities, highlighting, at the same time, the potential impact of neuro-symbolic AI in building rational LLM agents acting in multi-agent environments. Figure 1: Multi-agent LLM interactions often require inferring latent intentions beyond surface-level propositions, exposing a gap in traditional NLI evaluation. We propose Attributional NLI, a two-stage abductive-deductive framework grounded in attribution theory, consisting of intention selection followed by conclusion verification. We operationalise Att-NLI with Undercover-V, a verifiable social-deduction game that makes latent-intent attribution empirically testable. 1 Introduction Natural Language Inference (NLI) , determining whether a hypothesis is entailed, contradicted, or neutral given a premise, is a standard benchmark for evaluating textual reasoning in language models ( 6 ; 7 ) . A key aspect of NLI is constructing logically coherent arguments from factual premises to support a hypothesis ( 16 ; 41 ; 5 ; 47 ) . Recent work explores improving reasoning control in large language models (LLMs) for NLI ( 9 ; 42 ; 32 ; 33 ; 31 ) , focusing on eliciting factual, logical, or semantic consistency to enhance explicit inference. However, traditional NLI is fundamentally limited to single-agent, purely textual reasoning and overlooks the critical role of latent intentions in multi-agent settings. Many real-world scenarios, such as online debates, collaborative reasoning, or social deductive games, inherently require an understanding of underlying motivations beyond surface-level propositions ( 44 ; 8 ; 35 ) . While some studies have explored LLMs capabilities in multi-agent settings via social deductive games ( 39 ; 10 ; 43 ) , they primarily focus on game metrics, overlooking the underlying NLI capabilities. Similarly, other multi-agent studies ( 11 ) rely on explicit belief modeling rather than logic-based reasoning. Furthermore, existing NLI-based and multi-hop reasoning methods, like Chain-of-Thought or hybrid approaches ( 15 ; 45 ; 21 ) , tend to address explicit logical reasoning but lack quantitative metrics for evaluating intention-aware capabilities in multi-agent dialogues ( 37 ) . Attributional inference principles in social psychology describe the process of interpreting intentions through a two-stage process composed of intuitive inference and subsequent criticism ( 19 ; 1 ) . Inspired by these principles, we propose attributional NLI ( Att-NLI ), a framework that extends standard NLI by incorporating a two-stage reasoning process in a multi-agent setting (example in Fig. 1 ): (1) an initial abductive stage required to infer the latent intention of other agents, and (2) a subsequent deductive stage to draw logical conclusions based on the intentions. This abductive-deductive framework allows assessing LLMs’ reasoning and their applicability to complex, interactive multi-agent systems. To empirically evaluate Att-NLI and assess the attributional inference capabilities of LLM agents, we first introduce three types of LLM agents, namely NLI, Att-NLI, and Neuro-Symbolic Att-NLI, each endowed with distinct reasoning capabilities and access to external tools. We then empirically assess these agents using a representative deductive–abductive textual game, Undercover-V, which is specifically designed to be empirically testable for Att-NLI, together with a novel metric, the Attributional Score , which quantitatively evaluates Att-NLI proficiency and augments standard game performance metrics. Undercover-V provides a setting where agents must infer others’ roles (intentions) based on their actions (premises). The standard NLI agent performs only conventional deductive textual inference without considering intentions. The Standard Att-NLI agent extends this with an abductive-deductive pipeline, first inferring each agent’s intention and then revising its judgment. The Neuro-Symbolic Att-NLI agent further enhances this process with an external theorem prover, ensuring logically sound inference and external-feedback-guided refinement for deductive reasoning. We use standard game metrics (win rate, elimination rate) to provide a holistic view of reasoning capacity, while the new Attributional Score, measuring soundness and alignment, quantifies the Att-NLI performance across different LLM agents. Extensive evaluations using four widely adopted LLMs (GPT-4o-mini, GPT-4o, Mixtral-8x22B, and Mistral-Medium) led to the following conclusions: (1) We introduce Attributional NLI (Att-NLI), a mechanism that enables LLM agents to infer latent intentions via abductive-deductive reasoning, and design a text-based game with designed metrics to evaluate Att-NLI across different agents. (2) Our results establish a clear performance hierarchy across both game metrics and Attributional Score. Agents based on GPT-4o consistently outperform others and show the most consistent improvement across all agent types, suggesting better inherent reasoning capabilities, while Mixtral-8x22b shows the largest performance gains from neuro-symbolic integration. (3) We demonstrate the effectiveness of Att-NLI agent enhancements. The Neuro-Symbolic Att-NLI agent achieves the strongest results across all metrics (e.g., 17.08% average spy win rate), representing a 24.22% improvement over the Standard Att-NLI agent and a 78.29% improvement over the Standard NLI agent. 2 Attributional Natural Language Inference Attributional inference, a foundational concept in social psychology, is the cognitive process by which agents infer the latent causes or intentions underlying observed behaviours ( 14 ; 46 ; 22 ) . For LLMs acting in multi-agent settings, such as cooperative planning ( 3 ; 40 ) , accurate attribution is essential for predicting other agents’ actions and formulating effective responses. Because interaction in these environments occurs almost exclusively through natural language, the attribution problem can be rigorously formalised as an NLI task, namely, determining whether a set of premises entails hypotheses about latent intentions. Yet traditional NLI benchmarks fail to assess this intention-centred reasoning. To bridge this gap, we introduce the Attributional NLI (Att-NLI) framework, which evaluates an LLM’s capacity for intentional reasoning through a two-stage abductive–deductive process. 2.1 Attributional Inference as an Abductive-Deductive Process The Att-NLI framework is grounded in a two-stage reasoning model that mirrors attributional cognition ( 13 ; 12 ) . It posits an initial abductive phase for generating intent hypotheses ( 2 ; 51 ) , followed by a deductive phase to validate and refine them and draw logical conclusions ( 20 ; 48 ) . Stage 1: Intention Selection (Abduction). The first stage involves abductive inference, which is to generate the “best explanation” for a set of observations. Given a set of premises \mathcal{P} , which represent observable actions or statements from agents, an LLM must infer the latent intention \mathcal{H}^{*} that most plausibly explains these premises. This can be conceptualized as a form