Counterfactual Reasoning for Causal Responsibility Attribution in Probabilistic Multi-Agent Systems

Chunyan Mu 1, Muhammad Najib 2 · 2026

Read Counterfactual Reasoning for Causal Responsibility Attribution in Probabilistic Multi-Agent Systems by Chunyan Mu 1, Muhammad Najib 2 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13077.txt.

Introduction

Mu and Najib model multi-agent systems as concurrent stochastic multiplayer games and introduce backward counterfactual responsibility, which scores each agent's share of blame for outcomes under a given strategy profile. To split blame fairly they use the Shapley value, proving it meets fairness and consistency rules. Their setup supports both checking and strategic reasoning in blame-aware systems. Taking Nash equilibrium as the solution concept, they show how to compute stable profiles where agents trade blame against expected reward.

Catalog record

CREATORChunyan Mu 1, Muhammad Najib 2
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60530
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13077

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Counterfactual Reasoning for Causal Responsibility Attribution in Probabilistic Multi-Agent Systems Chunyan Mu 1, Muhammad Najib 2 Abstract Responsibility allocation—determining the extent to which agents are accountable for outcomes—is a fundamental challenge in the design and analysis of multi-agent systems. In this work, we model such systems as concurrent stochastic multi-player games and introduce a notion of retrospective (backward) counterfactual responsibility, which quantifies an agent’s accountability for outcomes resulting from a given strategy profile. To allocate responsibility among agents, we utilise the Shapley value and formally show that this method satisfies key desirable properties, including fairness and consistency. Building on this foundation, we propose a formal framework that supports both verification and strategic reasoning in responsibility-aware multi-agent systems. Furthermore, by adopting Nash equilibrium as the solution concept, we demonstrate how to compute stable strategy profiles in which agents trade off responsibility against expected reward. 1 Introduction The growing emphasis on trustworthy AI [ 12 , 35 ] necessitates a paradigm shift, particularly regarding responsibility and accountability [ 21 , 29 , 8 ] . To enable responsible behaviour in agents, they must be endowed with an awareness of responsibility. This motivated the notion of responsibility-aware agents [ 52 , 30 ] , which are assumed to consider not only their own rewards/payoffs but also the broader implications of their actions. In MAS setting, where agents interact and may collaborate, the problem of responsibility attribution becomes increasingly important. When multiple agents jointly bring about an outcome, how can we fairly attribute responsibility to each agent, taking into account their respective capability? To illustrate this challenge, consider the following example. Example 1 Consider two autonomous vehicles, A_{1} and A_{2} , approaching an uncontrolled junction under snowy conditions. A_{1} is travelling from east to west, A_{2} from south to north. Each vehicle can either brake or not brake. If neither brakes, they will crash into each other. If both successfully brake (and stop), they will avoid a collision. However, due to the slippery road conditions, there is a 0.2 chance that A_{1} will not be able to stop, and a 0.6 chance that A_{2} will not be able to stop. Each vehicle aims to minimise its travel time to reach its destination. However, a crash would result in a significant cost. Suppose the outcome is a collision resulting from the agents’ chosen actions (or strategies), which vehicle should bear greater responsibility for the collision? Naturally, this depends on the strategies adopted during the interaction. However, responsibility may also hinge on the agents’ capabilities [ 24 ] . To illustrate, suppose that A_{2} can guarantee stopping with certainty. If both agents adopt the same mixed strategy that includes a non-zero probability of not braking, and a collision occurs, it seems reasonable to assign greater responsibility to A_{2} , as it had the capability to avoid the collision entirely. Moreover, there is an inherent trade-off between minimising travel time and avoiding collisions. This creates a strategic decision-making problem in which agents must weigh their utility (e.g., travel time) against potential responsibility penalties for a collision. Given these considerations, some important questions arise: Given the strategy profiles and capabilities, how should responsibility be allocated? , If the agents are aware of responsibility attribution, how should they choose their strategies? In this paper, we aim to such questions. First, we study responsibility attribution through the lens of counterfactual reasoning , which evaluates an agent’s contribution by asking how the outcome would change if the agent had acted differently. We follow well-established accounts of causation in philosophy and AI, where counterfactuals capture “ what would have happened otherwise ” [ 15 , 34 , 41 ] . We then examine strategic reasoning for responsibility-aware agents—agents that weigh not only their expected rewards but also the potential responsibility they may incur. This perspective provides a framework for addressing the earlier question of (strategic) forward reasoning : how such agents should choose their strategies. Contribution Our main contribution is an approach for responsibility attribution in probabilistic multi-agent systems. Firstly, we introduce a formal framework based on the Shapley value [ 43 ] and show that the resulting allocations satisfy desirable properties such as fairness (responsibility reflects contribution) and consistency (an agent’s share does not decrease when its influence increas). Although we do not claim this to be a definitive account of responsibility, the framework is interpretable, and based on a concept used widely across disciplines. Our focus is not on formalising moral responsibility, an extremely complex area with no clear consensus, nevertheless, we believe that our approach can contribute toward such a formalisation. Secondly, we study strategic reasoning in the setting where agents employ randomised memoryless strategy (aka behavioural [ 18 ] ), i.e., functions that map from state to a probability distribution over actions. Following the tradition of formal method in MAS, we extend the logic PATL with cumulative reward (similar to rPATL [ 32 ] ) and introduce degree of responsibility operators . We show that model checking this logic remains in PSPACE, thus no harder than rPATL [ 33 ] . Finally, we present a method for computing Nash equilibrium strategy profiles where agents’ utility functions incorporate both reward and responsibility allocation. We show that when agents’ temporal objectives are specified as either reachability or safety conditions, these equilibria can also be computed in PSPACE. Related work Research on responsibility and attribution spans a large body of work; here, we highlight some relevant studies and key distinctions. Responsibility attribution is closely tied to causality and counterfactual reasoning. Foundational work by Halpern and Pearl [ 26 ] introduced structural causal models, which underpin formal definitions of causality and counterfactual dependence. Building on this, [ 15 ] proposed a quantitative notion of responsibility, which later extended to a notion of blame attribution [ 25 ] . While conceptually related to our approach, their framework relies on directed acyclic graphs and is primarily suited for reasoning about beliefs, intentions, and epistemic states, whereas our work focuses on temporally extended properties in strategic settings. The Shapley value has also been applied for responsibility allocation. [ 23 ] extends the structural-model approach [ 25 ] by incorporating the Shapley value to distribute blame, and demonstrating that the allocation scheme satisfies desirable properties. As previously discussed, their model differs from ours and is suited for different purposes. Similarly, [ 51 ] apply Shapley-based responsibility allocation in concurrent epistemic games, enabling epistemic modeling but under deterministic assumptions, in contrast to our probabilistic setting. [ 4 ] studies backward and forward responsibility in extensive-form games , while [ 5 ] employs parametric Markov chains (pMCs), which are closely related to our model. Memoryless strategy profiles naturally correspond to parameters assignements in a pMC, although the converse does not always hold 1 1 1 Some parameter assignments cannot be expressed as individual strategies; see [ 46 , Remark 8] . We address this by imposing additional constraints in our parametric model ( Section 7 ). . Furthermore, [ 5 ] primarily focuses on attributing changes to parameters , with its main concern being how variations in temporal satisfaction degrees should be attributed to changes in parameter assignments. In contrast, our work assigns responsibility to individual players. Closer

Read the complete text