Learning Probabilistic Responsibility Allocations for Multi-Agent Interactions
Isaac Remy, Caleb Chang, Karen Leung · 2026
Read Learning Probabilistic Responsibility Allocations for Multi-Agent Interactions by Isaac Remy, Caleb Chang, Karen Leung (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13128.txt.
Introduction
Remy, Chang, and Leung learn how people share responsibility in shared settings, how much each person shifts from their own desired behavior to make room for others. Their model captures the spread across possible allocations using a variational autoencoder plus multi-agent path forecasting, with a trainable optimization layer linking shares to observed controls. Tested on the INTERACTION driving dataset, it predicts well and yields readable patterns of multi-agent interaction.
Catalog record
| CREATOR | Isaac Remy, Caleb Chang, Karen Leung |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44367 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.13128
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Probabilistic Responsibility Allocations for Multi-Agent Interactions Isaac Remy, Caleb Chang, Karen Leung Abstract Human behavior in interactive settings is shaped not only by individual objectives but also by shared constraints with others, such as safety. Understanding how people allocate responsibility , i.e., how much one deviates from their desired policy to accommodate others, can inform the design of socially compliant and trustworthy autonomous systems. In this work, we introduce a method for learning a probabilistic responsibility allocation model that captures the multimodal uncertainty inherent in multi-agent interactions. Specifically, our approach leverages the latent space of a conditional variational autoencoder, combined with techniques from multi-agent trajectory forecasting, to learn a distribution over responsibility allocations conditioned on scene and agent context. Although ground-truth responsibility labels are unavailable, the model remains tractable by incorporating a differentiable optimization layer that maps responsibility allocations to induced controls, which are available. We evaluate our method on the INTERACTION driving dataset and demonstrate that it not only achieves strong predictive performance but also provides interpretable insights, through the lens of responsibility, into patterns of multi-agent interaction. I Introduction Designing human-centric autonomous systems requires not only predicting human behavior but also understanding the principles that govern how people interact with one another. Human interaction is shaped not only by personal objectives but also by shared constraints (e.g., safety) and social norms that govern acceptable behavior. For example, a driver aiming to reach their destination quickly must also follow traffic rules and act in ways that do not endanger others. Understanding how humans balance self-interested goals with the welfare of those around them is key to designing socially-aware autonomous agents. In this work, we aim to codify how humans trade off their own objectives to ensure safe interactions with others . We build on prior work on responsibility in multi-agent interactions [ 18 , 6 ] , where responsibility is defined as how much each agent contributes to maintaining shared safety constraints. Unlike previous works, which adopt deterministic models, we propose a probabilistic responsibility model derived from real-world human interaction data. Given the inherent multimodal uncertainty of human behavior and the nuanced, context-dependent nature of responsible actions, a probabilistic formulation provides a more faithful and flexible representation of multi-agent responsibility. Fig. 1 : Bottom left: If all agents behave selfishly, executing their desired control, a collision occurs. So who is “responsible” for deviating from their desired control? Our responsibility generative model encodes the scene context into a latent space (top left), decodes it to a distribution over responsibility allocations (top right), which pass through a responsibility-aware safety filter, producing a multimodal distribution of agent behaviors (bottom right). Specifically, we extend the framework of [ 18 ] , which defined an agent’s responsibility as their willingness to deviate from their desired behavior to enable safe interaction. That work focused on learning a deterministic mapping from the environment to each agent’s responsibility allocation at a single point of time. In contrast, our probabilistic responsibility allocation model outputs a distribution over responsibility allocations conditioned on current and past environment information. To achieve this, we leverage techniques in multi-agent trajectory forecasting and generative modeling, which provide tools for handling variable and heterogeneous agents, conditioning on interaction histories, and reasoning over multimodal futures. Contributions. We emphasize that this work is not presenting a methodology for trajectory forecasting, but is instead promoting a new way to understand how humans contribute to shared constraints while achieving their individual objectives. Specifically, our contributions are as follows: (i) a formulation of probabilistic responsibility allocations for multi-agent settings that extends prior work while leveraging the strengths of deep generative models and the computational advantages of decentralized control, (ii) a sequence-to-sequence responsibility model borrowing insights from transformer-based multi-agent trajectory forecasting models which can handle numerous complexities, and (iii) experiments demonstrating the efficacy of our probabilistic model on both multimodal synthetic data and real-world driving data. Our code will be released upon paper acceptance. II Related work We provide an overview of recent work on socially-aware interaction modeling and trajectory forecasting models. II-A Socially-aware interaction modeling and planning Explicitly incorporating the welfare of other agents into an autonomous agent’s planning objective provides an interpretable means of shaping its interactions with others. Prior work utilizing this approach shows the emergence of behaviors described as altruistic [ 27 ] , prosocial [ 8 ] , courteous [ 23 ] , cooperative [ 22 ] , or sympathetic [ 26 ] . These approaches highlight the simplicity of formulating the objective as a linear combination of the agent’s own utility and that of others, where the relative weighting produces markedly different interaction outcomes. For example, [ 27 ] shows that altruistic autonomous agents, which assign greater weight to others’ welfare, improve both traffic flow and safety compared to purely egoistic agents. Rather than specifying the weighting directly, it can also be learned from interaction data [ 22 ] . In this view, an agent may be assigned a Social Value Orientation (SVO) that characterizes its social preferences (e.g., altruistic, prosocial, or even masochistic). However, framing the prioritization of others’ welfare as equivalent to “responsibility” raises multiple issues: (i) Uncertain objectives. Reasoning at the objective level assumes other agents’ objectives are known. Inferring them through inverse reinforcement learning remains a challenging and open problem, especially in multi-agent settings. (ii) Multi-faceted objectives. An agent’s objective may combine diverse considerations—such as task goals, safety, preferences, and effort—making it unclear what aspect of responsibility is being captured. (iii) Decision-making assumptions. Objective-based reasoning presumes agents are (noisy) optimal decision-makers. While common, this assumption excludes alternative behavior models that directly capture empirical patterns (e.g., behavioral cloning). Instead of considering how agents value each others welfare, where latent social norms can be hard to disentangle from “aggressive” or “altruistic” behavior, our responsibility framework prioritizes empirically learning how agents contribute to safety constraints. II-B Trajectory forecasting models Recent advances in multi-agent trajectory forecasting [ 20 ] have led to a rich set of models and tools for predicting how agents move and interact in complex environments. In particular, there has been significant progress in the autonomous driving domain, fueled by the availability of large open-source datasets [ 4 , 24 ] . Interpretable trajectory forecasting models. Recent work in trajectory forecasting has increasingly emphasized interpretability, aiming to make predictions more transparent and trustworthy. One direction focuses on disentangling prediction factors such as goals [ 19 ] , intentions [ 25 ] , and interaction modes [ 21 ] , allowing users to trace how specific assumptions shape outcomes and inform downstream planning. Another line of work incorporates handcrafted auxiliary features during training to encourage latent variables to align with interpretable concepts. For example, [ 10 ] introduces “safety responsibility” and “courtesy responsibility” to ground latent features in a conditional variational autoencoder (CVAE) forecasting model. Collectively, these efforts move beyond simply improving accuracy, aiming instead toward models whose internal logic can be inspected, explained, and aligned with human expectations. Building on this perspective, we design a novel architecture that learns a structured latent embedding representative of responsibility allocations in driving scenarios. Language-based trajectory forecasting models. The growing popularity and performance of large language models (LLMs) and vision-language models (VLMs), has led to