Estimating cognitive biases with attention-aware inverse planning

Sounak Banerjee, Daphne Cornelisse, Deepak Gopinath, Emily Sumner, Jonathan DeCastro, Guy Rosman, Eugene Vinitsky, Mark K. Ho · 2025

Read Estimating cognitive biases with attention-aware inverse planning by Sounak Banerjee, Daphne Cornelisse, Deepak Gopinath, Emily Sumner, Jonathan DeCastro, Guy Rosman, Eugene Vinitsky, Mark K. Ho (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-25951.txt.

Introduction

Sounak Banerjee leads seven co-authors in a method to infer a person's attention biases from their actions. People act with cognitive biases, systematic twists in thinking, and a robot or car that works with people should account for them. Attention bias shapes which objects a person notices, which in turn affects tasks such as driving.

Banerjee and the team formalize attention aware inverse planning, where the goal is to recover attention weights from observed behavior. They show how it differs from standard inverse reinforcement learning, which recovers goals alone. Their approach pairs deep reinforcement learning with a cognitive model and infers attention strategies for agents in real driving scenes from the Waymo Open Dataset.

Catalog record

CREATORSounak Banerjee, Daphne Cornelisse, Deepak Gopinath, Emily Sumner, Jonathan DeCastro, Guy Rosman, Eugene Vinitsky, Mark K. Ho
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-25951

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Estimating cognitive biases with attention-aware inverse planning Sounak Banerjee, Daphne Cornelisse, Deepak Gopinath, Emily Sumner, Jonathan DeCastro, Guy Rosman, Eugene Vinitsky, Mark K. Ho Abstract People’s goal-directed behaviors are influenced by their cognitive biases, and autonomous systems that interact with people should be aware of this. For example, people’s attention to objects in their environment will be biased in a way that systematically affects how they perform everyday tasks such as driving to work. Here, building on recent work in computational cognitive science, we formally articulate the attention-aware inverse planning problem , in which the goal is to estimate a person’s attentional biases from their actions. We demonstrate how attention-aware inverse planning systematically differs from standard inverse reinforcement learning and how cognitive biases can be inferred from behavior. Finally, we present an approach to attention-aware inverse planning that combines deep reinforcement learning with computational cognitive modeling. We use this approach to infer the attentional strategies of RL agents in real-life driving scenarios selected from the Waymo Open Dataset, demonstrating the scalability of estimating cognitive biases with attention-aware inverse planning. 1 Introduction Conventional wisdom suggests that people are not always rational, and this truism is now backed by over half a century of research in cognitive science ( Simon 1955 ; Tversky and Kahneman 1974 ; Gigerenzer et al. 2000 ) . It is remarkable, then, that standard approaches to modeling goal-directed human behavior in machine learning and artificial intelligence (e.g., inverse reinforcement learning) assume that people act optimally—or at least approximately optimally—with respect to their goals ( Ng and Russell 2000 ; Arora and Doshi 2021 ) . What explains this disconnect between psychological reality and basic modeling assumptions? How can we bridge this gap? One reason why machine learning models of human behavior assume (approximate-)optimality is that although this assumption is false in fundamental ways, it underpins expected utility theory ( von Neumann and Morgenstern 1947 ; McFadden 1974 ) , which itself provides the basis for developing scalable algorithms that can make generalizable predictions about human behavior ( Ho and Griffiths 2022 ) . In contrast, general and scalable frameworks that account for why, when, and how people deviate from idealized rationality have not been previously available. This has changed in recent years: Building off of classic ideas in bounded rationality ( Simon 1990 ) , cognitive scientists have begun to go beyond just describing deviations from ideal rationality to systematically explaining , predicting , and influencing those deviations by developing general theories of resource-limited cognition ( Lewis et al. 2014 ; Griffiths et al. 2015 ; Gershman et al. 2015 ; Shenhav et al. 2017 ; Bhui et al. 2021 ) . The present work aims to apply these recent insights to the development of generalizable and scalable algorithms for modeling human decision-making. Here, we focus specifically on how limited attention affects goal-directed behavior in complex tasks. As an example, consider the everyday activity of driving. When driving, people must systematically prioritize which objects in the environment to attend to (e.g., the car directly ahead, the child entering a blind spot) and which objects to ignore (e.g., the parked car on the opposite side of the street, the pile of leaves in a driveway). Whether an object is prioritized for attention depends on numerous factors, such as its immediate relevance for planning or a person’s previous driving experience. Recent work by Ho et al. 2022 has proposed the framework of value-guided construal , which formalizes the process of prioritizing attention for planning as a meta-cognitive decision. The value-guided construal framework can be viewed as a principled forward model of how unobservable cognitive processes (e.g., attention, planning, and biases) integrate to produce observable behavior. In this paper, we extend the value-guided construal framework to incorporate attentional biases and then invert it to specify the attention-aware inverse planning problem, in which the goal is to infer the biases of an attention-limited decision-maker from their behavior. We then study this approach in tabular domains and compare it to standard modeling approaches that assume decision-makers have un limited attention (e.g., inverse reinforcement learning ( Abbeel and Ng 2004 ) ). Finally, we develop an approach for inferring biases from synthetically generated behavior in real-world driving scenarios selected from the Waymo Open Motion Dataset ( Ettinger et al. 2021 ) , demonstrating the feasibility of scaling up attention-aware inverse planning to complex, naturalistic domains. 2 Background A number of algorithmic approaches have been developed for modeling human behavior. The simplest approaches are based on imitation learning ( Bain and Sammut 1995 ) , in which behavior is modeled by directly fitting a policy that predicts actions given observations. Imitation learning is effective when data is abundant and generalization is within-distribution, and has been successfully applied to model human behavior in real-world tasks such as highway driving ( Lefèvre et al. 2014 ; Rudenko et al. 2020 ) . However, when training data is limited or generalization is out-of-distribution, it is necessary to turn to methods that make stronger assumptions about policy structure. In particular, methods based on inverse reinforcement learning (IRL) assume that observed behavior is generated by a policy that is optimal (plus decision-noise) with respect to the true task dynamics and a latent reward function, and attempts to infer the reward function ( Abbeel and Ng 2004 ; Ziebart et al. 2008 ) . In human-robot interaction and AI safety, generalizable models of human cognition and action are key for safe and effective interaction ( Collins et al. 2024 ) . Although multi-agent interactions can be modeled without considering human biases via self-play or population-play algorithms ( Silver et al. 2017 ; Jaderberg et al. 2019 ) , agents trained this way perform poorly with people, especially in cooperative tasks ( Carroll et al. 2019 ) . Additionally, accurate representations of how people make decisions are needed for more sophisticated forms of interaction that involve reasoning about the physical capabilities and intentions of human users ( Gopinath et al. 2021a ) , modeling how humans reason about intentions ( Dragan et al. 2013 ) , or more complex forms of cooperation ( Hadfield-Menell et al. 2016 ; Kleiman-Weiner et al. 2016 ) . Separate from this work on behavior modeling, work on attention modeling in the machine learning community has mainly been pursued in the context of specific tasks, such as driving ( Kotseruba and Tsotsos 2022 ; Gopinath et al. 2021b ; Cao et al. 2022 ) . Although early work used cognitive models that relate attention to behavior ( Salvucci 2006 ) , more recent work is based on data-driven approaches using gaze data and reaction times ( Ahlström et al. 2022 ; Sundareswara et al. 2013 ; Li et al. 2024 ; Yang et al. 2020 ; Xue et al. 2025 ) . IRL has also inspired computational approaches to studying human social cognition. For example, Baker et al. 2009 proposed that human theory of mind could be conceptualized as inverse planning , Bayesian inference over a generative model of rational action. Additionally, as noted in the introduction, a large literature documents human deviations from expected utility theory ( Kahneman and Tversky 1979 ) . More recent

Read the complete text