A Unified Framework for Robots that Influence Humans over Long-Term Interaction
Shahabedin Sagheb \affilnum 1, Sagar Parekh \affilnum 1, Ravi Pandya \affilnum 2, Ye-Ji Mun \affilnum 3, Katherine Driggs-Campbell \affilnum 3, Andrea Bajcsy \affilnum 2, and Dylan P. Losey \affilnum 1 · 2025
Read A Unified Framework for Robots that Influence Humans over Long-Term Interaction by Shahabedin Sagheb \affilnum 1, Sagar Parekh \affilnum 1, Ravi Pandya \affilnum 2, Ye-Ji Mun \affilnum 3, Katherine Driggs-Campbell \affilnum 3, Andrea Bajcsy \affilnum 2, and Dylan P. Losey \affilnum 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14633.txt.
Introduction
Shahabedin Sagheb and co-authors build a single framework for robots that deliberately influence the people around them over long relationships. A self-driving car easing into a lane so a human driver yields is influence in action. Unchecked, such influence can harm the people nearby. Past methods work in the short term but fade as the person adapts to the robot.
The framework keeps a dynamic model of the human, predicting how today's robot choices shape the person's future behavior. The robot then plans to hold its influence across repeated meetings. The authors show that leading earlier methods are simplified cases of their formalism. When solving the full problem is too costly, designers can add their own simplifications in a principled way. Tests in simulation and with users showed the framework kept influencing people successfully over repeated interactions, where baselines faded.
Catalog record
| CREATOR | Shahabedin Sagheb \affilnum 1, Sagar Parekh \affilnum 1, Ravi Pandya \affilnum 2, Ye-Ji Mun \affilnum 3, Katherine Driggs-Campbell \affilnum 3, Andrea Bajcsy \affilnum 2, and Dylan P. Losey \affilnum 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 99 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-14633
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Unified Framework for Robots that Influence Humans over Long-Term Interaction Shahabedin Sagheb \affilnum 1, Sagar Parekh \affilnum 1, Ravi Pandya \affilnum 2, Ye-Ji Mun \affilnum 3, Katherine Driggs-Campbell \affilnum 3, Andrea Bajcsy \affilnum 2, and Dylan P. Losey \affilnum 1 Abstract Robot actions influence the decisions of nearby humans. Here influence refers to intentional change: robots influence humans when they shift the human’s behavior in a way that helps the robot complete its task. Imagine an autonomous car trying to merge; by proactively nudging into the human’s lane, the robot causes human drivers to yield and provide space. Influence is often necessary for seamless interaction. However, if influence is left unregulated and uncontrolled, robots will negatively impact the humans around them (e.g., autonomous cars that repeatedly merge in front of humans may cause human drivers to become more aggressive). Prior works have begun to address this problem by creating a variety of control algorithms that seek to influence humans. Although these methods are effective in the short-term, they fail to maintain influence over time as the human adapts to the robot’s behaviors. In this paper we therefore present an optimization framework that enables robots to purposely regulate their influence over humans across both short-term and long-term interactions. Here the robot maintains its influence by reasoning over a dynamic human model which captures how the robot’s current choices will impact the human’s future behavior. Our resulting framework serves to unify current approaches: we demonstrate that state-of-the-art methods are simplifications of our underlying formalism. Our framework also provides a principled way to generate influential policies: in the best case the robot exactly solves our framework to find optimal, influential behavior. But when solving this optimization problem becomes impractical, designers can introduce their own simplifications to reach tractable approximations. We experimentally compare our unified framework to state-of-the-art baselines and ablations, and demonstrate across simulations and user studies that this framework is able to successfully influence humans over repeated interactions. See videos of our experiments here: https://youtu.be/nPekTUfUEbo keywords Human-Robot Interaction, Control Theory, Influence, Optimization † † runninghead: Sagheb et al. † † affiliation: \affilnum 1Virginia Tech, Department of Mechanical Engineering \affilnum 2Carnegie Melon University, Robotics Institute \affilnum 3University of Illinois Urbana-Champaign, Department of Electrical and Computer Engineering † † corresponding: Dylan P. Losey, Department of Mechanical Engineering, Virginia Tech, Blacksburg, VA, 24060, USA. 1 Introduction Figure 1: (Left) Human interacting with a drone, a robot arm, and an autonomous car. In each scenario, the robot uses state-of-the-art algorithms to influence the human and change their actions. (Right) Results from online and in-person user studies. The state-of-the-art approaches work in the short-term , i.e., human behavior is influenced by the robot in the first few interactions, but not in the long-term , i.e., over time the participants adapt to avoid or ignore the influential robot. When robots and humans interact, it is inevitable that robot behavior will influence human decisions. Consider an autonomous car moving near a human-driven vehicle. If the autonomous car drives in an aggressive way — e.g., merging directly in front of the human — the human may start to drive more defensively to give the robot space. Conversely, if the autonomous car is consistently defensive — e.g., always yielding to the human — then the human may change their behavior to drive aggressively around the robot. We refer to these robots as influential because they choose actions that i) cause the human’s behavior to shift in a way that ii) increases the robot’s overall performance. On one hand, the ability to influence other agents is what enables autonomous robots to seamlessly coordinate with humans. On the other hand, if the influential behaviors are haphazardly designed, they can have significant consequences. In non-embodied domains, we have already observed the effects of influential artificial intelligence (AI) agents on elections, consumer habits, and popular trends ( Nicas, 2018 ; Hagen et al., 2022 ; Stella et al., 2018 ; Tran et al., 2021 ; Khaund et al., 2021 ) . Embodied robots are not nearly as pervasive as AI agents; but as robots increasingly integrate into human lives, the scale to which they influence human behaviors will continually grow. Consider our example of shared roads — as the number of autonomous vehicles increases, humans have new expectations for how closely they can follow other vehicles, and place more responsibility on autonomous cars for avoiding incidents ( Schneble and Shaw, 2021 ; Marshall, 2018 ; Eliot, 2020 ) . Prior works have accordingly proposed algorithms to control and regulate influential robots. Over short-term interactions current approaches can discourage or encourage human behaviors ( Hong et al., 2023 ; Lazar et al., 2018 ) , change leader and follower roles within a team ( Li et al., 2021 ; Chari et al., 2024 ) , and manipulate the human’s actions to increase the robot’s reward ( Xie et al., 2021 ; Tian et al., 2023 ) . Despite success in short-term and one-off interactions, robots still struggle to regulate the long-term impacts their behaviors have on humans (see Figure 1 ). This stems from a fundamental issue with the way today’s robots model human partners. Prior work on influence typically treats the human as a static agent; i.e., it assumes that the human will always respond to a given robot behavior in a fixed way. Returning to our motivating example, each time the autonomous car merges in front of the human, it predicts that the human will slow down. Accordingly — to influence the speed of the human driver — the autonomous car simply needs to move into the human’s lane. This approach works well the first few times the human interacts with the robot. But gradually the human adapts and their responses shift; for instance, after the autonomous car merges into the human’s lane several times, the human driver may quickly accelerate to pass the autonomous car or prevent it from merging. In this paper, we introduce a unifying formalism for influential robots. Our approach connects prior works that focus on short-term interactions, while also enabling robots to regulate their long-term influence on nearby humans. To achieve this unification, we recognize that static human models are insufficient: robots must account for how humans continually adapt over time. Indeed, relying on any single human model is bound to fail — so we instead propose a control-theoretic framework which accounts for a variety of human responses. Our core hypothesis is that: When robots interact with humans, the robot’s current actions will affect not only the human’s current response, but also the human’s future latent strategy. By applying this hypothesis, we are able to formulate influence as an underactuated dynamical system with an unknown and evolving latent state which parameterizes the human’s strategy. The robot is uncertain about how the human’s latent strategy will change over time, i.e., how the human will adapt to robot actions. However, during interaction, the robot gathers information about the dynamic human model, and updates not only its estimate of the current human, but also how that human will respond in the future. Robots can then leverage this dynamic understanding of the human to select actions that guide the underactuated system towards