Blending Participatory Design and Artificial Awareness for Trustworthy Autonomous Vehicles

Ana Tanevska, Ananthapathmanabhan Ratheesh Kumar, Arabinda Ghosh, Ernesto Casablanca, Ginevra Castellano, Sadegh Soudjani · 2025

Read Blending Participatory Design and Artificial Awareness for Trustworthy Autonomous Vehicles by Ana Tanevska, Ananthapathmanabhan Ratheesh Kumar, Arabinda Ghosh, Ernesto Casablanca, Ginevra Castellano, Sadegh Soudjani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07633.txt.

Introduction

Ana Tanevska and five co-authors model how human drivers react to self-driving cars at varied transparency levels. Their paper from twenty twenty-five grows from the SymAware project on artificial awareness for vehicle and drone teams. Trust between people and agents is the design target. A large user study on human-car interaction supplies the data for the model.

Drivers faced scenarios that varied the car's openness, the setting, and their own traits. Behavior shifts with all three factors in the data. Markov chain models distilled from the runs capture those shift patterns. The chains are meant to plug into the awareness architecture as its human module. The authors frame participatory data as the ground for trustworthy autonomy. Findings stress that one transparency setting will not fit all drivers.

Catalog record

CREATORAna Tanevska, Ananthapathmanabhan Ratheesh Kumar, Arabinda Ghosh, Ernesto Casablanca, Ginevra Castellano, Sadegh Soudjani
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-07633

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Blending Participatory Design and Artificial Awareness for Trustworthy Autonomous Vehicles Ana Tanevska, Ananthapathmanabhan Ratheesh Kumar, Arabinda Ghosh, Ernesto Casablanca, Ginevra Castellano, Sadegh Soudjani Abstract Current robotic agents, such as autonomous vehicles (AVs) and drones, need to deal with uncertain real-world environments with appropriate situational awareness (SA), risk awareness, coordination, and decision-making. The SymAware project strives to address this issue by designing an architecture for artificial awareness in multi-agent systems, enabling safe collaboration of autonomous vehicles and drones. However, these agents will also need to interact with human users (drivers, pedestrians, drone operators), which in turn requires an understanding of how to model the human in the interaction scenario, and how to foster trust and transparency between the agent and the human. In this work, we aim to create a data-driven model of a human driver to be integrated into our SA architecture, grounding our research in the principles of trustworthy human-agent interaction. To collect the data necessary for creating the model, we conducted a large-scale user-centered study on human-AV interaction, in which we investigate the interaction between the AV’s transparency and the users’ behavior. The contributions of this paper are twofold: First, we illustrate in detail our human-AV study and its findings, and second we present the resulting Markov chain models of the human driver computed from the study’s data. Our results show that depending on the AV’s transparency, the scenario’s environment, and the users’ demographics, we can obtain significant differences in the model’s transitions. I Introduction “Awareness” refers to the capacity of an agent to detect, interpret, and respond to changes in its environment, both internal and external. In autonomous agent based systems, awareness involves monitoring the operational context, identifying relevant events, and adapting behavior based on the situation. As these systems are increasingly deployed in real-world safety critical scenarios involving humans, incorporating awareness becomes essential [ 1 ] . Fig. 1: A complex urban intersection scenario illustrating the autonomous systems interacting with pedestrians, emergency vehicle and human-driven cars. Image generated using DALL-E. Applications such as intelligent transportation rely on multiple agents collaborating to accomplish shared objectives. This collaborative framework is referred to as multi-agent systems (MASs), which can consist of physical robots or virtual agents [ 2 ] . Introducing awareness to artificial agents within a MAS scenario serves multiple objectives: awareness drives the agents to perceive and understand the intentions, actions, and states of other agents in the system; and enables them to exhibit cooperative behavior, coordinating their actions and collaborating towards common goals efficiently and effectively [ 3 , 4 ] . Awareness in MASs helps to develop adaptive decision-making [ 5 ] and facilitate task allocation and resource management among the agents by efficiently planning and executing the tasks while resolving conflicts [ 6 ] . The ability to effectively communicate and exchange information with other agents and the environments also assists the agents in achieving their objectives. The communication process within a MAS can take various forms, such as message passing, shared memory, negotiation and agreement protocols, ontologies and semantic communication, and perception-based exchanges [ 7 ] . Integrating this communication process can foster a sense of autonomy among the agents in the MAS (as well as between different MASs). While current MAS architectures focus on inter-agent awareness, an equally important challenge is enabling effective human-agent interaction. For instance, Fig. 1 illustrates a critical urban road intersection scenario involving an autonomous vehicle, an ambulance, a regular car, a cyclist, pedestrians, and a child. In such settings, autonomous agents must not only coordinate with other vehicles and infrastructure but also interpret and respond to human behavior in real time. Effective interaction with human users, whether they are drivers, pedestrians, or cyclists, is essential for ensuring the safety of all participants, and maintaining the users’ trust in the autonomous systems. With our research, we attempt to address precisely this issue, namely: how can artificial agents in a MAS communicate with human agents in a trustworthy manner? We aim to bridge the gap between current research on designing and implementing MAS architectures which are centered around the artificial agents’ capabilities, and the existing human-agent/human-robot interaction (HAI/HRI) research on designing trustworthy, user-centered interaction. A first step towards building this interaction can be to incorporate a model of human agents into the MAS architecture of the artifical agent. This in turn requires an understanding of people’s intentions and behaviors [ 8 , 9 ] , which can be obtained through user-centered studies [ 10 ] . Moreover, as user behavior is also affected by various aspects of the autonomous agent, we need to also consider the requirements for building a trustworthy and ethical HAI, and investigate how the agent’s autonomy will impact the human, as well as which HAI parameters will have the highest impact on the user’s sense of trust in the agent [ 11 , 12 ] . We begin our study design from the existing guidelines on trustworthy and ethical HAI [ 13 ] , and then proceed to explore specifically the trustworthy concepts of agent transparency and user oversight and agency . From these two concepts, we define the research questions to be addressed in our work: • How can human users be in the loop and monitor the interaction? (which will explore the agent’s transparency and the information it shares with the human.) • To what extent should the agent act autonomously? (which will explore the interplay between the agent’s autonomy and the user’s preferences.) The first interaction scenario we are working with is the one between an autonomous vehicle (AV) and a human in the role of its driver. Our study’s design is informed from a prior participatory workshop [ 14 ] on driver-AV interaction, where users experienced two different scenarios as an AV driver. In it, we manipulated the level of information the AV provided to the participants, and we tried to understand how the AV’s transparency interacts with the users’ sense of agency, as represented by the amount of autonomy users were willing to grant to the AV. In this paper, we aim to create a data-driven model of a human driver to be integrated in our situational awareness (SA) architecture, grounding our research in the principles of trustworthy HAI. To collect the data necessary for creating the model, we conduct a large-scale user-centered study on human-AV interaction, in which we investigate the interaction between the AV’s transparency and the users’ behavior. Our contributions with this research are twofold: we illustrate in detail our human-AV study and its findings, and we present the resulting Markov chain model of the human driver computed from the study’s data. The rest of the paper is organized as follows: Section II presents our MAS architecture for situational awareness, Section III presents our human-AV study on transparency and user behavior, Section IV presents the data analysis and building of the user model, and finally Section V summarizes our findings and outlines our next steps. II MAS Architecture for Situational Awareness Fig. 2: The SymAware architecture provides insights into the internal structure of an agent i , which interacts with another agent j through the communication module. Designing effective MASs requires a structured architectural approach that enables

Read the complete text