Actual Achieved Gain and Optimal Perceived Gain: Modeling Human Take-over Decisions Towards Automated Vehicles’ Suggestions
Shuning Zhang, Xin Yi, Shixuan Li, Chuye Hong, Gujun Chen, Jiarui Liu, Xueyang Wang, Yongquan Hu, Yuntao Wang, Hewu Li · 2025
Read Actual Achieved Gain and Optimal Perceived Gain: Modeling Human Take-over Decisions Towards Automated Vehicles’ Suggestions by Shuning Zhang, Xin Yi, Shixuan Li, Chuye Hong, Gujun Chen, Jiarui Liu, Xueyang Wang, Yongquan Hu, Yuntao Wang, Hewu Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-06179.txt.
Introduction
Shuning Zhang and nine co-authors model the split-second choice a driver makes when a self-driving system suggests an action. Taking over well is central to safe cooperation between humans and automated vehicles, yet the quality of those decisions had not been dissected. The team defines two scores: the gain a driver actually achieves, and the gain an optimal judge would perceive, both weighted by how accurate the system is.
A first study of 315 people measured perceived gains and losses for route choice, overtaking, and collision avoidance. Two smaller studies then varied system accuracy and decision time. Given more than about three and a half seconds, actual decisions converged toward optimal ones; under time pressure, drivers fell back on intuition and fixed habits. Small trials with voice and multi-modal alarms, triggered by deviations from optimal choices, showed the scores can guide interventions that improve decisions.
Catalog record
| CREATOR | Shuning Zhang, Xin Yi, Shixuan Li, Chuye Hong, Gujun Chen, Jiarui Liu, Xueyang Wang, Yongquan Hu, Yuntao Wang, Hewu Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-06179
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Actual Achieved Gain and Optimal Perceived Gain: Modeling Human Take-over Decisions Towards Automated Vehicles’ Suggestions Shuning Zhang, Xin Yi, Shixuan Li, Chuye Hong, Gujun Chen, Jiarui Liu, Xueyang Wang, Yongquan Hu, Yuntao Wang, Hewu Li Abstract . Driver decision quality in take-overs is critical for effective human-Autonomous Driving System (ADS) collaboration. However, current research lacks detailed analysis of its variations. This paper introduces two metrics–Actual Achieved Gain (AAG) and Optimal Perceived Gain (OPG)–to assess decision quality, with OPG representing optimal decisions and AAG reflecting actual outcomes. Both are calculated as weighted averages of perceived gains and losses, influenced by ADS accuracy. Study 1 (N=315) used a 21-point Thurstone scale to measure perceived gains and losses—key components of AAG and OPG—across typical tasks: route selection, overtaking, and collision avoidance. Studies 2 (N=54) and 3 (N=54) modeled decision quality under varying ADS accuracy and decision time. Results show with sufficient time (>3.5s), AAG converges towards OPG, indicating rational decision-making, while limited time leads to intuitive and deterministic choices. Study 3 also linked AAG-OPG deviations to irrational behaviors. An intervention study (N=8) and a pilot (N=4) employing voice alarms and multi-modal alarms based on these deviations demonstrated AAG’s potential to improve decision quality. Conference: CHI Conference on Human Factors in Computing Systems; April 26-May 1, 2025; Yokohama, Japan CHI Conference on Human Factors in Computing Systems (CHI ’25), April 26-May 1, 2025, Yokohama, Japan DOI: 10.1145/3706598.3713707. ISBN: 979-8-4007-1394-1/25/04 CCS: Human-centered computing Empirical studies in HCI CCS: Human-centered computing Empirical studies in collaborative and social computing CCS: Human-centered computing Collaborative and social computing theory, concepts and paradigms Figure 1. The research framework of this paper. † † cc-license: by 1. Introduction Although automated vehicles (AVs) have made significant progress and can handle various driving scenarios ( Hancock et al., 2020 ) , they still face challenges in managing all road situations. As a result, human drivers must occasionally take control, especially in complex or unexpected scenarios where AV systems reach their limits ( Du et al., 2020 ) . This ongoing need for human intervention highlights its essential role in human-vehicle collaboration during AVs’ transition towards full autonomy. Most research on automated driving focuses on full transfer of control when systems reach their operational limits ( Zhang et al., 2019 ; Bazilinskyy et al., 2018 ) . However, the take-over process is often suboptimal due to human factors, such as reduced situational awareness ( Vlakveld et al., 2018 ) . Walch et al. ( Walch et al., 2017b ) proposed cooperative interfaces to address these challenges, emphasizing mutual predictability, control, shared awareness, and calibrated trust. While studies have examined trust calibration ( Akash et al., 2020 ; Kraus et al., 2020 ) , situational awareness ( Woide et al., 2022 ; Walch et al., 2019 ) , and control ( Colley et al., 2021 ) , mutual predictability, particularly the ability of AVs to predict driver behavior, remains under-explored. Previous studies on mutual predictability have mainly examined the quality of drivers’ take-over under various conditions, using metrics like acceleration ( Lee et al., 2021 ) , deviation distance ( Pakdamanian et al., 2021 ) , and subjective reports ( Du et al., 2020 ) after the take-over. However, these studies overlook the crucial role of decision-making before the actual control. These decisions are crucial for responding safely and effectively to ADS suggestions, especially in scenarios where the driver only partially takes over and relies on ADS support or road analysis ( Walch et al., 2016 ) . In such cases, decision quality becomes a key factor, as it directly impacts the outcome. Therefore, this paper aims to quantitatively model the quality of drivers’ decision-making during take-over in response to ADS suggestions. We conceptualized human and ADS decision-making as a collaborative system, aiming for optimal collaborative outcomes. As control shifts to human drivers, their thoughts and decisions directly influence the take-over quality. To predict real-time take-over quality without relying on post-hoc ground-truth, we propose evaluating outcomes based on drivers’ perceptions of benefits and risks, offering a new perspective. As decision-making quality may be influenced by factors like time ( Wan and Wu, 2018 ) , take type ( Radlmayr et al., 2014 ) and ADS accuracy ( Wan and Wu, 2018 ) , we selected these factors for their representativeness of human decision-making, ADS performance, and environmental conditions. We examined the effects of these key factors on take-over quality to validate our proposed metrics. This leads to the following research questions: RQ1. How to establish quantitative metrics grounded in the human-ADS collaboration perspective to assess drivers’ decision-making quality during the take-over process? RQ2. How do time, task and ADS accuracy factors influence drivers’ take-over decision quality? RQ3. How to improve drivers’ take-over decision quality leveraging the proposed quantitative metrics? To address RQ1, we developed a pair of correlated metrics—Actual Achieved Gain (AAG) and Optimal Perceived Gain (OPG)—to assess the quality of human decisions in response to ADS suggestions. OPG, grounded in game theory and the concepts of perceived gain and loss, represents the optimal decisions drivers make to maximize perceived gains across various scenarios. Perceived gains and losses serve as indicators of decision quality, reflecting participants’ value judgments. It is calculated as the maximum weighted sum of perceived gains and losses for each scenario, with weights determined as the ADS accuracy and the sum encompassing all possible decision behaviors. The evaluation of perceived gain and loss utilizes a 21-point Thurstone scale based on behavioral economics principles ( Mohring, 1971 ; Kahneman and Tversky, 2013 ) , and reflects participant preferences. However, due to time constraints, drivers often struggle to make fully rational decisions. Therefore, we proposed AAG to quantify the actual value drivers achieve through their decisions, capturing potential deviations from OPG. In Study 1, we measured perceived gain and loss across three typical take-over tasks with varying safety risks: Route Selection ( Sheng et al., 2021 ) , Overtaking ( Gold et al., 2015 ; Borojeni et al., 2016 ; Lin et al., 2020 ; Zeeb et al., 2015 ) and Avoiding Collision with Other Cars ( Louw and Merat, 2017 ; Pampel et al., 2019 ; Melcher et al., 2015 ) . These parameters are integral to AAG and OPG, linking human cognition with decision-making and ADS suggestions. Our findings reveal that perceived gain and loss vary by task, with safety-preserving decisions (e.g., avoiding collisions when suggested so) showing significantly higher perceived gain and loss than others (e.g., taking a shorter route when suggested so), indicating a tendency towards risk aversion and follow-the-suggestion behavior ( Rabin, 2013 ) . To address RQ2, Studies 2 and 3 investigated the effectiveness of AAG and OPG under conditions of sufficient and insufficient decision-making time. Study 2 manipulated ADS accuracy and task factors . Using the CARLA simulator ( Dosovitskiy et al., 2017 ) , we constructed automated driving scenarios with varying levels of ADS accuracy and decision-making time to assess drivers’ decisions responses to ADS suggestions. The results indicated that given sufficient time, drivers’ AAG converged towards OPG, reflecting drivers made optimal decisions aimed at maximizing gains. Study 3, on the other hand, varied time and task factors to explore scenarios where decision-making time was insufficient.