The Impact and Feasibility of Self-Confidence Shaping for AI-Assisted Decision-Making

Takehiro Takayanagi, Ryuji Hashimoto, Chung-Chi Chen, Kiyoshi Izumi · 2025

Read The Impact and Feasibility of Self-Confidence Shaping for AI-Assisted Decision-Making by Takehiro Takayanagi, Ryuji Hashimoto, Chung-Chi Chen, Kiyoshi Izumi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14311.txt.

Introduction

Takehiro Takayanagi and co-authors present a computing study from 2025 on human trust in smart advice. People working with a model must gauge their own confidence to know when to lean on it. The team tested shaping that confidence toward a set target level.

In trials with 121 people, shaping lifted team performance by nearly half. It trimmed both blind trust and needless doubt. A side task asked if software can spot when shaping is needed. Simple models guessed a user's confidence with sixty-seven percent accuracy. Mood in the user's text tracked confidence too, hinting that tone edits could shape it. The authors map next steps toward real-world use in finance and health settings.

Catalog record

CREATORTakehiro Takayanagi, Ryuji Hashimoto, Chung-Chi Chen, Kiyoshi Izumi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-14311

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Impact and Feasibility of Self-Confidence Shaping for AI-Assisted Decision-Making Takehiro Takayanagi, Ryuji Hashimoto, Chung-Chi Chen, Kiyoshi Izumi Abstract In AI-assisted decision-making, it is crucial but challenging for humans to appropriately rely on AI, especially in high-stakes domains such as finance and healthcare. This paper addresses this problem from a human-centered perspective by presenting an intervention for self-confidence shaping , designed to calibrate self-confidence at a targeted level. We first demonstrate the impact of self-confidence shaping by quantifying the upper-bound improvement in human-AI team performance. Our behavioral experiments with 121 participants show that self-confidence shaping can improve human-AI team performance by nearly 50% by mitigating both over- and under-reliance on AI. 1 1 1 The experimental protocol was approved by our organization’s ethical board We then introduce a self-confidence prediction task to identify when our intervention is needed. Our results show that simple machine-learning models achieve 67% accuracy in predicting self-confidence. We further illustrate the feasibility of such interventions. The observed relationship between sentiment and self-confidence suggests that modifying sentiment could be a viable strategy for shaping self-confidence. Finally, we outline future research directions to support the deployment of self-confidence shaping in a real-world scenario for effective human-AI collaboration. 1 Introduction Artificial Intelligence (AI) technologies have become ubiquitous and are adopted across diverse areas of society, leading to an increasing reliance on AI recommendations in decision-making. Yet, in high-stakes domains such as finance and healthcare, where safety, ethical, and legal obligations remain paramount, full automation can be problematic, while purely manual approaches risk inefficiency and inaccuracy. Consequently, AI-assisted decision-making has emerged as a promising paradigm, which augments human judgment with AI recommendations Lai and Tan (2019) ; Lai et al. (2023) ; Debic and Medvidovic (2024) . A central challenge in this paradigm is ensuring appropriate reliance on AI Schemmer et al. (2023) . Over-reliance can degrade outcomes if the model or data are flawed, while under-reliance means ignoring beneficial advice. To address this, prior research has primarily focused on AI-centric interventions , such as providing confidence scores, or explanations for AI predictions Yin et al. (2019) ; Zhang et al. (2020) ; Bansal et al. (2019) . Beyond AI-centric interventions, prior studies emphasize that human self-confidence is key to proper reliance. However, human self-confidence is often treated as a fixed factor Mahmood et al. (2024) ; Chong et al. (2022) . This perspective overlooks the potential for a human-centric intervention to shape human self-confidence and mitigate both over- and under-reliance. Consequently, this represents a largely underexplored avenue for improving AI-assisted decision-making. Figure 1: Conceptual illustration of the two-round procedure: 1 st round , independent judgment; 2 nd round , final team decision with AI recommendation. In this paper, we take an initial step toward enhancing AI-assisted decision-making through self-confidence shaping . 2 2 2 We define self-confidence shaping as the deliberate intervention to shape a decision-maker’s confidence at a targeted level. This differs from confidence calibration, which aligns a user’s confidence with their actual performance Moore (2020) . First, we quantify the potential gains in human-AI team performance under ideal conditions where self-confidence is perfectly controlled. Next, we introduce a self-confidence prediction task to determine when our intervention is needed, assessing how accurately a decision-maker’s (DM) self-confidence can be predicted based on user traits and task characteristics. Finally, we explore the feasibility of this intervention by investigating the relationship between task features and self-confidence. In particular, drawing on decision science research that demonstrates how subtle shifts in sentiment in a text can significantly influence self-confidence Griffin and Tversky (1992) , we examine how modifying sentiment may serve as an initial step toward effective self-confidence shaping. To summarize, we explore the following questions. • RQ1: Under perfect control over self-confidence, how much can human-AI team performance improve through self-confidence shaping? • RQ2: To what extent can we predict self-confidence in decision-making? • RQ3: Is the sentiment significantly associated with self-confidence? To address these questions, we developed an AI-assisted investment decision-making task in a financial context, recruited 121 crowd workers, and collected 2,420 decision instances. Adopting the Judge-Advisor System (JAS) for decision-making Sniezek and Buckley (1995) , our experiments consist of two rounds: (1) participants first form an independent prediction, and (2) they make the final decision after considering the AI recommendation, as illustrated in Figure 1 . Our results show that successful self-confidence shaping can significantly improve human-AI team performance. In particular, our scenario analyses reveal that shaping self-confidence can reduce both over- and under-reliance on AI recommendations, improving team performance by up to nearly 50%. Moreover, our findings suggest that such intervention is indeed feasible: simple machine learning models that incorporate user traits and task characteristics can predict whether self-confidence is high or low with about 67% accuracy. We also observe that the sentiment in a text is significantly associated with self-confidence. 2 Related Work 2.1 Appropriate Reliance in AI-assisted Decision-Making A challenge for improving human-AI team performance in AI-assisted decision-making is ensuring humans’ appropriate reliance on AI, given the uncertainties of both humans and AI Schemmer et al. (2023) ; Bansal et al. (2021) ; Buçinca et al. (2021) ; Lai et al. (2023) . Over-reliance on AI can degrade human-AI decision-making if the model is flawed or data is unreliable. Conversely, under-reliance occurs when humans ignore correct AI advice, missing opportunities to improve performance. To encourage appropriate reliance, prior research has primarily focused on AI-centric design interventions Zhang et al. (2020) . In particular, displaying AI confidence levels has been proposed to help users gauge the likelihood of correct predictions Zhang et al. (2020) ; Vodrahalli et al. (2022b) ; Ma et al. (2023) . Additionally, elucidating the rationale behind AI outputs through explanations remains a widely studied approach to foster appropriate reliance Zhang et al. (2020) ; Bansal et al. (2021) ; Wang and Yin (2021) ; Li and Yin (2024) . Nonetheless, these AI-centric interventions show mixed results, indicating that they do not always lead to improved human-AI collaboration Zhang et al. (2020) ; Ma et al. (2023) ; Zhao et al. (2024) . As a result, there has been a growing focus on human self-confidence, which constitutes another key element of appropriate reliance Chong et al. (2022) ; Vodrahalli et al. (2022a) ; Ma et al. (2024) ; Mahmood et al. (2024) . Prior studies highlight the pivotal role of human DMs’ self-confidence in the adoption of AI recommendations Chong et al. (2022) . However, self-confidence is often treated as a fixed factor, overlooking how it can be shaped to mitigate over- and under-reliance. Therefore, in this work, we propose that self-confidence shaping could serve as a viable method for enhancing human-AI team performance. 2.2 AI-Assisted Decision-Making in Financial Context Finance is a significant domain for AI-assisted decision-making, as evidenced by the substantial body of literature on the topic Hase and Bansal (2020) ; Zhang et al. (2020) ; Li and Yin (2024) ; Vodrahalli et al. (2022b) . Its high-stakes nature, where mistakes can lead to significant losses Lai et al. (2023) ; Biran and McKeown (2017) , combined with the frequent overconfidence of DMs Barber and Odean (2001) ; Grežo (2021) , makes it an ideal setting for our study on self-confidence

Read the complete text