Learning to Decide with AI Assistance under Human-Alignment
Nina Corvelo Benz §, Eleni Straitouri †, Manuel Gomez-Rodriguez † · 2026
Read Learning to Decide with AI Assistance under Human-Alignment by Nina Corvelo Benz §, Eleni Straitouri †, Manuel Gomez-Rodriguez † (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12646.txt.
Introduction
Benz, Straitouri and Gomez-Rodriguez study learning to decide with AI help when human and AI confidence align. When AI helps high-stakes decisions by predicting an outcome, it should share prediction confidence. Yet people often struggle to judge when to trust a prediction from confidence alone. Recent work links use of AI-aided decisions to match between AI confidence and people's confidence in their own guesses. The paper asks how far that match shapes learning optimal choices through repeat rounds, in the case of binary guesses and binary choices.
Catalog record
| CREATOR | Nina Corvelo Benz §, Eleni Straitouri †, Manuel Gomez-Rodriguez † |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 98305 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.12646
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning to Decide with AI Assistance under Human-Alignment Nina Corvelo Benz §, Eleni Straitouri †, Manuel Gomez-Rodriguez † Abstract It is widely agreed that when AI models assist decision-makers in high-stakes domains by predicting an outcome of interest, they should communicate the confidence of their predictions. However, empirical evidence suggests that decision-makers often struggle to determine when to trust a prediction based solely on this communicated confidence. In this context, recent theoretical and empirical work suggests a positive correlation between the utility of AI-assisted decision-making and the degree of alignment between the AI confidence and the decision-makers’ confidence in their own predictions. Crucially, these findings do not yet elucidate the extent to which this alignment influences the complexity of learning to make optimal decisions through repeated interactions. In this paper, we address this question in the canonical case of binary predictions and binary decisions. We first show that this problem is equivalent to a two-armed online contextual learning problem with full feedback, and establish a lower bound of Ω ( | ℋ | ⋅ | ℬ | ⋅ T ) \Omega(\sqrt{|\mathcal{H}|\cdot|\mathcal{B}|\cdot T}) on the expected regret any learner can attain, where ℋ \mathcal{H} and ℬ \mathcal{B} denote the sets of human and AI confidence values. We then demonstrate that, under perfect alignment between AI and human confidence, a learner can attain an expected regret of 𝒪 ( | ℋ | ⋅ T log T ) \mathcal{O}(\sqrt{|\mathcal{H}|\cdot T\log T}) and, when | ℋ | = 𝒪 ( log T ) \sqrt{|\mathcal{H}|}=\mathcal{O}(\log T) and ℬ \mathcal{B} is countable, a non-trivial generalization of the Dvoretzky-Kiefer-Wolfowitz inequality improves the regret bound to 𝒪 ( T log T ) \mathcal{O}(\sqrt{T\log T}) . Taken together, these results reveal that alignment can reduce the complexity of learning to make decisions with AI assistance. Experiments on real data from two different human-subject studies where participants solve simple decision-making tasks assisted by AI models show that our theoretical results are robust to violations of perfect alignment. 1 Introduction The promise of AI-based decision support systems is that human experts using these systems will make better decisions than human experts not using them. However, multiple lines of empirical evidence across various domains suggest that this promise has not yet been reliably realized ( 47 ; 51 ; 41 ; 27 ) . In the canonical case of binary predictions and binary decisions, 8 ; 9 have recently argued both theoretically and empirically that the way in which AI models quantify and communicate confidence in their predictions is one of the reasons AI-assisted decision making falls short. First, they have shown that, if an AI model uses calibrated estimates of the probability that the prediction is correct as AI confidence values—as commonly done ( 15 ; 49 ; 17 ; 19 ; 23 ; 45 ) —a (rational) human expert who places more (less) trust on predictions with higher (lower) AI confidence may never make provably optimal decisions. Second, they have provided empirical evidence that closer alignment between AI and human confidence correlates with higher utility in AI-assisted decision making. Crucially, the aforementioned results do not yet elucidate the extent to which the alignment between AI and human confidence influences the complexity of learning to make (optimal) decisions through repeated interactions ( 31 ; 5 ; 32 ; 21 ) . In this paper, we start closing this gap. Our contributions. We first show that, in the canonical case of binary predictions and binary decisions, the problem of learning to make decisions with AI assistance through repeated interactions is equivalent to a two-armed online contextual learning problem with full feedback ( 37 ) . Using this equivalence, we establish a lower bound of \Omega(\sqrt{|\mathcal{H}|\cdot|\mathcal{B}|\cdot T}) on the expected regret any learner can attain in solving the problem, where \mathcal{H} and \mathcal{B} denote the sets of human and AI confidence values. Further, we derive a simple online learning algorithm that, under perfect alignment between AI and human confidence, is guaranteed to attain an expected regret of \mathcal{O}(\sqrt{|\mathcal{H}|\cdot T\log T}) . Additionally, when \sqrt{|\mathcal{H}|}=\mathcal{O}(\log T) and \mathcal{B} is countable, we show that a non-trivial generalization of the Dvoretzky-Kiefer-Wolfowitz (DKW) inequality ( 12 ; 29 ) improves the regret bound to \mathcal{O}(\sqrt{T\log T}) . Taken together, our theoretical results reveal that alignment between AI and human confidence can reduce the complexity of learning to make decisions with AI assistance. Finally, we complement our theoretical results with experiments on real data from two different human-subject studies where participants solve simple decision-making tasks assisted by AI models ( 43 ; 9 ) . The experiments demonstrate that our theoretical results are robust to violations of perfect alignment—a learner who assumes perfect alignment can achieve lower expected regret than one making no such assumption, provided that a weaker notion of alignment holds. Further related work. Our work builds upon a rapidly increasing literature on AI-assisted decision making (see 27 for a recent review). More specifically, it is motivated by several empirical studies showing that decision-makers have difficulties in modulating trust using confidence values ( 44 ; 48 ; 40 ; 39 ; 38 ; 10 ; 16 ; 11 ) . In this context, we should also note that other studies have analyzed how additional context, such as model explanations and accuracy, can help modulate trust ( 34 ; 46 ; 47 ; 33 ; 51 ; 18 ; 24 ; 30 ) . Our work also builds upon the vast literature of multi-armed bandits (see 37 for a recent review). Within this literature, the DKW inequality has been used to derive regret bounds in settings in which the objective requires precise estimation of the entire reward distribution ( 6 ; 25 ; 26 ; 3 ; 22 ) , such as the conditional value at risk (CVaR). However, to the best of our knowledge, the DKW inequality has not been used to derive improved average regret bounds in contextual settings in which the optimal decision policy satisfies a monotonicity property with respect to the context as in our work. 2 Learning to Decide with AI Assistance In this section, we first revisit the AI-assisted decision making task we focus in our work, which has also been studied elsewhere ( 8 ; 9 ) . Then, in the context of this task, we introduce the problem of learning an optimal decision policy through repeated interactions, and characterize its complexity. 2.1 AI-Assisted Decision Making with Binary Predictions and Binary Decisions We consider an AI-assisted decision making task where, for each realization of the task, a decision maker first observes a set of features (x,v)\in\mathcal{X}\times\mathcal{V} , then takes a binary decision a\in\{0,1\} informed by a classifier’s prediction \hat{y}=\mathop{\mathrm{argmax}}_{y}f_{y}(x) , as well as confidence f_{\hat{y}}(x)\in\mathcal{B}\subseteq[0,1] , of a binary label of interest y\in\{0,1\} , and finally receives a utility u(a,y)\in\mathbb{R} . Such an AI-assisted decision making process fits a variety of real-world applications. For example, in medical treatment, the features (x,v) may comprise multiple sources of information regarding a patient’s health 1 1 1 Our formulation allows for a subset of the features v to be available only to the decision maker but not to the classifier. , the label y