Failing to Falsify: Evaluating and Mitigating Confirmation Bias in Language Models Ayush Rajesh Jhaveri, Anthony GX-Chen, Ilia Sucholutsky, Eunsol Choi Abstract Confirmation bias, the tendency to seek evidence that supports rather than challenges one’s belief, hinders one’s reasoning ability. We examine whether large language models (LLMs) exhibit confirmation bias by adapting the rule-discovery study from human psychology: given a sequence of three numbers (a “triple”), an agent engages in an interactive feedback loop where it (1) proposes a new triple, (2) receives feedback on whether it satisfies the hidden rule, and (3) guesses the rule. Across eleven LLMs of multiple families and scales, we find that LLMs exhibit confirmation bias, often proposing triples to confirm their hypothesis rather than trying to falsify it. This leads to slower and less frequent discovery of the hidden rule. We further explore intervention strategies (e.g., encouraging the agent to consider counter examples) developed for humans. We find prompting LLMs with such instruction consistently decreases confirmation bias in LLMs, improving rule discovery rates from 42% to 56% on average. Lastly, we mitigate confirmation bias by distilling intervention-induced behavior into LLMs, showing promising generalization to a new task, the Blicket test. Our work shows that confirmation bias is a limitation of LLMs in hypothesis exploration, and that it can be mitigated via injecting interventions designed for humans. 1 Introduction Humans often form an initial hypothesis and then seek evidence that supports their hypothesis rather than refutes it ( 20 ) . For example, a hiring manager who believes that a particular demographic tends to perform better may keep hiring from that group and interpreting positive outcomes as confirmation. Such selective exploration, known as confirmation bias , leads to inefficient learning and decision-making. Figure 1 exemplifies such a scenario in a rule-discovery task ( 30 ) , where consistently using confirmatory examples leads to failed rule discovery. Figure 1: Confirmation bias leads to narrow exploration. We show two trajectories for rule discovery task, where an agent aims to infer a hidden numerical rule over multiple turns. Starting from an initial triple, the agent guess a hypothesis and test a new triple, receiving binary feedback on whether the proposed triple satisfies the hidden rule. A compatible test is consistent with the agent’s current hypothesis, whereas an incompatible test contradicts it. Trajectory 2 proposes compatible tests in both turns, showing confirmation bias. In contrast, Trajectory 1 introduces incompatible test in the second turn, allowing elimination of incorrect hypothesis and lead to correct hidden rule discovery. We aim to understand confirmation bias for large language models (LLMs) acting as agents ( 34 ; 29 ; 26 ) . In these scenarios, LLMs perform tasks that require exploratory reasoning: generating hypotheses, testing them, and refining beliefs in iterative loops. An agent that only verifies its current guess will be suboptimal compared to an agent which also seeks evidence that can falsify its current guess. To this end, we adapt a simplified rule discovery study in humans ( 30 ) . We synthetically generate large-scale data, where an initial triple can match multiple valid rules. We then evaluate the LLMs’ ability to identify the hidden rule by proposing and testing new triples. This setup enables step-by-step observation of how models generate evidence and revise hypotheses. We further quantify a model’s confirmation bias by measuring the ratio between incompatible and compatible tests it proposes. We experiment with eleven LLMs of different families and scales. Models exhibit varying extents of confirmation bias and task success rates (from 6% to 78%, within a maximum turn limit of 45 interactions). We find recent LLMs with longer reasoning traces ( 24 ; 33 ) show much stronger performance, as well as lower confirmation bias. As was in humans, we observe a negative correlation between the extent of confirmation bias and task success rates. We then study methods to decrease confirmation bias, using two well-established interventions originally developed for humans: Dual-Goal ( 11 ) and Think-in-Opposites ( 5 ) . Prompting LLMs with these strategies leads to meaningful performance gains. We then investigate whether fine-tuning LLMs via symbolic knowledge distillation ( 31 ) to directly use these intervention strategies helps decrease confirmation bias, alleviating the need for task-specific inference-time interventions. Finally, We study if the fine-tuned models can generalize to a new domain: the Blicket Test ( 12 ) . We again confirm that a naive model can exhibit confirmation bias, which also correlates with low performance in this new task. However, a model fine-tuned on the original task exhibits generalization of its behavior, leading to lower confirmation bias and improved task success without any additional fine-tuning or prompting. Together, our framework enables studying whether LLMs exhibit confirmation bias during hypothesis exploration. Intervention studies further present promising results in how psychologically inspired framings can reduce this bias and improve task performance. By internalizing debiasing behaviors through symbolic knowledge distillation, our work lays the groundwork for studying how reductions in confirmation bias generalize beyond rule-discovery settings to broader reasoning tasks. 2 Background 2.1 Wason’s 2–4–6 Study Setting Human participants were shown the triple of integers (i.e., 2-4-6 ), told it conformed to a hidden rule, and asked to discover that rule by proposing new triples. After each proposal, an experimenter responded YES or NO , indicating whether the proposed triple conformed to the hidden rule. Participants could guess the rule at any time; incorrect guesses did not terminate the experiment. The experiment continued until the participant correctly guessed the rule, expressed a wish to give up, or the session time limit (45 minutes) was reached. Measuring Confirmation Bias Confirmation bias was quantified by measuring the ratio between the number of turns when a participant tests triples that contradict ( incompatible ) versus confirm ( compatible ) their current hypothesis. Higher ratios indicate more disconfirmatory testing and thus lower confirmation bias. Results The study included 29 participants. 6/29 participants announced the correct rule on their first attempt, and 21/29 eventually discovered the correct rule. Participants who were correct on their first announcement exhibited more disconfirmatory exploration, with a mean I:C of 1.79 , compared to 0.24 for those whose first announcement was incorrect. Among who initially failed, those who succeeded on the second announcement showed a higher I:C ( 0.50 ) than those who did not ( 0.19 ). These results show that in humans, higher I:C correlates with earlier and more frequent rule discovery. LLM study Recent relevant work ( 3 ) adapted this study to evaluate multi-turn reasoning in LLMs. Here, each episode initializes a hidden Boolean rule over three numbers, and the model may propose up to 30 test triples, receiving binary feedback before making a rule guess. They report the guessing accuracy, framing it as a small-scale evaluation benchmark (N=50) for reasoning and hypothesis exploration abilities for LLMs without focusing specifically on confirmation bias. They find that the LLMs they evaluated did not perform competitively, at best achieving 26% task success rate. We expand this approach substantially by introducing a larger-scale dataset and a framework to measure the confirmation bias. We use this framework to study mitigation strategies for reducing LLM confirmation bias and improving performance. 2.2 Intervention to Decrease Confirmation Bias We describe two debiasing interventions from prior human studies that are designed to reduce confirmation bias in Wason’s 2-4-6 task. Think-in-Opposites ( 5 ) introduces a metacognitive strategy to reduce confirmation bias. Specifically, participants are instructed to identify a salient feature of the example and then deliberately test an instance that is “opposite” with respect to that feature. Dual-Goal ( 11 ) rephrases the task to guess two rules: the DAX rule (original rule) and the MED rule, which is the complement of the DAX rule. This encourages humans to test both confirmatory (DAX) and disconfirmatory (MED) triples, reducing confirmation bias. 3 Our Framework to Identify Confirmation Bias in LLM Notation Summary - Episode e A full sequence of rule discovery game: input followed by 45 guess–test–feedbacks turns - Input ( \mathbf{x}_{\text{ini}} , \mathbf{r}^{*} ) (Initial triple of integers, Hidden rule) - Guess \mathbf{r}_{i} Model’s guessed rule at turn i - Test \mathbf{x}_{i} Triple of integers proposed at test turn i - Feedback y_{i}=\mathbf{r_{i}}(\mathbf{x_{i}}) A binary label whether triple \mathbf{x_{i}} conforms to rule \mathbf{r_{i}} - First correct turn t_{e}^{\star} Turn index of the first correct rule announcement in episode e , if any Setting We simulate a multi-turn reasoning game for LLMs. Each game scenario consists of an initial triple of integers ( \mathbf{x}_{\text{ini}} ) and a hidden rule \mathbf{r}^{*} . Initially, the LLM is given \mathbf{x}_{\text{ini}} and the task instruction. 1 1 1 The full task instruction can be found in Appendix B . Then, LLM takes Guess and Test turns. On i -th Guess turn, the LLM states the guessed hidden rule \mathbf{r}_{i} in text; on the subsequent ( i -th) Test turn, it proposes a new triple \mathbf{x}_{i} for evaluation. We denote that a triple \mathbf{x} conforms to a rule \mathbf{r} as \mathbf{r}(\mathbf{x})=1 , and \mathbf{r}(\mathbf{x})=0 otherwise. Then, the environment provides binary feedback y_{i} whether the proposed triple conforms to the hidden rule ( \mathbf{r_{i}}(\mathbf{x_{i}}) ). We continue this for 45 turns. For episodes in which the model correctly identifies the hidden rule, let t_{e}^{\star} denote the turn index of the first correct announcement, i.e., Eq(\mathbf{r}_{t_{e}^{\star}},\mathbf{r}^{*})=1 . We describe how our setting differs from Wason study on humans in the appendix A.6 . Evaluation Metrics We report reasoning process success, efficiency of the reasoning process, as well as the extent of confirmation bias exhibited during the multi-turn games. (1) Task Success (Success ratio % \uparrow ) We report the percentage of scenarios in which the LLM guesses the correct rule during the conversation. For each episode, we measure whether any of i -th guessed rule \mathbf{r}_{i} matches the hidden rule \mathbf{r}^{*} using LLM-as-a-judge for each scenario, \mathbf{1}\Big(\bigvee_{i=1}^{n}Eq(\mathbf{r}_{i},\mathbf{r}^{*})\Big) , where n is the maximum number of turns. (2) # Turns until Success ( \downarrow ) We report the number of turns LLMs took to guess the correct rule. This is only computed for episodes where the model successfully guessed the correct rule within the allowed maximum number of turns. More formally, \frac{1}{|\mathcal{E}_{\mathrm{succ}}|}\sum_{e\in\mathcal{E}_{\mathrm{succ}}}t_{e}^{*} where \mathcal{E}_{\mathrm{succ}} denotes the set of episodes in which the model correctly identifies the hidden rule. (3) # Tokens per Turn ( \downarrow ) We report the average number of tokens generated by the model per Guess or Test turn across all episodes. This metric serves as a proxy for the amount of compute spent on reasoning and hypothesis testing. At comparable task performance, lower values indicate more concise and efficient reasoning. (4) Confirmation Bias Status (Incompatible:Compatible Ratio (I:C) \uparrow ). Following 30 , we quantify the model’s confirmation bias by measuring the ratio between the number of turns when it tests triples that contradict ( incompatible ) versus confirm ( compatible ) its current hypothesis. For episode e , let C_{e} and I_{e} denote the numbers of compatible and incompatible tests, respectively: C_{e}=\sum_{t=1}^{t_{e}^{\star}}\mathbbm{1}\!\left[\mathbf{r_{t}(x_{t})}=1\right],\quad I_{e}=\sum_{t=1}^{t_{e}^{\star}}\mathbbm{1}\!\left[\mathbf{r_{t}(x_{t})}=0\right],\quad\mathrm{I{:}C}=\frac{\sum_{e\in\mathcal{E}}I_{e}}{\sum_{e\in\mathcal{E}}C_{e}} where \mathcal{E} denotes the total set of evaluation episodes. To compute the compatibility of a triple with a rule, we first use an LLM to translate each rule into a Python function. Then we execute this Python function to decide the compatibility between the rule and the triple. The implementation details are in Appendix C.4 . Table 1: Example rule sets (each set has 4 rules) and sampled triples. Each rule is defined over integer triples (a,b,c) . All triples are sampled from the feasible intersection of the rules. Rule group Initial triple samples All odd; b is (strict) max; mixed signs; at least one multiple of 3 (-9,\,55,\,-71) , (-77,\,75,\,-47) All prime numbers; non-increasing; all positive; contains a prime (79,\,43,\,31) , (89,\,67,\,2) Data Each game scenario requires an initial triple \mathbf{x}_{\text{ini}} , the target rule \mathbf{r}^{*} , as well as a set of N other rules \{\mathbf{r}_{i}\}_{i=1}^{N} that satisfies the initial triple. We ensure there are other plausible rules that match the initial triple so that the LLM tests other triples to identify the hidden rule. We aim to generate a rule set that is diverse, while also representing human rules. Table 1 contains example rule sets and sampled initial triples. We develop 4 rule sets for training, 2 for validation, and 4 for testing, with each rule set containing 4 rules. For each rule set, we sample triples that satisfy all four rules, and evaluate each triple against each rule as the target, yielding one episode per triple–rule pairing. Training uses 100 triples per rule set (1,600 evaluation episodes), validation uses 2 triples per rule set (16 episodes), and testing uses 5 triples per rule set (80 episodes). We describe the data generation process below. Rule Set Generation We prompt an LLM to generate 40 game scenarios. First, we prompt the LLM to generate a set of four plausible rules over integer triples (a,b,c)\in[-99,100]^{3} . The prompt encourages rules from several conceptual families: ordering , arithmetic structure , parity or divisibility , sign , and number properties . We instruct that there should be non-empty set of triples that can satisfy all four rules. After initial generation, we apply heuristic checks (e.g., detecting multi-step arithmetic dependencies or rules relying on a single variable). Rule sets that fail these checks are revised via reprompting, resulting in approximately 33% of the initial generations being corrected. After filtering, we replace one of the LLM-generated rules in each rule set with a human-derived rule from prior work ( 4 ; 27 ) . The replacement is chosen such that there remains at least one triple satisfying all four rules. The data details are in Appendix A . 4 Replicating Human Studies We now evaluate off-the-shelf LLMs with three interaction settings: Baseline, Dual-Goal, and Think-in-Opposites. The first simulates the Wason’s study, and the other two mimic two intervention studies respectively. We ask the following two research questions: (1) Do LLMs exhibit confirmation bias? (2) Are intervention strategies to reduce the confirmation bias in humans effective for LLMs? 4.1 Interaction Settings Baseline This adapts the instruction from Wason’s classic 2–4–6 rule-discovery task ( 30 ) as is. The prompt and example interaction in Appendix B.1 . Each episode begins with an initial Guess turn, where the model states its first guess at the rule. It continues with the model’s Test , feedback on the test from the environment, then a new Guess turn. Think-in-Opposites (TiO) This adapts the study of 5 and instructs the LLM to focus on one property of the previous Test example triple and construct a new triple that is opposite with respect to that property. The prompt and example interaction for this intervention is in Appendix B.3 . Except for the prompt, it follows the same interaction protocol as the baseline condition. Dual-Goal We introduce a prompt adapted from the Dual-Goal paradigm ( 11 ) (prompt and example in Appendix B.2 ). The interaction protocol is identical to the baseline condition, with two modifications. First, during the Guess turn, the LLM must output two test rules: one for the DAX rule and one for the MED rule. The DAX rule corresponds to the original hidden rule, while the MED rule is its logical complement, capturing triples that violate the DAX rule. Second, during the Test turn, the LLM proposes a triple. The environment will evaluate this the same way (whether it fits the hidden rule or not), but instead of YES / NO feedback, it will output DAX / MED respectively. 4.2 Models Evaluated We evaluate 11 LLMs, including those with thinking mode, which generate intermediate reasoning traces, and LLMs without it. Decoding parameters, post-processing rules, and judge prompts are in Appendix C and we manually validate LLM-as-a-judge performance in Appendix H . LLMs (standard inference) Qwen3-8B, Qwen3-14B, and Qwen3-32B ( 33 ) ; Llama-3.3-70B-Instruct ( 19 ) ; and GPT-4o ( 22 ) . LLMs with Thinking Mode Gemini-2.5-Pro ( 8 ) ; Qwen3-8B, Qwen3-14B, and Qwen3-32B ( 33 ) ; QwQ-32B ( 24 ) ; and DeepSeek-R1-Distill-Llama-70B ( 10 ) . Thinking-mode models generate reasoning traces before an answer. 4.3 Results Table 2: LLMs task performance and the extent of confirmation bias (I:C ratio) on Wason’s rule discovery game. We observe varying success rates for LLMs. Overall, larger models with thinking mode show higher task success rates. TiO represents the Think-in-Opposites intervention. Non-Thinking Thinking Task Suc. Avg. # Turns Avg. # Tkns I:C Task Suc. Avg. # Turns Avg. # Tkns I:C % \uparrow until Suc. \downarrow per Turn \downarrow \uparrow % \uparrow until Suc. \downarrow per Turn \downarrow \uparrow Qwen3-8B Qwen3-8B Baseline 0.06 5.00 8.4 0.35 0.21 10.88 1088.2 0.15 TiO 0.06 15.25 8.4 0.30 0.36 9.01 1716.1 0.35 Dual-Goal 0.08 0.00 13.4 0.57 0.40 7.37 2142.7 0.55 Qwen3-14B Qwen3-14B Baseline 0.23 3.00 7.6 0.72 0.34 7.39 1179 0.19 TiO 0.29 4.12 7.0 0.90 0.48 7.08 1332.4 0.26 Dual-Goal 0.13 0.50 15.0 0.41 0.58 7.66 1191.7 0.40 Qwen3-32B Qwen3-32B Baseline 0.33 4.93 6.6 0.50 0.41 10.83 1029.8 0.14 TiO 0.36 3.76 6.1 0.63 0.61 6.38 1450.0 0.54 Dual-Goal 0.10 0.00 15.4 0.46 0.60 10.29 1472.3 0.77 LLaMA-3.3-70B-Ins DeepSeek-R1-LLaMA-70B Baseline 0.21 9.37 14.1 0.37 0.35 8.10 957.6 0.32 TiO 0.38 10.03 14.7 0.50 0.46 10.07 1072.8 0.48 Dual-Goal 0.20 12.87 23.7 0.53 0.50 8.39 1211.2 0.61 GPT-4o QwQ-32B Baseline 0.11 0.00 10.4 0.25 0.50 11.75 1757.5 0.36 TiO 0.16 2.50 10.7 0.17 0.59 10.28 1464.5 0.37 Dual-Goal 0.14 6.75 17.1 0.34 0.58 10.76 2277.2 0.81 – Gemini-2.5-Pro Baseline – – – – 0.73 11.14 – 0.66 TiO – – – – 0.78 8.52 – 0.75 Dual-Goal – – – – 0.78 10.10 – 0.77 (a) Thinking models (b) Non-thinking models Figure 2: Confirmation bias correlates with task success. Higher I:C (more disconfirmatory testing) is associated with higher task success. Each point represents a (model, variant) averaged over 80 episodes, and shaded regions show 95% confidence intervals. Table 2 presents the experimental results in eleven LLMs. We see larger model variants are largely more successful within the same model family. Additional diagnostics, such as first attempt guess rate, are in Appendix D . In the first three row blocks, we can compare three models (Qwen3-8B, 14B, 32B) in thinking vs. non-thinking mode. We find that thinking mode largely improves task success rates over non-thinking mode. across all three models and interaction settings. The number of turns to success is not always better with thinking models; potentially, they explore more to identify harder rules, which non-thinking models fail to guess. We also observe that thinking models generate more number of tokens per turn. We also find that the performance improvement from switching non-thinking to thinking mode is not accompanied by a consistent increase in I:C, indicating that these gains are not driven by reduced confirmation bias. Lower confirmation bias correlates with higher task success Figure 2 plots I:C ratios (x-axis) against task success rates (y-axis), separately for thinking and non-thinking models. We observe statistically significant positive correlations in both cases, with a stronger trend for thinking models. Overall, this indicates that reduced confirmation bias is associated with higher task success, suggesting that mitigating confirmation bias in LLMs can improve its performance. (a) Thinking models (b) Non-thinking models Figure 3: Interventions shift exploration in thinking but not non-thinking models. Red denotes Baseline; blue denotes intervention runs (Dual-Goal / Think-in-Opposites). Ellipses show 95% covariance regions. Each point represents a (model, variant) averaged over 80 episodes. Impact of Interventions Overall, the intervention strategies improves task success. Dual-Goal improves task success in eight out of eleven model–inference scenarios, while Think-in-Opposites improves task success in all. Both interventions tend to increase I:C ratios (18 out of 22 cases). Figure 3 visualizes these trends. We found the improvements to be statistically significant for thinking models, whereas for non-thinking models the results are mixed (no significant change for I:C, small improvement in accuracy for TiO and small drop in accuracy for Dual-Goal). The statistical testing results are in Appendix G.1 . 5 Injecting Intervention-Guided Reasoning into LLMs Having observed that the intervention prompt improves the LLM’s task performance by reducing confirmation bias, we study how to internalize this behavior without providing it at inference time as a prompt. We use a symbolic knowledge distillation approach ( 31 ) . We generate input-output pairs from the experimental setting with lower confirmation bias and higher task success rate, and perform supervised fine-tuning on that data. We describe the set-up below. Distillation setup To target exploration behavior rather than rule-guessing accuracy, we train on Test turns produced by a teacher, including unsolved episodes and solved ones. Each training example consists of the dialogue history up to a Test turn and the teacher’s next-turn response. More formally, let x_{t} denote the dialogue history up to the t -th Test turn. Let T_{\text{teacher}}(x_{t}) and T_{\text{student}}(x_{t}) denote the prompts used for the teacher and student, respectively. The teacher model p_{\theta_{T}} produces a next-turn response y^{T}=(y^{T}_{1},\dots,y^{T}_{|y^{T}|}) under T_{\text{teacher}}(x_{t}) . For distillation, the student model p_{\theta} is conditioned on the same dialogue history formatted with T_{\text{student}}(x_{t}) and trained to imitate the teacher output token by token. Specifically, we optimize the log-likelihood: \mathcal{L}_{\textsc{sft}}(\theta)=-\mathbb{E}_{(x_{t},y^{T})\sim\mathcal{D}}\sum_{i=1}^{|y^{T}|}\log p_{\theta}\!\left(y^{T}_{i}\mid T_{\text{student}}(x_{t}),y^{T}_{