Beware of Reasoning Overconfidence: Pitfalls in the Reasoning Process for Multi-solution Tasks

Jiannan Guan 1∗ Qiguang Chen 1∗ Libo Qin 2 , = {}^{2,{\mbox{=}}} Dengyun Peng 1 Jinhao Liu 1 Liangyu Huo 3 Jian Xie 3 Wanxiang Che 1 , = {}^{1,{\mbox{=}}} 1 Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology, 2 School of Computer Science and Engineering, Ce · 2025

Read Beware of Reasoning Overconfidence: Pitfalls in the Reasoning Process for Multi-solution Tasks by Jiannan Guan 1∗ Qiguang Chen 1∗ Libo Qin 2 , = {}^{2,{\mbox{=}}} Dengyun Peng 1 Jinhao Liu 1 Liangyu Huo 3 Jian Xie 3 Wanxiang Che 1 , = {}^{1,{\mbox{=}}} 1 Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology, 2 School of Computer Science and Engineering, Ce (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-01725.txt.

Introduction

Jiannan Guan and co-authors warn of reasoning overconfidence in multi-solution tasks. Language models shine when one answer is right. Tasks that need many diverse answers expose a flaw. Models state high certainty for partial answer sets. That certainty hides missing cases from users.

The team names that flaw reasoning overconfidence. They trace where it enters the thought process. Fixes must teach models to doubt coverage, not just steps. Better coverage checks matter for law, medicine, and planning tasks where a missed option can be costly. Coverage doubt is distinct from step doubt, and naming it apart lets trainers target the exact stage where answer sets go thin.

Catalog record

CREATORJiannan Guan 1∗ Qiguang Chen 1∗ Libo Qin 2 , = {}^{2,{\mbox{=}}} Dengyun Peng 1 Jinhao Liu 1 Liangyu Huo 3 Jian Xie 3 Wanxiang Che 1 , = {}^{1,{\mbox{=}}} 1 Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology, 2 School of Computer Science and Engineering, Ce
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-01725

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beware of Reasoning Overconfidence: Pitfalls in the Reasoning Process for Multi-solution Tasks Jiannan Guan 1∗ Qiguang Chen 1∗ Libo Qin 2 , = {}^{2,{\mbox{=}}} Dengyun Peng 1 Jinhao Liu 1 Liangyu Huo 3 Jian Xie 3 Wanxiang Che 1 , = {}^{1,{\mbox{=}}} 1 Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology, 2 School of Computer Science and Engineering, Central South University, 3 Du Xiaoman (Beijing) Science Technology Co., Ltd. Abstract Abstract: Large Language Models (LLMs) excel in reasoning tasks requiring a single correct answer, but they perform poorly in multi-solution tasks that require generating comprehensive and diverse answers. We attribute this limitation to reasoning overconfidence : a tendency to express undue certainty in an incomplete solution set. To examine the effect, we introduce MuSoBench , a benchmark of multi-solution problems. Experiments show that the conventional short chain-of-thought (Short-CoT) prompting paradigm exhibits pronounced overconfidence, whereas the emerging long chain-of-thought (Long-CoT) approach mitigates it through iterative exploration and self-reflection. We further characterise observable behaviours and influential factors. To probe the underlying cause, we propose the cognitive-rigidity hypothesis , which posits that overconfidence arises when the reasoning process prematurely converges on a narrow set of thought paths. An attention-entropy analysis offers preliminary support for this view. These findings provide tools for assessing the completeness of LLM reasoning and highlight the need to move evaluation beyond single-answer accuracy toward comprehensive exploration. ∗ Equal Contribution = {}^{{\mbox{=}}} Corresponding Author = Date : Oct. 01, 2025 Code Repository : https://github.com/jubgjf/reasoning-overconfidence = Contact : [email protected] , [email protected] , [email protected] , [email protected] 1 Introduction Recently, Large Language Models (LLMs) have shown strong performance on tasks requiring multiple correct answers [ 1 , 37 , 43 , 27 ] . As illustrated in Figure 1 , consider planning every possible dinner from a fixed set of ingredients: success lies in listing the full menu, not a single dish. We call such problems multi-solution reasoning tasks, whose goal is completeness and diversity. Yet advanced methods like Chain-of-Thought (CoT) [ 32 ] , designed for one reasoning path, often stop early. When asked to list all answers, LLMs usually produce a few options and then assert confidently that no others exist. As Figure 1 & 2 depict, this overconfidence significantly reduces possible solution exploration, exposing a mismatch between stated confidence and actual coverage. To systematically analyze this failure mode on multi-solution tasks, we introduce the concept of Reasoning Overconfidence : A model’s subjective confidence in its solution set significantly exceeds its actual ability to recover the full set of correct answers. Figure 1 : On multi-solution tasks, the model suffers from reasoning overconfidence , exhibiting excessively high confidence while exploring only a few reasoning paths. This leads to a poor completeness score for the final task. Prior work has examined LLM performance on multi-solution tasks. Some work focuses on reasoning under structured constraints. For example, the 24-point game requires enumerating all valid arithmetic expressions [ 39 ] , while benchmarks such as CalibratedMath use problems with multiple correct answers to assess uncertainty calibration [ 24 ] . Others center on open-ended generation. Creative tasks such as story generation evaluate producing diverse content from an effectively unbounded solution space [ 36 , 31 ] . However, the datasets used in existing work share a fundamental limitation: Their solution spaces are either tightly constrained or nearly unbounded, which hinders reliable estimation of completeness. To enable more precise empirical study, we developed the Multi-solution Benchmark (MuSoBench) , a task suite designed to evaluate reasoning overconfidence under controlled solution spaces. When applied to MuSoBench, the conventional short chain-of-thought (Short-CoT) approach exhibits persistent overconfidence: as shown in Figure 2 , its outputs cluster in the high-confidence, low-recall region, providing direct empirical evidence of this behavior. Behavioral analysis indicates that Short-CoT performs a shallow search, seldom revising its initial reasoning path, which largely explains its inflated confidence. By contrast, the Long-CoT paradigm, which promotes iterative exploration and self-reflection [ 4 , 5 , 41 , 22 ] , substantially improves both recall and precision, thereby reducing reasoning overconfidence. Finally, analysis of internal activations supports the cognitive rigidity hypothesis, which attributes overconfidence to premature convergence on a narrow set of reasoning paths. The main contributions are summarized as follows: • We first introduce the reasoning overconfidence concept as a critical failure mode of LLMs on multi-solution tasks and present MuSoBench, a new benchmark that documents this phenomenon through evidence on solution diversity, stability, and calibration. • We analyze factors influencing overconfidence and its mitigation. Our results show that the extent of overconfidence is governed chiefly by the length of the reasoning trace, the presence of reflective steps, and the breadth of exploration, thereby linking the phenomenon to both reasoning paradigms and task properties. • We advance the cognitive-rigidity hypothesis to explain this behavior, examining internal model states that give rise to overconfidence and offering a fresh perspective on the fundamental multi-solution reasoning. 2 Problem Formulation & Benchmark 2.1 Multi-solution Tasks Multi-solution tasks require a model to enumerate all valid answers to a single problem rather than to return just one. Formally, such a task is characterised by a dataset \mathcal{T}=\{(x_{i},\hat{\mathcal{Y}}_{i})\ |\ |\hat{\mathcal{Y}}_{i}|\geq 1\}_{i=1}^{N} , where x_{i} denotes the i -th problem instance and \hat{\mathcal{Y}}_{i} is the corresponding ground-truth solution set. Given x_{i} , a model \mathcal{M} outputs its own solution set \mathcal{Y}_{i}=\mathcal{M}(x_{i}) . The ideal outcome is that \mathcal{Y}_{i} matches \hat{\mathcal{Y}}_{i} exactly, covering every valid solution and omitting none. Figure 2 : Distribution plots of recall vs. confidence on the TimeTabling dataset. The plots clearly show Short-CoT results clustering in the low-recall, high-confidence corner (red). For SubsetSum results, see Figure 8 in Appendix. 2.2 Reasoning Overconfidence Figure 3 : Calibration and performance of Short-CoT vs. Long-CoT on TimeTabling dataset. As shown in (a), the diagonal line represents perfect calibration. Long-CoT models (blue) are better calibrated than Short-CoT models (orange). As shown in (b), Long-CoT models achieve significantly higher recall than Short-CoT models. For SubsetSum results, see Figure 9 in Appendix. R easoning O ver C onfidence (ROC) refers to a model’s tendency to report confidence levels that exceed its actual performance. In multi-solution tasks, this mismatch often drives the model to return only a subset of correct answers and to stop searching prematurely. To characterise the phenomenon quantitatively, we use the Expected Calibration Error (ECE), which compares expected and realised performance. Let \mathcal{C}(\mathcal{Y}_{i}\mid x_{i},\mathcal{M}) denote the confidence that model \mathcal{M} assigns to its proposed solution set \mathcal{Y}_{i} . A model is reasoning-overconfident when its reported confidence exceeds its observed performance \mathrm{Perf}(\cdot) : \mathcal{C}(\mathcal{Y}_{i}|x_{i},\mathcal{M})>\text{Perf}(\mathcal{Y}_{i},\hat{\mathcal{Y}}_{i}) (1) For tasks with multiple valid answers, the relevant performance dimension is the completeness of the returned set. Because our focus is the model’s failure to enumerate all correct solutions, not the precision of each individual answer, we measure performance with Recall . Metrics that combine precision and recall (e.g., F1-score) would blur the exploration shortfall we seek to isolate; hence, we instantiate \mathrm{Perf}(\cdot) as Recall throughout this work. 2.3 MuSoBench Construction To systematically and controllably evaluate models on multi-solution tasks, we introduce the Multi-Solution Benchmark (MuSoBench) , comprising two subtasks: TimeTabling and SubsetSum . The TimeTabling subtask is to construct conflict-free course schedules subject to constraints on course overlap, instructor

Read the complete text