Reasoning or Fluency? Dissecting Probabilistic Confidence in Best-of-N Selection

Hojin Kim, Jaehyung Kim · 2026

Read Reasoning or Fluency? Dissecting Probabilistic Confidence in Best-of-N Selection by Hojin Kim, Jaehyung Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-13735.txt.

Introduction

Hojin Kim and Jaehyung Kim question a common way to pick the best AI answer in 2026. In Best-of-N selection, a model makes many answers and one is chosen. Probabilistic confidence scores often make that choice. High confidence is taken as a sign of sound reasoning.

The pair test if those scores truly track the steps of valid reasoning. They ask if scores reflect fluency, smooth text, more than logic. Valid reasoning needs each step to cause the next in a sound chain. If scores miss that, Best-of-N can pick slick but wrong answers.

Catalog record

CREATORHojin Kim, Jaehyung Kim
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-13735

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reasoning or Fluency? Dissecting Probabilistic Confidence in Best-of-N Selection Hojin Kim, Jaehyung Kim Abstract Probabilistic confidence metrics are increasingly adopted as proxies for reasoning quality in Best-of- N N selection, under the assumption that higher confidence reflects higher reasoning fidelity. In this work, we challenge this assumption by investigating whether these metrics truly capture inter-step causal dependencies necessary for valid reasoning. We introduce three classes of inter-step causality perturbations that systematically disrupt dependencies between reasoning steps while preserving local fluency. Surprisingly, across diverse model families and reasoning benchmarks, we find that selection accuracy degrades only marginally under these disruptions. Even severe interventions, such as applying hard attention masks that directly prevent the model from attending to prior reasoning steps, do not substantially reduce selection performance. These findings provide strong evidence that current probabilistic metrics are largely insensitive to logical structure, and primarily capture surface-level fluency or in-distribution priors instead. Motivated by this gap, we propose a contrastive causality metric that explicitly isolates inter-step causal dependencies, and demonstrate that it yields more faithful output selection than existing probability-based approaches. 1 1 1 Code to be released upon acceptance 1 Introduction In recent years, Large Language Models (LLMs) have demonstrated remarkable increases in reasoning capabilities, largely driven by Chain-of-Thought (CoT) prompting and reinforcement learning ( 8 ; 7 ; 31 ) . These capabilities have been shown to scale effectively with increased inference-time computation ( 24 ) . In particular, Best-of-N , a strategy that samples multiple reasoning traces and selects the optimal one, has been widely adopted to boost the performance of LLMs across diverse reasoning benchmarks ( 30 ; 14 ; 10 ) . Best-of- N approaches can be broadly categorized into methods that use an external reward model and reward-free voting schemes. However, both methods exhibit distinct shortcomings: external reward models incur additional computational costs ( 29 ) , while voting schemes such as self-consistency ( 30 ) suffer from limited applicability to generative tasks ( 3 ; 4 ) . Consequently, recent research has shifted towards utilizing probabilistic confidence metrics derived directly from the LLM’s output token distribution, such as perplexity, as an efficient selection criterion ( 10 ; 6 ; 13 ) . Figure 1: Summary of our main results. Accuracy with Best-of- N selection using three probabilistic confidence metrics (Self-certainty, Log-likelihood, and Entropy) is insensitive to causal disruptions across a number of reasoning benchmarks, implying these metrics might not be capturing inter-step causality in CoT traces, but rather local fluency and prior likelihood. Despite their growing popularity, the reliability of these probabilistic metrics depends on a critical assumption: that they capture the validity of the underlying reasoning process. However, recent studies challenge this assumption, showing that final answer correctness often does not align with the quality of intermediate reasoning. For example, 18 reveal that correct answers can stem from unfaithful reasoning traces, and 27 demonstrate that CoT explanations are frequently post-hoc rationalizations rather than reflections of the model’s internal decision-making process. If CoT traces are often unfaithful or disconnected from the final answer, this raises a fundamental question: Do probabilistic confidence metrics actually measure reasoning quality, or do they merely capture surface-level fluency? To answer this, we investigate which aspects of CoT traces are truly captured by probabilistic confidence metrics. Specifically, we design three perturbation scenarios that explicitly disrupt inter-step causal dependencies ( i.e. , the logical flow between reasoning steps) while preserving local fluency. We then analyze how confidence metrics respond to these disruptions: \circ Attention-level disruptions : We break inter-step causality within the CoT trace by applying attention masking between steps during metric calculation. We further test an extreme case by removing the query context during calculation. \circ Parameter-level disruptions : We decouple the metric from evaluator reasoning capacity by computing metrics using a substantially smaller model ( e.g. , Qwen2.5-0.5B ( 26 ) ) that struggles to verify complex, multi-step logic. \circ Data-level disruptions : We structurally disrupt the reasoning trace by truncating, paraphrasing, or shuffling the text, before metric calculation. This preserves local sentence fluency but destroys global logical coherence. Our experiments reveal a counterintuitive phenomenon: state-of-the-art probabilistic confidence metrics are surprisingly insensitive to these disruptions . Across five reasoning benchmarks and three LLM families, disrupting inter-step causal structure with the proposed disruptions results in an average selection accuracy loss of less than 1%, and in several cases even leads to accuracy improvements (see Figure 1 ). These findings provide strong evidence that inherent probability-based metrics act primarily as proxies for local fluency and prior likelihood , rather than estimating inter-step causality and reasoning quality. Motivated by this, we propose a contrastive causality metric to isolate signals attributable to inter-step causal structure. The proposed metric not only outperforms existing metrics in Best-of- N selection, but also degrades consistently under causal disruptions, indicating greater sensitivity to reasoning coherence. Figure 2: Overall illustration of the proposed causality disruptions. From left to right, the diagrams depict: (i) the unaltered evaluation process, in which the full reasoning trace is evaluated autoregressively to calculate a probabilistic confidence metric; (ii) attention-level disruption , where cross-step attention is masked and each reasoning step is evaluated independently; (iii) parameter-level disruption , where a smaller evaluator model is used; and (iv) data-level disruption , where the reasoning trace is modified ( e.g. , order shuffling) prior to evaluation. 2 Related Works Best-of- N with probabilistic confidence. Existing Best-of- N selection methods using probabilistic confidence metrics fall into two categories: sentence-level and distributional approaches. Methods based on sentence-level confidence evaluate outputs by aggregating the probabilities assigned to sampled tokens. While the most straightforward approach simply selects outputs with the highest average log-likelihood (or lowest perplexity), recent research has introduced various refinements. For example, 13 score candidates using the joint log-likelihood of the reasoning chain and final answer, while 22 leverages likelihoods assigned by LLMs to different options in a self-evaluation framework. Similarly, 6 utilize the negative average log-probability of the top- k predicted tokens at each generation step to filter and refine reasoning chains. An alternative class of methods based on distributional confidence leverages the full output distribution over the entire vocabulary at each step rather than scoring solely based on the sampled tokens. A natural instantiation of this approach is to use the entropy of the distribution, where a more peaked distribution indicates higher model certainty. 10 formalize this by aggregating step-wise certainty across the reasoning trace via the KL-divergence between the model’s predicted distribution and a uniform distribution. Fragility and unfaithfulness of CoTs. Probabilistic confidence metrics are computed over the generated reasoning steps and the final answer. However, prior work has shown that CoT reasoning steps can be post-hoc or heuristic, and may fail to reflect the model’s underlying reasoning process. For example, 16 highlight cases where models arrive at the correct final answer without following the preceding steps. Similarly, 27 demonstrate that models may generate CoT steps that align with surface-level prompt cues and biases, rather than with the model’s true internal decision process. In addition, 12 show that the extent to which a model conditions on its CoT traces varies substantially across models and tasks. These findings indicate that CoT steps do not always causally influence the final

Read the complete text