PiCSAR: Probabilistic Confidence Selection And Ranking for Reasoning Chains
Joshua Ong Jun Leang, Zheng Zhao, Aryo Pradipta Gema, Sohee Yang, Wai-Chung Kwan, Xuanli He, Wenda Li, Pasquale Minervini, Eleonora Giunchiglia, Shay B. Cohen · 2025
Read PiCSAR: Probabilistic Confidence Selection And Ranking for Reasoning Chains by Joshua Ong Jun Leang, Zheng Zhao, Aryo Pradipta Gema, Sohee Yang, Wai-Chung Kwan, Xuanli He, Wenda Li, Pasquale Minervini, Eleonora Giunchiglia, Shay B. Cohen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-21787.txt.
Introduction
Joshua Ong Jun Leang and nine co-authors present a 2025 paper on picking the best answer when a language model generates several candidate solutions. Sampling many reasoning chains helps only if the chooser can spot the right one without peeking at the answer key. Their method, PiCSAR, needs no training: it scores each candidate by the joint log-probability of its reasoning steps and final answer together.
That score splits naturally into confidence in the reasoning and confidence in the answer. Correct chains, the authors show, score higher on both. On standard math benchmarks the method gained about ten points and beat rival selectors while using at least half the samples in most comparisons. The authors present confidence, properly combined, as a free and effective judge of machine reasoning.
Catalog record
| CREATOR | Joshua Ong Jun Leang, Zheng Zhao, Aryo Pradipta Gema, Sohee Yang, Wai-Chung Kwan, Xuanli He, Wenda Li, Pasquale Minervini, Eleonora Giunchiglia, Shay B. Cohen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-21787
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PiCSAR: Probabilistic Confidence Selection And Ranking for Reasoning Chains Joshua Ong Jun Leang, Zheng Zhao, Aryo Pradipta Gema, Sohee Yang, Wai-Chung Kwan, Xuanli He, Wenda Li, Pasquale Minervini, Eleonora Giunchiglia, Shay B. Cohen Abstract Best-of- n n sampling improves the accuracy of large language models (LLMs) and large reasoning models (LRMs) by generating multiple candidate solutions and selecting the one with the highest reward. The key challenge for reasoning tasks is designing a scoring function that can identify correct reasoning chains without access to ground-truth answers. We propose P robab i listic C onfidence S election A nd R anking (PiCSAR): a simple, training-free method that scores each candidate generation using the joint log-likelihood of the reasoning and final answer. The joint log-likelihood of the reasoning and final answer naturally decomposes into reasoning confidence and answer confidence . PiCSAR achieves substantial gains across diverse benchmarks ( + 10.18 +10.18 on MATH500, + 9.81 +9.81 on AIME2025), outperforming baselines with at least 2x fewer samples in 16 out of 20 comparisons. Our analysis reveals that correct reasoning chains exhibit significantly higher reasoning and answer confidence, justifying the effectiveness of PiCSAR. Figure 1: Performance of PiCSAR on three datasets and three models, compared to self-consistency. 1 Introduction Recent work shows that large language models (LLMs) can reason to a degree ( Grattafiori et al. 2024 ; Team et al. 2024 ; Hurst et al. 2024 ) ; this is especially true when using techniques like Chain-of-Thought ( Wei et al. 2022 ; Kojima et al. 2022 , CoT,) , which generate explicit intermediate reasoning steps. Building on these advances, large reasoning models (LRMs), LLMs that received intensive reasoning-focused post-training, such as OpenAI’s o1 ( Jaech et al. 2024 ) , DeepSeek R1 ( Guo et al. 2025 ) , and Qwen3 ( Yang et al. 2025a ) , can solve relatively complex problems through long chains of thought, or a thinking process, often characterised as extended CoT with self-reflection ( Yang et al. 2025b ; Muennighoff et al. 2025 ) . Despite these advances, classic decoding approaches such as greedy decoding often fall short of state-of-the-art performance on complex benchmarks ( Team et al. 2025 ; Balunović et al. 2025 ) , emphasising the need for more sophisticated inference-time strategies. Best-of-N sampling (BoN) sampling ( Stiennon et al. 2020 ) emerged as an important technique, where n candidate responses are generated and the one with the highest score from a reward model is selected ( Mudgal et al. 2024 ; Huang et al. 2025 ) . However, training or fine-tuning external reward models can be computationally expensive ( Wang et al. 2023a ) and can be vulnerable to distribution shifts ( Eisenstein et al. 2023 ) . This led to the adoption of simpler, training-free BoN variants like Self-Consistency ( Wang et al. 2023b ) , which selects the most frequent answer among multiple generated outputs. However, a key limitation of Self-Consistency is its exclusive reliance on the final answer. Extensions like Universal Self-Consistency ( Chen et al. 2023 , USC,) prompt the model itself to identify the most consistent response from a set of candidates. USC, while evaluating complete responses, identifies the majority consensus pattern rather than the correctness of the reasoning; it discards valuable signals from the reasoning process itself, such as its coherence and plausibility, that contribute to reaching the answer. USC faces additional constraints from model context-window capacity and the reasoning ability of the model ( Chen et al. 2023 ) , with recent work showing that it is especially ineffective with smaller models ( Kang et al. 2025 ) . Attempts to overcome this by prompting the model to self-evaluate its reasoning verbally are often ineffective, as this form of explicit confidence can be poorly calibrated ( Miao et al. 2024 ; Taubenfeld et al. 2025 ) . Figure 2: PiCSAR selects the most likely reasoning trace r and answer y by jointly maximising their log-likelihoods \log p(r\mid x) and \log p(y\mid r,x) . To address these challenges, we introduce Probabilistic Confidence Selection And Ranking (PiCSAR), a probabilistic confidence method for selecting a reasoning chain r and answer y without requiring any training. Our approach is straightforward to implement and can be used with any LLM or LRM as an inference-time tool. It is based on a new scoring function for BoN that, given a prompt x , selects a reasoning chain r and the answer y via their joint conditional likelihood \log p(y,r\mid x) . This objective naturally separates into two complementary components. The reasoning confidence term \log p(r\mid x) promotes high-probability reasoning sequences by implicitly evaluating the likelihood of the chain given the prompt. The answer confidence term \log p(y\mid r,x) quantifies the model’s certainty in its final prediction, conditioned on the generated reasoning chain. Figure 2 shows a high-level outline of PiCSAR, and how it can solve instances that Self-Consistency and USC cannot solve correctly. This provides a richer signal than the simple answer-agreement, allowing PiCSAR to identify high-quality reasoning that other approaches disregard. We evaluate PiCSAR on reasoning tasks across five LLMs and three LRMs, outperforming Self-Consistency and USC in most cases. PiCSAR achieves these improvements with substantially fewer samples, often requiring only k=6 samples to outperform them using k=16\text{ or }32 samples. In particular, LRMs show particularly substantial improvements, with Deepseek-R1-distilled-Llama-3 achieving +13.33% and +12.78% over Self-Consistency on AIME2024 and AIME2025, respectively ( Figure 1 ). Unlike USC, which is bounded by the underlying model’s reasoning abilities, PiCSAR allows confidence scores to be estimated by separate models. Even smaller models can approximate confidence effectively, as the evaluator captures stable properties of the reasoning process rather than artefacts themselves ( Section 5.1 ). Beyond empirical results, we provide a comprehensive analysis of LLM confidence behaviour, and we show that answer confidence positively correlates with downstream accuracy ( Section 5.2 ). In addition, we show that confidence values are model-dependent and should not be used for directly comparison across models for ranking. At a finer granularity, we analyse answer confidence at a sentence level, using a peak-to-sentence ratio that counts how often a chain attains high confidence relative to its length. We find that a higher accuracy often correlates with a high ratio within the model family ( Section 5.3 ). 2 A Joint Probabilistic Method for Reasoning Chain Selection We propose a training-free method for selecting an optimal reasoning chain from a set of candidates, grounded in a probabilistic framework that leverages the model’s confidence as its scoring signal. We frame the selection problem as an approximation of maximum a posteriori (MAP) decoding over the joint space of reasoning chains and final answers. 2.1 Scoring Function and Log-Likelihood Decomposition We denote by \mathcal{X} a set of possible prompts, \mathcal{R} a set of reasoning chains, and \mathcal{Y} the set of possible final answers. For a given input prompt x\in\mathcal{X} , our goal is to find the optimal reasoning chain r\in\mathcal{R} and its corresponding answer y\in\mathcal{Y} . Consider a selection criterion that aims to identify the pair (r,y) with the highest joint conditional probability, p(r,y\mid x) , which by the chain rule of probability decomposes into two distinct components: \arg\max_{r,y}p(r,y\mid x)=\arg\max_{r,y}p(y\mid r,x)\cdot p(r\mid x). (1)