A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models
Yanbo Wang, Yongcan Yu, Jian Liang, Ran He · 2025
Read A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models by Yanbo Wang, Yongcan Yu, Jian Liang, Ran He (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-03871.txt.
Introduction
In a 2025 survey paper, Yanbo Wang and three co-authors ask whether chain-of-thought reasoning makes large language models more trustworthy, or quietly less so. Writing out intermediate steps has raised performance on understanding tasks, hard problems, and code generation. What that reasoning style does to trust has lacked a comprehensive account.
Five dimensions structure the review: truthfulness, safety, fairness, robustness, and privacy. Studies of reasoning models and chain-of-thought methods are surveyed for each, arranged chronologically, with methods, findings, and limitations dissected. A double-edged picture emerges. Reasoning helps on several fronts, reducing hallucination, catching harmful content, and improving robustness in places. Yet the strongest reasoning models frequently match or exceed plainer systems in their safety, robustness, and privacy weaknesses. Synthesising that tension is the survey's contribution: a timely map, aimed at the AI safety community, of where reasoning earns trust and where it spends it.
Catalog record
| CREATOR | Yanbo Wang, Yongcan Yu, Jian Liang, Ran He |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 104 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-03871
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models Yanbo Wang, Yongcan Yu, Jian Liang, Ran He Abstract Abstract: The development of Long-CoT reasoning has advanced LLM performance across various tasks, including language understanding, complex problem solving, and code generation. This paradigm enables models to generate intermediate reasoning steps, thereby improving both accuracy and interpretability. However, despite these advancements, a comprehensive understanding of how CoT-based reasoning affects the trustworthiness of language models remains underdeveloped. In this paper, we survey recent work on reasoning models and CoT techniques, focusing on five core dimensions of trustworthy reasoning: truthfulness, safety, robustness, fairness, and privacy. For each aspect, we provide a clear and structured overview of recent studies in chronological order, along with detailed analyses of their methodologies, findings, and limitations. Future research directions are also appended at the end for reference and discussion. Overall, while reasoning techniques hold promise for enhancing model trustworthiness through hallucination mitigation, harmful content detection, and robustness improvement, cutting-edge reasoning models themselves often suffer from comparable or even greater vulnerabilities in safety, robustness, and privacy. By synthesizing these insights, we hope this work serves as a valuable and timely resource for the AI safety community to stay informed on the latest progress in reasoning trustworthiness. A full list of related papers can be found at https://github.com/ybwang119/Awesome-reasoning-safety . Corresponding author: Jian Liang ([email protected]). This survey considers papers published up to June 30, 2025. Work in progress. Contents 1 Introduction With the advancement of large language models (LLMs), Chain-of-Thought (CoT) techniques have become an important way to improve model performance on various downstream tasks, especially in math and code generation. After the release of OpenAI’s o1 series models as well as the DeepSeek-R1, developing reasoning models with system-2 thinking also attracted significant interest from researchers around the world, followed by innovations in reinforcement learning algorithms, training data generation, and adaptation methods for other tasks. Despite these improvements, the trustworthiness of CoT techniques as well as reasoning models remains underexplored. Intuitively, it may be reasonable that the thinking capability could be generalized to the trustworthiness domain, resulting in a safer and more reliable model. However, recent works [ 1 , 2 , 3 ] did not support such an ideal hypothesis. Furthermore, prior surveys on LLM safety [ 4 , 5 , 6 ] provide little discussion of reasoning as a factor in model trustworthiness. This gap motivates the central question: What does the reasoning capability bring to the language model trustworthiness? To answer this question, we propose the first comprehensive survey to thoroughly review recent advancements in trustworthy reasoning. We unfold our survey through five main components: truthfulness, safety, robustness, fairness, and privacy. In the truthfulness section, with a focus on model reliability, we include hallucination and reasoning faithfulness, encompassing hallucination detection and mitigation methods with CoT techniques, hallucination analysis in reasoning models, reasoning faithfulness measurement, faithfulness understanding, as well as methods to improve reasoning faithfulness. In the safety section, we aim to understand the harmlessness of the generation content, and mainly take vulnerability assessment, jailbreak, alignment, and backdoor into consideration. For better readability, we specifically distinguish between jailbreak attacks targeting reasoning models and the use of reasoning techniques in attack and defense, forming different paragraphs to structure the literature. In the robustness section, we mainly focus on adversarial input noises that elicit false answers at inference time. The overthinking and underthinking problems are highlighted as a special case when language models are equipped with reasoning capability. After that, in the fairness section, we mainly cover the latest evaluations and methods for bias detection. As for the privacy section, we split the related works into model-related privacy and prompt-related privacy, with topics containing model unlearning, IP protection, watermarking, and privacy inference. While existing surveys have explored reasoning techniques [ 7 , 8 ] and reasoning efficiency [ 9 , 10 , 11 ] , relatively little attention has been paid to the trustworthiness of reasoning in large language models. A related survey [ 12 ] provided valuable discussions on safety-related aspects. In contrast, our work offers a more comprehensive perspective on trustworthiness. In general, we provide a clear taxonomy for model trustworthiness in reasoning, which includes both early CoT techniques and end-to-end reasoning models. Through our review of existing work, we suggest that reasoning techniques not only facilitate the development of more interpretable and trustworthy models but also introduce new vulnerabilities. As models acquire more advanced reasoning capabilities, the attack surface correspondingly expands, enabling more complex and targeted adversarial strategies. We hope that both the surveyed literature and our proposed taxonomy will serve as a timely reference for the AI safety community, supporting ongoing efforts to understand and improve the trustworthiness of reasoning in language models. Table 1: List of Abbreviations and Acronyms Abbreviation Full Term Abbreviation Full Term AOC Area Over Curve MCTS Monte-Carlo Tree Search ASR Attack Success Rate MLLM Multimodal Large Language Model CNN Convolutional Neural Network MLRM Multimodal Large Reasoning Model CoT Chain-of-Thought ORM Outcome Reward Model DFS Depth-First Search PRM Process Reward Model DPO Direct Preference Optimization QA Question-Answering GRPO Group Relative Policy Optimization RL Reinforcement Learning ICL In-Context Learning RLHF Reinforcement Learning from Human Feedback KL Kullback-Leibler Divergence RLVR Reinforcement Learning with Verifiable Reward LAS Leakage-Adjusted Simulatability RAG Retrieval-Augmented Generation LLM Large Language Model SCM Structural Causal Model LRM Large Reasoning Model SoTA State-of-the-Art LoRA Low-Rank Adapter SFT Supervised Fine-Tuning MoE Mixture-of-Experts VR Verifiable Reward 2 Background In this section, we provide an overview of fundamental concepts related to reasoning in language models, including discussions of the general definition of reasoning, an introduction to CoT as a widely adopted technique, and key considerations in model training that influence the reasoning abilities. 2.1 Large Language Model Reasoning LLM reasoning is a novel paradigm that leverages the knowledge embedded within models like GPT-4 [ 13 ] , Claude [ 14 ] , and DeepSeek-R1 [ 15 ] to solve complex tasks—such as math, coding, and logical reasoning—by mimicking human cognitive processes. Typically, LLM reasoning involves generating both the final answer and the intermediate steps, often referred to as “thoughts”, which guide the model from the question to the answer. Formally, given a prompt x and context C , the reasoning of an LLM \mathcal{M} can be represented as follows: T,A=\mathcal{M}(x,C), (1) where T refers to the intermediate reasoning process and A is the answer. By enabling the AI system to generate interpretable reasoning steps alongside the solution, LLM reasoning not only solves complex tasks but also improves human understanding of the problem-solving process, thereby enhancing its utility and reliability. Currently, the two main paradigms for implementing large language model reasoning are CoT prompting and large reasoning model training. 2.2 Chain-of-Thought Prompting CoT prompting [ 16 , 17 ] is a prompt engineering technique designed to elicit a sequence of intermediate reasoning steps referred to as the thought, before providing the final answer. There are various methods for implementing CoT, with two of the most common being few-shot-CoT [ 16 ] and zero-shot-CoT [ 17 ] . As illustrated in Figure 1 , few-shot-CoT mirrors the approach of few-shot in-context learning (ICL) [ 18 ] , utilizing a small number of examples to guide the model