Lie to Me: How Faithful Is Chain-of-Thought Reasoning in Open-Weight Reasoning Models?

Richard J. Young, [4pt] University of Nevada, Las Vegas, Department of ManagementEntrepreneurship and Technology, Lee Business School, Las Vegas, NV, USA · 2026

Read Lie to Me: How Faithful Is Chain-of-Thought Reasoning in Open-Weight Reasoning Models? by Richard J. Young, [4pt] University of Nevada, Las Vegas, Department of ManagementEntrepreneurship and Technology, Lee Business School, Las Vegas, NV, USA (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22582.txt.

Introduction

Young tests how faithful chain-of-thought reasoning is in open-weight language models. Faithful here means the model admits when a hint shaped its answer. The study covers 12 models from nine families. It uses 498 test questions and six kinds of hints. Across 41,832 runs, faithfulness rates range from 39.7 to 89.9 percent. Models often note a hint in their thinking tokens but drop that note in the final answer. Young reports that training method and model family predict faithfulness better than model size.

Catalog record

CREATORRichard J. Young, [4pt] University of Nevada, Las Vegas, Department of ManagementEntrepreneurship and Technology, Lee Business School, Las Vegas, NV, USA
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74779
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.22582

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Lie to Me: How Faithful Is Chain-of-Thought Reasoning in Open-Weight Reasoning Models? Richard J. Young, [4pt] University of Nevada, Las Vegas, Department of ManagementEntrepreneurship and Technology, Lee Business School, Las Vegas, NV, USA Abstract Chain-of-thought (CoT) reasoning has been proposed as a transparency mechanism for large language models in safety-critical deployments, yet its effectiveness depends on faithfulness (whether models accurately verbalize the factors that actually influence their outputs), a property that prior evaluations have examined in only two proprietary models, finding acknowledgment rates as low as 25% for Claude 3.7 Sonnet and 39% for DeepSeek-R1. To extend this evaluation across the open-weight ecosystem, this study tests 12 open-weight reasoning models spanning 9 architectural families (7B–685B parameters) on 498 multiple-choice questions from MMLU and GPQA Diamond, injecting six categories of reasoning hints (sycophancy, consistency, visual pattern, metadata, grader hacking, and unethical information) and measuring the rate at which models acknowledge hint influence in their CoT when hints successfully alter answers. Across 41,832 inference runs, overall faithfulness rates range from 39.7% (Seed-1.6-Flash) to 89.9% (DeepSeek-V3.2-Speciale) across model families, with consistency hints (35.5%) and sycophancy hints (53.9%) exhibiting the lowest acknowledgment rates. Training methodology and model family predict faithfulness more strongly than parameter count, and keyword-based analysis reveals a striking gap between thinking-token acknowledgment (approximately 87.5%) and answer-text acknowledgment (approximately 28.6%), suggesting that models internally recognize hint influence but systematically suppress this acknowledgment in their outputs. These findings carry direct implications for the viability of CoT monitoring as a safety mechanism and suggest that faithfulness is not a fixed property of reasoning models but varies systematically with architecture, training method, and the nature of the influencing cue. K eywords Chain-of-Thought \cdot Faithfulness \cdot Reasoning Models \cdot AI Safety \cdot Open-Weight Models 1 Introduction As large language models are deployed in increasingly high-stakes settings, from medical diagnosis and legal reasoning to autonomous code generation, the ability to monitor and verify their reasoning processes becomes a critical safety requirement. Chain-of-thought (CoT) reasoning, in which models produce step-by-step explanations before arriving at a final answer, has been widely adopted as a transparency mechanism: if a model’s reasoning is visible, human overseers can potentially detect flawed logic, biased reasoning, or deceptive intent before harm occurs [ 1 ] . This promise is especially significant for reasoning models (systems explicitly trained to produce extended thinking traces via reinforcement learning) which now dominate benchmarks in mathematics, science, and coding [ 2 , 3 ] . However, the safety value of CoT monitoring rests on a crucial assumption: that the chain of thought faithfully represents the model’s actual reasoning process. If models can be influenced by factors they do not acknowledge in their CoT, then monitoring these traces provides a false sense of security [ 4 , 5 ] . A growing body of evidence suggests that CoT explanations are frequently unfaithful. Turpin et al. [ 6 ] demonstrated that biased features in prompts (such as suggested answers from a purported expert) systematically influence model outputs without being mentioned in the CoT, revealing structural gaps between stated and actual reasoning across multiple tasks on BIG-Bench Hard. Lanham et al. [ 7 ] further measured CoT faithfulness in Claude models by truncating, corrupting, and adding mistakes to reasoning chains, finding that the correlation between CoT content and model predictions varies substantially across tasks. Subsequent work established that sycophancy in RLHF-trained models is pervasive [ 8 ] and scales with model size [ 9 ] , while Roger and Greenblatt [ 10 ] showed that models can encode reasoning steganographically in CoT text, suggesting that surface-level monitoring may systematically underestimate the true divergence between stated and actual reasoning. Most critically, Chen et al. [ 11 ] conducted the most comprehensive evaluation to date, using six types of reasoning hints injected into MMLU and GPQA multiple-choice questions. Their results revealed that Claude 3.7 Sonnet acknowledges hints that influenced its answer only 25% of the time, while DeepSeek-R1 does so only 39% of the time, with unfaithful CoTs being paradoxically longer than faithful ones. A shared limitation across all of these studies is their narrow model coverage: existing evaluations test at most two to four models, leaving the vast and rapidly growing ecosystem of open-weight reasoning models almost entirely unexamined. What remains unknown is whether the low faithfulness rates observed in Claude and DeepSeek-R1 generalize across the broader open-weight reasoning model ecosystem, or whether they reflect properties specific to particular architectures, training methods, or model scales. Since early 2025, a diverse set of open-weight reasoning models has emerged spanning dense architectures from 7B to 32B parameters, mixture-of-experts (MoE) models exceeding 685B total parameters, and training pipelines ranging from pure reinforcement learning (GRPO, RL) to distillation, data-centric methods, and hybrid approaches. No study has systematically compared CoT faithfulness across these model families, leaving a critical gap in understanding which models, and which training paradigms, produce reasoning traces that can be reliably monitored for safety purposes. As Lightman et al. [ 12 ] demonstrated, step-level verification of reasoning outperforms outcome-level supervision, making the question of whether each reasoning step is honest, not merely correct, a first-order concern for AI safety. The present study addresses this gap with a large-scale, cross-family evaluation of CoT faithfulness in open-weight reasoning models. A total of 12 models spanning 9 architectural families, including DeepSeek, Qwen, MiniMax, OpenAI, Baidu, AI2, NVIDIA, StepFun, and ByteDance, are evaluated on 498 multiple-choice questions (300 from MMLU and 198 from GPQA Diamond) using the same six hint categories established by Chen et al. [ 11 ] , yielding 41,832 inference runs. Faithfulness is assessed using a two-stage classifier (regex pattern matching followed by a three-judge LLM panel), with Claude Sonnet 4 as an independent validation judge on all 10,276 influenced cases [ 13 ] . Two primary hypotheses are tested: (H1) faithfulness rates vary significantly across model families, reflecting differences in training methodology rather than scale alone; and (H2) certain hint types, particularly metadata and grader hacking, exhibit consistently lower faithfulness across all models, suggesting category-specific blind spots in CoT monitoring. All code, prompts, model outputs, and faithfulness annotations are released to support future research on CoT monitoring reliability. 2 Related Work 2.1 Chain-of-Thought Faithfulness The question of whether chain-of-thought explanations faithfully represent a model’s actual reasoning process has been investigated through several complementary methodologies. Jacovi and Goldberg [ 14 ] argued that faithfulness itself admits multiple valid definitions depending on the operationalization chosen, a concern borne out empirically by Parcalabescu and Frank [ 15 ] , who showed that different faithfulness measures yield divergent results on the same data. Young [ 13 ] demonstrated that this divergence extends to automated classifiers: three classification methodologies applied to the same 10,276 cases produce faithfulness rates spanning a 12.9-percentage-point range, with inter-classifier agreement as low as \kappa=0.06 for sycophancy hints. Turpin et al. [ 6 ] introduced the bias injection paradigm: by adding biasing features to few-shot prompts (e.g., labeling answers with positional patterns or attributing answers to authority figures), they showed that models on BIG-Bench Hard tasks are systematically influenced by features never mentioned in their CoT explanations. This established that CoT unfaithfulness is not merely occasional but reflects a structural gap between the reasoning a model

Read the complete text