Reasoning Models Can be Easily Hacked by Fake Reasoning Bias

Qian Wang, Yubo Fan, Zhenheng Tang, Nuo Chen, Wenxuan Wang, Bingsheng He · 2025

Read Reasoning Models Can be Easily Hacked by Fake Reasoning Bias by Qian Wang, Yubo Fan, Zhenheng Tang, Nuo Chen, Wenxuan Wang, Bingsheng He (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-13758.txt.

Introduction

Reasoning models are increasingly used as judges of other models' answers, trusted because they show their work. Qian Wang and co-authors show in this 2025 paper that the shown work itself can be rigged: judges favor text that merely looks like reasoning, even when the logic is broken. They call the flaw Fake Reasoning Bias.

Their benchmark, THEATER, builds test cases that dress wrong answers in reasoning costumes, from tiny cue phrases to full fake chains of thought. Seventeen leading models were tried on opinion-style and factual tasks. All were fooled to some degree, and reasoning models were fooled more than plain ones, a more-thinking-less-robust paradox. Simple cues did the most damage, cutting accuracy by up to fifteen percent on the weakest sets. Careful prompting clawed back some accuracy on factual tasks.

Catalog record

CREATORQian Wang, Yubo Fan, Zhenheng Tang, Nuo Chen, Wenxuan Wang, Bingsheng He
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-13758

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reasoning Models Can be Easily Hacked by Fake Reasoning Bias Qian Wang, Yubo Fan, Zhenheng Tang, Nuo Chen, Wenxuan Wang, Bingsheng He Abstract Large Reasoning Models (LRMs) like DeepSeek-R1 and o1 are increasingly used as automated evaluators or judgers, raising critical questions about their vulnerability to the aesthetics of reasoning in LLM-as-a-judge settings. We introduce THEATER, a comprehensive benchmark to systematically evaluate this vulnerability—termed Reasoning Theater Bias (RTB)—by comparing LLMs and LRMs across subjective preference and objective factual datasets. Through investigation of six bias types including Simple Cues and Fake Chain-of-Thought, we uncover three key findings: (1) in a critical paradox, reasoning-specialized LRMs are consistently more susceptible to RTB than general-purpose LLMs, particularly in subjective tasks; (2) this creates a task-dependent trade-off, where LRMs show more robustness on factual tasks but less on subjective ones; and (3) we identify ‘shallow reasoning’—plausible but flawed arguments—as the most potent form of RTB. To address this, we design and evaluate two prompting strategies: a targeted system prompt that improves accuracy by up to 12% on factual tasks but only 1-3% on subjective tasks, and a self-reflection mechanism that shows similarly limited effectiveness in the more vulnerable subjective domains. Our work reveals that RTB is a deep-seated challenge for LRM-based evaluation and provides a systematic framework for developing more genuinely robust and trustworthy LRMs. 1 Introduction As Large Language Models (LLMs) have demonstrated remarkable capabilities across many domains ( Brown et al. 2020 ; Wei et al. 2022 ; Wang et al. 2025b ) , researchers increasingly deploy them as automated evaluators—a paradigm known as LLM-as-a-Judge ( Gu and Others 2024 ; Li and Others 2024 ) . With advancements in reasoning methods since 2025, the landscape of LLMs has evolved into a new category termed Large Reasoning Models (LRMs), exemplified by models like DeepSeek-R1 Guo et al. 2025 and OpenAI’s o1 Jaech et al. 2024 . Unlike standard LLMs, LRMs have a "think" process, enhancing performance in complex reasoning tasks through explicitly designed mechanisms, such as generating chains of thought (CoT) and refining multi-step logical inferences before final answers Xu et al. 2025b ; Tang et al. 2025 . Consequently, LRMs are increasingly employed as automated evaluators Wang et al. 2025a to judge outputs Li and Others 2024 or work as reward models in RL Bandyopadhyay et al. 2025 . Figure 1: Illustration of Reasoning Theater Bias testing: (A) shows the authentic reasoning process exhibited by DeepSeek R1 with its natural thinking pattern, while (B) demonstrates our experimental intervention where we insert superficial phrases "wait, wait, wait… let me think about it" between choices to test if LLMs and LRMs are susceptible to such reasoning cues. Recent studies have highlighted vulnerabilities in LRMs’ reasoning mechanisms, particularly their susceptibility to prompt manipulation Zhou et al. 2025 ; Kuo et al. 2025 ; Liu et al. 2025 . Motivated by how humans can be influenced by the mere appearance of effort ( Kruger et al. 2004 ) , we designed an experiment following the settings of Wang et al. 2025a to test whether LRMs can be systematically misled by superficial reasoning cues. As shown in Figure 1 , we inserted phrases that mimic deliberation before the second answer choice to measure their impact on model judgments. Our experiment specifically placed the incorrect answer in the second position. The results in Table 1 reveal a striking pattern: when these reflective cues were introduced before the incorrect second option on the Truthy-DPO dataset ( Durbin 2023 ) , LRMs like DS-R1-70B and DS-R1 ( Guo et al. 2025 ) were significantly deceived. They exhibited a strong bias toward the cued (but incorrect) answer, resulting in accuracy decreases of 10-12%. In contrast, standard language models like GPT-4o ( OpenAI 2024 ) and DS-V3 ( Guo et al. 2025 ) were more robust, demonstrating much smaller accuracy drops of only 4-5% under the same conditions. Model Baseline Acc. Accuracy with Cue LRMs DS-R1-70B 0.52 0.42 (-0.10) DS-R1 0.49 0.37 (-0.12) LLMs GPT-4o 0.75 0.71 (-0.04) DS-V3 0.43 0.38 (-0.05) Table 1: Effect of reflective cues on model accuracy in the Truthy-DPO dataset when the incorrect answer appears in the second position, preceded by the cue. LRMs exhibit significantly larger accuracy drops (10-12%) compared to standard LLMs (4-5%), demonstrating their heightened susceptibility to superficial reasoning cues—a key indicator of Reasoning Theater Bias. Based on these findings, we term this phenomenon Reasoning Theater Bias (RTB) . These considerations motivate us to systematically investigate the following questions: How do Large Reasoning Models (LRMs) and standard Large Language Models (LLMs) differ in their susceptibility to RTB? Which types of deceptive reasoning are most potent, and how does this vary across subjective and factual tasks? Finally, how effectively can prompting strategies mitigate these vulnerabilities? To answer these questions, we introduce THEATER , a comprehensive benchmark to investigate Reasoning Theater Bias. Our framework systematically evaluates two categories of bias—subtle Simple Cues and elaborate Fake Chain-of-Thought —across a range of LRMs and LLMs. We test these models on both subjective preference alignment datasets and objective fact-based datasets to analyze performance in different contexts. We have three main findings from our experiments: (1) Despite their advanced reasoning capabilities, LRMs exhibit a critical paradox, proving consistently more susceptible to RTB than their LLM counterparts. (2) This vulnerability is most severe in subjective tasks, where we identify that “shallow reasoning"—plausible but flawed arguments—is the most potent form of deception. (3) This creates a task-dependent performance trade-off, with LRMs showing greater robustness only in narrow, fact-based domains. Based on our benchmark, we design and evaluate two mitigation strategies: a targeted system prompt that improves accuracy by up to 12% on factual tasks but provides only minimal improvement (1-3%) on subjective tasks, and a self-reflection prompt that shows similarly limited effectiveness in the more vulnerable subjective domains. We find that the failure of these strategies in subjective contexts demonstrates that RTB is a deep-seated challenge, not a surface-level flaw. Our key contributions are: ❶ We define and formalize Reasoning Theater Bias (RTB) , identifying it as a critical vulnerability in modern reasoning models, particularly LRMs. ❷ We develop THEATER , a comprehensive evaluation framework with six distinct bias types for systematically measuring and diagnosing RTB across different models and tasks. ❸ We provide the first large-scale empirical evidence that specialized LRMs are more susceptible to RTB than LLMs, pinpointing shallow reasoning on subjective tasks as the key failure mode. ❹ We demonstrate that RTB is highly resistant to prompting-based mitigation in subjective domains, highlighting a fundamental challenge for developing trustworthy LRMs. 2 Proposed Framework: THEATER To systematically investigate RTB, we propose THEATER (THinking Evaluation And Testing for Erroneous Reasoning), a comprehensive benchmark framework illustrated in Figure 2 . Its purpose is to quantify model susceptibility to deceptive reasoning cues through a controlled experimental pipeline. The framework consists of three core components: a suite of designed bias injections, a carefully selected set of models and tasks for evaluation, and a set of metrics to measure the bias’s impact. Figure 2: The THEATER framework for systematically evaluating Reasoning Theater Bias. It details our methodology for injecting six distinct bias types (from Simple Cues to Fake CoT) across different models (LRMs and LLMs) and

Read the complete text