To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models

Zihao Zhu, Hongbao Zhang, Ruotong Wang, Ke Xu, Siwei Lyu, Baoyuan Wu · 2025

Read To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models by Zihao Zhu, Hongbao Zhang, Ruotong Wang, Ke Xu, Siwei Lyu, Baoyuan Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12202.txt.

Description

Zihao Zhu and co-authors expose a way to switch off the thinking of reasoning models, then turn the same flaw to good use. Large reasoning models write out their thought process before answering, and special tokens mark where thinking starts and ends. Their 2025 study shows those markers can be manipulated so the model skips thinking entirely, a flaw they name the Unthinking Vulnerability, found across mainstream models.

As an attack, Breaking of Thought plants the bypass during fine-tuning or triggers it at run time, degrading answers. A recovery alignment defense partly patches it. As a tool, Monitoring of Thought uses the same switch from outside, stopping reasoning that runs long or turns risky. The authors say the flaw is architectural: models that cannot protect their own thinking cannot yet be trusted to reason unsupervised.

Catalog record

CREATORZihao Zhu, Hongbao Zhang, Ruotong Wang, Ke Xu, Siwei Lyu, Baoyuan Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE97 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-12202

Browse the full library · About the Tower of Babel