Monitoring the Internal Monologue: Probe Trajectories Reveal Reasoning Dynamics

Maciej Chrabąszcz, Aleksander Szymczyk, Marcin Sendera, Tomasz Trzciński, Sebastian Cygert · 2026

Read Monitoring the Internal Monologue: Probe Trajectories Reveal Reasoning Dynamics by Maciej Chrabąszcz, Aleksander Szymczyk, Marcin Sendera, Tomasz Trzciński, Sebastian Cygert (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18549.txt.

Introduction

Maciej Chrabąszcz and four co-authors ask, in a 2026 paper, whether large reasoning models' next moves can be foreseen from hidden representations. Scoring a probe at each new token builds a probe trajectory, the shifting odds of a concept across reasoning. Full paths split future model states better than single static guesses. Signal traits tracking swing, trend, and steady state lift splitting further, and max-pooling hits up to 95 percent AUROC where average-pooling falls near random.

Catalog record

CREATORMaciej Chrabąszcz, Aleksander Szymczyk, Marcin Sendera, Tomasz Trzciński, Sebastian Cygert
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72148
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.18549

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Monitoring the Internal Monologue: Probe Trajectories Reveal Reasoning Dynamics Maciej Chrabąszcz, Aleksander Szymczyk, Marcin Sendera, Tomasz Trzciński, Sebastian Cygert Abstract Large Reasoning Models (LRMs) introduce new opportunities for safety monitoring through their Chain of Thought (CoT) reasoning. However, CoT is not always faithful to the model’s final output, undermining its reliability as a monitoring tool. To address this, we investigate the hidden representations of LRMs to determine whether future behavior can be predicted from prompt and CoT representations. By evaluating a probe at each generated token, we construct a probe trajectory, the continuous evolution of a concept’s probability across the reasoning process. We find that future model behavior is more distinguishable when examined over the full trajectory than from a single static prediction. To characterize these temporal dynamics, we extract signal-processing features that capture volatility, trend, and steady-state behavior, significantly improving the separation of future model states. We also present two methodological insights. First, template-based training data achieves near-parity with dynamically generated model responses, eliminating the need for a costly initial inference and labeling. Second, the choice of pooling operation is critical: average-pooling and last-token methods collapse to near-random performance, while max-pooling achieves up to 95 % 95\% AUROC and yields stable probe trajectories. Using four datasets and four reasoning models across the domains of safety and mathematics, we demonstrate that trajectory features encode task-specific dynamics that improve outcome separability. These findings establish probe trajectories as a complementary framework for monitoring LRM behavior. Warning: This article contains potentially harmful content. Figure 1 : Overview of the trajectory-based analysis framework. (a) Surface-level CoT is unfaithful to the final output in over 10% of cases, necessitating latent monitoring to ensure safety. (b) Our framework monitors hidden representations to generate probe trajectories, from which we extract signal features (e.g., statistical state and trend dynamics) that are more expressive of true intent than surface-level text. (c) Tracking these trajectories captures temporal dynamics that distinguish behaviors even when the generated text is misleading. Notably, the extracted signal features make it easier to differentiate between unfaithful cases: those with a safe response despite an unsafe CoT ( violet line ) and those with an unsafe response despite a safe CoT ( orange line ). 1 Introduction LRMs like Deepseek-R1 [ 20 ] have advanced complex task-solving and agentic capabilities, prompting a paradigm shift in which nearly all frontier proprietary models [ 2 , 13 , 39 ] now utilize reasoning traces. While these capabilities have sparked an interest in AI safety [ 8 ] , they also present a unique opportunity: monitoring CoT [ 27 , 4 , 6 ] to understand and predict model behavior. The foundational premise of text-based CoT monitoring (e.g., using a trusted LLM) is that the generated text faithfully reflects the model’s internal reasoning. However, recent studies reveal a critical flaw in relying solely on text: CoT is not always a faithful explanation of the model’s response [ 7 , 24 , 3 , 10 , 30 ] . This introduces a performance ceiling for text-based CoT monitoring. To quantify this barrier, we evaluated 4 models on WildGuardMix [ 21 ] and Aegis [ 18 ] data, assessing how closely the CoT matched the final response harmfulness. As shown in Figure 1 (a), the CoT is unfaithful in 5--10% of samples, i.e., cases where the CoT appears safe but the final response is harmful, and vice-versa 1 1 1 We provide examples of unfaithful CoT in Appendix D . . To extract more faithful knowledge from the CoT, we draw on Representation Engineering [ 47 ] and Mechanistic Interpretability [ 16 ] , which leverage internal model representations to monitor and steer behavior. Probes [ 1 ] trained on these hidden states have proven highly effective, whether using non-linear [ 37 ] or multi-layer [ 11 ] approaches, at detecting high-stakes interactions and safety violations [ 36 ] , strategic deception [ 19 ] , mathematical errors [ 45 ] , and hallucinations [ 33 ] . Furthermore, Ashok and May 2026 has shown that prompt representations alone can predict future model actions. The ability to forecast correctness from internal states builds on earlier CNN research, where meta-models trained on activations were used to predict the accuracy of vision models [ 15 , 26 ] . However, it is unclear how to extend those methods to LRMs with very long CoTs. Building on this foundation, we shift the focus from textual CoT to what we term the model’s internal monologue , i.e., the sequence of latent representations produced during CoT generation, and conduct an empirical analysis of how these representations evolve during reasoning. To robustly capture the model’s internal state, we utilize multi-layer representations integrated via an efficient Multiple Instance Learning (MIL) meta-probe. By tracking probe predictions sequentially across the generation process, we extract continuous probe trajectories and characterize them using signal-processing features that capture temporal dynamics, volatility, and steady-state behavior. We evaluate probe trajectories across two distinct domains, response-harmfulness and math-error prediction, and find that max pooling is critical: average pooling and last-token extraction collapse to near-random performance (AUROC \sim 50%), while max pooling consistently achieves > 90% AUROC and produces substantially more stable trajectories. We further show that template-based training data achieves near-parity with expensive model-generated responses for concept detection, while outperforming raw message-based training. The main contributions of this work are as follows: We introduce continuous probe trajectories via a MIL meta-probe, providing a novel framework for analyzing how behavioral intent is dynamically encoded across the reasoning process (see Section 2 ). We demonstrate that CoT probe trajectories exhibit distinct dynamics , providing rich signals that enable more robust forecasting of future behaviors compared to static probes (see Figure 3 ). We validate that template-based training data is sufficient for high-quality probes , showing that static templates achieve near-parity in concept separation compared to dynamically generated model responses, eliminating the costly overhead of generating exact reasoning traces (see Table 1 ). We reveal that max-pooling is essential for stable intent forecasting : standard average-pooling and last-token methods collapse to near-random performance (AUROC \sim 50%), while max-pooling consistently achieves > 90% AUROC and yields highly stable probe trajectories (see Table 1 ). 2 From Hidden States to Behavioral Trajectories Our primary objective is to forecast an LRM’s final output solely by leveraging its internal hidden states during the prompt and CoT phases, thereby mitigating the risks associated with deceptive or unfaithful CoT. To decode this internal reasoning process, we employ lightweight, non-linear classifiers that continuously track latent knowledge across generated tokens. The following section outlines our data curation pipeline, comparing template-based, message-based, and dynamically generated datasets, along with the specific probe architecture used to generate trajectories. Training data. We curate three distinct data pipelines to train and evaluate the concept probes: Template-Based: We inject samples from a base dataset into a predefined template, asking the target model whether a specific concept is present. The ground-truth labels are inherited directly from the underlying dataset. Message-Based: Using the same underlying datasets as the template approach, we pass the raw messages directly through the model using the model’s chat template, with labels remaining consistent with the source dataset. Exact Model Messages-Based: To

Read the complete text