MENTIS: What Belief Changes Under Alignment? Measuring Multi-Scale Latent Torsion in Language Models

Partha Pratim Saha, Samarth Raina, Mayur Parvatikar, Amit Dhanda, Vinija Jain, Aman Chadha, Amitava Das, [4pt] Pragya Lab, BITS Pilani Goa, India · 2026

Read MENTIS: What Belief Changes Under Alignment? Measuring Multi-Scale Latent Torsion in Language Models by Partha Pratim Saha, Samarth Raina, Mayur Parvatikar, Amit Dhanda, Vinija Jain, Aman Chadha, Amitava Das, [4pt] Pragya Lab, BITS Pilani Goa, India (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01060.txt.

Introduction

Saha and co-authors measure what alignment does inside a language model in this 2026 paper. Preference alignment polishes a model's outward behavior. Jailbreaks and prompt attacks still slip through, which hints the inside tells a richer story. Post training should leave traces in the model's internal geometry. The team asks where those traces sit and how selective they are.

Their framework, MENTIS, compares paired checkpoints: instruction tuned versus preference aligned. A layer wise covariance based torsion norm leads, backed by a spectral check and a depth locator score. Four model pairs in the seven to eight billion range face the LITMUS suite. Change is selective, not uniform, they find. Normative concepts shift more than factual ones on average. Torsion falls as contextual entropy rises. Peak effects sit in mid to late layers, at spots that vary by architecture.

Catalog record

CREATORPartha Pratim Saha, Samarth Raina, Mayur Parvatikar, Amit Dhanda, Vinija Jain, Aman Chadha, Amitava Das, [4pt] Pragya Lab, BITS Pilani Goa, India
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.01060

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MENTIS: What Belief Changes Under Alignment? Measuring Multi-Scale Latent Torsion in Language Models Thanks: This work does not relate to Amit Dhanda’s position at Amazon. Thanks: This work does not relate to Vinija Jain’s position at Meta. Thanks: This work does not relate to Aman Chadha’s position at Apple. Partha Pratim Saha, Samarth Raina, Mayur Parvatikar, Amit Dhanda, Vinija Jain, Aman Chadha, Amitava Das, [4pt] Pragya Lab, BITS Pilani Goa, India Abstract Preference alignment has substantially improved the observable behavior of large language models, yet it remains unclear what alignment changes internally . Aligned systems still fail under jailbreaks, prompt injection, and retrieval-time corruption—suggesting behavior-level evaluation alone is incomplete . Post-training should leave measurable traces in internal computation. We ask: when an IT model becomes a PA model, what geometric structure changes , where do those changes concentrate, and how selectively do they vary across concepts, prompts, and model families? We introduce MENTIS , a geometry-first framework for measuring alignment-induced internal reorganization in paired checkpoints. MENTIS compares IT and PA models using a primary layerwise covariance-based torsion norm, T1 ; a secondary spectral torsion diagnostic, T2 ; and an Energy-Radiance-Activation measure, ERA , for depth localization. Across four 7–8B model pairs on LITMUS, our study reveals that alignment-induced change is selective rather than uniform : normative concepts exhibit larger torsion shifts than factual concepts on average; torsion is negatively correlated with contextual entropy; and peak effects localize to architecture-specific mid-to-late layers . The same pattern appears across (i) word-level , (ii) prompt-level , and (iii) model-level analyses. These results suggest preference alignment leaves structured, depth-localized geometric signatures in internal computation beyond what behavior-level evaluation alone can reveal. We release our code, data . 0.1 What We Mean by Belief: A Task-Conditioned Directional View The term belief is easy to overinterpret in language-model analysis. We therefore use it in a deliberately operational sense. In this paper, a belief is not a symbolic proposition, a human-like mental state, or an independently recoverable variable inside the model. Instead, it denotes a task-conditioned internal direction : a local direction in hidden-state space that increases support for a target continuation under a specified prompt, layer, and readout. Thus, when we speak of belief change , we mean a measurable change in this internal directional organization, not a claim that the model has revised a human-style belief. Table 1: Positioning MENTIS relative to prior belief and alignment diagnostics. Prior work studies behavioral outputs, preference-data values, factual associations, static hidden-state structure, or localized steering directions. MENTIS instead studies paired-checkpoint geometric reorganization : how task-conditioned internal directions change from Instruction-Tuned (IT) to Preference-Aligned (PA) models across concepts, prompts, and depth. Approach Behavior Belief-like Paired Depth Geometric audit internals IT \rightarrow PA localized change Output-level alignment evaluation ( 9 ; 13 ) ✓ ✗ ✗ ✗ ✗ Preference-data value audits ( 11 ) ✓ ✗ ✗ ✗ ✗ Factual-belief localization / editing ( 4 ; 10 ) ✗ ✓ ✗ ✓ ✗ Static residual-stream geometry ( 5 ; 14 ) ✗ ✓ ✗ ✓ ✗ Representation engineering / steering directions ( 16 ; 1 ) ✗ ✓ ✗ ✓ ✗ Checkpoint drift / CKA-style similarity ( 7 ) ✗ ✗ ✓ \triangle \triangle MENTIS ✗ ✓ ✓ ✓ ✓ Legend: ✓= explicitly supported; ✗= not the primary object of study; \triangle = partially supported but without task-conditioned directional torsion. This distinction is central to our framing. Prior work has shown that language models contain measurable internal structure: factual associations can be localized or edited ( 4 ; 10 ) , residual streams can encode belief-state-like geometry ( 5 ; 14 ) , and safety or refusal behavior can sometimes be mediated by low-dimensional activation directions ( 16 ; 1 ) . Other work studies alignment behavior or value structure through outputs and preference data ( 9 ; 13 ; 11 ) . MENTIS asks a different question: when an instruction-tuned checkpoint is transformed into a preference-aligned checkpoint, how does the task-conditioned internal direction itself reorganize across depth? A single-model probe may reveal that a representation is linearly decodable, or that a factual association is localized, but it does not directly measure the geometric update induced by preference alignment. MENTIS therefore treats belief change as alignment-induced directional reorientation : we compare IT and PA checkpoints under matched prompts and matched target continuations, then measure how the associated internal directions change in magnitude, angle, spectral structure, and depth localization. Table 1 summarizes this positioning. The key distinction is that MENTIS is not primarily a behavioral audit, a preference-data audit, or a static probe of hidden states. It is a comparative geometric diagnostic for measuring how alignment changes task-conditioned internal organization across words, prompts, and model families. 1 MENTIS: Alignment as Internal Geometric Reorganization 1.1 Operational View: Belief as Directional Support MENTIS treats preference alignment as a geometric transformation of internal computation. If post-training changes how a model supports, suppresses, or redirects task-relevant continuations, then that change should leave measurable traces in how hidden-state directions evolve across depth. We use “belief” only in an operational sense. It does not denote a symbolic proposition or a human-like mental state. Instead, it refers to a task-conditioned internal direction : the local direction in representation space that increases support for a target continuation. Thus, belief change means alignment-induced reorientation of this directional field, not philosophical belief revision. This gives MENTIS a narrow goal: compare an Instruction-Tuned (IT) checkpoint and its Preference-Aligned (PA) counterpart under matched prompts and targets, then ask where the internal geometry changes, how strongly it changes, and whether the change is selective across concepts, prompts, and model families. 1.2 Paired-Checkpoint Setup Let \theta^{(0)} denote the IT model and \theta^{(1)} its PA counterpart. For prompt x , let h_{\ell}^{(m)}(x)\in\mathbb{R}^{d},\qquad m\in\{0,1\},\quad\ell\in\{1,\dots,L\}, be the hidden representation at layer \ell . Each prompt induces a depth-indexed trajectory \mathcal{H}^{(m)}(x)=\bigl(h_{1}^{(m)}(x),h_{2}^{(m)}(x),\dots,h_{L}^{(m)}(x)\bigr). We also consider semantic subsets \mathcal{P}^{(c)} for value category c and \mathcal{P}^{(w)} for prompts associated with concept w . 1.3 Layerwise Directional Field Using the unembedding or equivalent readout operator W_{U} , we define a layer-indexed predictive distribution: p_{\theta^{(m)},\ell}(y\mid x)=\operatorname{softmax}\!\left(W_{U}h_{\ell}^{(m)}(x)\right)_{y}. In experiments, y is the first token of the gold response for each LITMUS 2 prompt. This keeps the readout tied to a concrete predictive object rather than to a pooled sequence-level surrogate. The layerwise directional field is v_{\ell}^{(m)}(x):=\nabla_{h_{\ell}^{(m)}(x)}\log p_{\theta^{(m)},\ell}(y\mid x). Geometrically, v_{\ell}^{(m)}(x) is the steepest local direction that increases support for y at layer \ell . For a semantic subset \mathcal{Q}\subseteq\mathcal{P} , we define v_{\ell}^{(m,\mathcal{Q})}:=\mathbb{E}_{x\sim\mathcal{Q}}\left[v_{\ell}^{(m)}(x)\right]. Figure 2 provides two motivating examples of this depthwise reorganization, showing that alignment changes torsion profiles differently across concept pairs. Figure 1: Depthwise torsion separates value-salient concepts. Layerwise T1 torsion profiles for JUSTICE and WAR under Instruction-Tuned (IT) and Preference-Aligned (PA) checkpoints. Alignment-induced reorganization is not uniform across concepts: the two semantic regions exhibit distinct torsional trajectories and different late-layer concentration patterns. Figure 2: Torsion geometry of JUSTICE across depth. Three-dimensional depthwise torsion trajectory for JUSTICE under IT and PA checkpoints, visualizing how alignment reshapes the concept-specific representational path across layers. 1.4 Alignment-Induced Directional Shift The local IT \rightarrow PA displacement at layer \ell is \Delta v_{\ell}(x)=v_{\ell}^{(1)}(x)-v_{\ell}^{(0)}(x). We summarize this displacement through magnitude and angle: \Delta_{\mathrm{mag},\ell}(x)=\left|\|v_{\ell}^{(1)}(x)\|-\|v_{\ell}^{(0)}(x)\|\right|, \Delta_{\mathrm{ang},\ell}(x)=\arccos\left(\frac{\langle v_{\ell}^{(0)}(x),v_{\ell}^{(1)}(x)\rangle}{\|v_{\ell}^{(0)}(x)\|\,\|v_{\ell}^{(1)}(x)\|}\right). Magnitude asks whether alignment

Read the complete text