Understanding the Self-Reflection Mechanisms of LLMs through Biased Attitude Associations

Jingshen Zhang, Bo Wang, Boci Yang, Dongming Zhao, Ruifang He, Yuexian Hou, Zifei Yu · 2026

Read Understanding the Self-Reflection Mechanisms of LLMs through Biased Attitude Associations by Jingshen Zhang, Bo Wang, Boci Yang, Dongming Zhao, Ruifang He, Yuexian Hou, Zifei Yu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00600.txt.

Introduction

Zhang, Wang, and Yang probe how chat models mend their own slants when they stop and think. Self-thought in such models may cut bias on its own. It may also lock bias in, which is the fear they test. Their frame, ReBias-Lens, reads bias as leans in felt worth.

Worth leans twixt groups form the core trait they track. Sharp swings in those leans mark where bias grows. Two gauges split world-wide trends from niche group marks. Tests span four models and twelve group types. Leans smooth out layer by layer as thought deepens. End acts show less bias on the whole in their tests. Yet niche groups can see bias lock in or swell. The mend is thus picky, not a cure-all.

Catalog record

CREATORJingshen Zhang, Bo Wang, Boci Yang, Dongming Zhao, Ruifang He, Yuexian Hou, Zifei Yu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.00600

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Understanding the Self-Reflection Mechanisms of LLMs through Biased Attitude Associations Jingshen Zhang, Bo Wang, Boci Yang, Dongming Zhao, Ruifang He, Yuexian Hou, Zifei Yu Abstract While the emergent self-reflection capabilities of Large Language Models (LLMs) offer a promising paradigm for autonomous bias mitigation, their internal mechanics remain unclear, raising concerns regarding potential bias entrenchment. Under the premise that social bias is intrinsically encoded as valence inclinations, where the exacerbation of bias scales with sharper valence fluctuations across social groups, this paper proposes ReBias-Lens , a probing framework designed to interpret how self-reflection reconfigures these biased attitude associations through the lens of valence projection within intersectional contexts. Central to ReBias-Lens is the metric of Valence Fluctuation (VF) comprising two variants: Global-VF , which captures macroscopic valence encoding trends, and Local-VF , which scrutinizes microscopic distinctiveness across specific social categories. Deploying ReBias-Lens to evaluate four LLMs across twelve social categories reveals that overall valence fluctuations undergo a distinct layer-wise smoothing, characterized by a significant hierarchical representation divergence as the layers deepen, which ultimately manifests as a widespread mitigation of bias at the behavioral level. In stark contrast to this macro-level reduction, this reflection mechanism is not universally corrective, instead exhibiting a stubborn, category-specific selectivity that regularly locks in and perversely amplifies localized biases. Warning: this paper contains examples with biased content. github.com/JasonZhang0702/rebias-lens † † footnotetext: † Corresponding author. 1 Introduction Leveraging superior in-context learning, Large Language Models (LLMs) have demonstrated surprising emergent self-reflection capabilities, offering a novel paradigm for autonomous decision-making and safety governance 37 ; 17 ; 10 ; 32 ; 47 ; 25 . This potential is especially pronounced in algorithmic fairness, where self-reflection mechanisms offer a promising avenue to mitigate stereotypically biased content 12 ; 6 ; 4 ; 28 ; 47 ; 11 . Yet, recent evidence suggests that self-reflection is not inherently synonymous with neutrality; conversely, it may precipitate self-preference amplification and systemic overconfidence 44 ; 34 ; 45 ; 46 . Confronting these latent vulnerabilities, this study argues that the advancement of self-reflection necessitates interpretability interventions to expose and preemptively disrupt bias entrenchment within LLMs, thereby paving the way for more reliable autonomous agent self-evolution. Previous works have systematically evaluated the prerequisites for effective self-reflection from a behavioral perspective 19 , yet failed to investigate the underlying mechanisms. Concurrently, other studies have employed probing techniques to trace the inter-layer propagation of toxicity during self-reflection 26 ; 27 , yet they rely on explicit toxicity metrics that struggle to capture the implicit and nuanced value inclinations inherent in social biases. These collective limitations underscore a critical research lacuna: the lack of an internal, granular lens capable of deciphering how LLMs process subtle, implicit biases during self-reflection. To bridge this gap, this paper proposes ReBias-Lens , an interpretability framework that integrates valence projection technology within intersectional contexts. Specifically, it operationalizes social biases as measurable shifts along the internal valence spectrum, utilizing intersectional prompts as a diagnostic lens to expose implicit prejudices. Consequently, this framework enables a multidimensional and dynamic investigation of how self-reflection reconfigures biased attitude associations. Central to ReBias-Lens is the quantification of Valence Fluctuation (VF) comprising two variants: Global-VF , which captures macroscopic valence encoding trends, and Local-VF , which scrutinizes microscopic distinctiveness across specific social categories (Section 3 ). By decoupling these fluctuations, ReBias-Lens provides a granular lens to dissect the mechanics of self-reflection. We deploy this framework across four representative LLMs and twelve social categories. Our analysis is guided by following three hierarchically organized research questions: RQ1: To what extent does self-reflection systematically modulate the magnitude of bias via cross-sample VF? This question seeks to provide a macroscopic account of how self-reflection restructures biased attitude associations, examining whether it mitigates or amplifies bias and how these impacts are expressed in behavioral outputs, thus supporting mechanistic analyses in subsequent research questions. Experimental results demonstrate that self-reflection drives stable valence smoothing, with Global-VF reduced by more than 73% on average across models and templates. Moreover, our framework not only clarifies the mechanics of LLMs’ normative behaviors but also offers a new tool for analyzing exaggerated safety phenomena (Section 4.1 ). RQ2: Do observed smoothing effects of VF originate from specific neural layers? This question is motivated by our observation that VF displays distinctive hierarchical smoothing across model layers. To answer it, we first employ a change-point detection algorithm to identify the key transition layer l^{*} , then conduct layer-wise window-based weight ablation centered on the l^{*} . Our results show that the bias mitigation effect is robust to local network perturbations, with increased robustness observed in deeper layers (Section 4.2 ) . RQ3: Does this VF smoothing operate uniformly across categories versus exhibiting group-specific selective biases? This question advances the findings of RQ1 and RQ2 by investigating category-specific bias dynamics. We conduct a Triple-State comparison across the Stereotype Baseline, Intact Self-Reflection, and Ablated Self-Reflection conditions using Local-VF. While bias mitigation efficacy exceeds 50% across categories and models, we identify a critical and underaddressed issue: consistent bias amplification across all evaluated models, which is even more impactful than the original stereotypical encoding (Section 4.3 ). Our core contribution lies in constructing an intersectional context and employing valence-based probing to investigate the internal mechanisms of self-reflection. This approach not only effectively addresses the uninterpretability of external model behaviors but also mitigates instability caused by prompt sensitivity, offering a new perspective for implicit bias analysis and trustworthy self-evolution of autonomous agents. 2 Related Work 2.1 Interpretability for Bias Research In social psychology, biased attitude associations have long remained a central research focus 38 ; in the context of LLMs, such bias is inherently rooted in word embeddings. To evaluate biased associations within embeddings, inspired by the Implicit Association Test (IAT) 13 , 5 5 proposed Word Embedding Association Test (WEAT), which quantifies internal biases using cosine similarity. To address WEAT’s limitations regarding its reliance on static embeddings, subsequent studies have developed context-aware detection methods 30 ; 14 ; 43 ; 8 . Recently, empirical studies have highlighted that the intrinsic anisotropy of contextual word embeddings impairs the reliable evaluation of embedding semantics via metrics such as cosine similarity 43 ; 36 . To mitigate these geometric distortions, some research leverages latent subspace projection to isolate specific semantic dimensions, which establishes a robust foundation for quantifying biased attitude associations 29 ; 9 ; 22 ; 36 ; 21 ; 41 . 2.2 Self-Reflection for Bias Research In psychology, self-reflection refers to a high-level cognitive process in which individuals scrutinize their internal states by integrating innate cognitive frameworks with empirical personal experiences 15 ; in the context of LLM fairness, self-reflection facilitates the mitigation of stereotypical biases by overriding the probabilistic associations rooted in massive training corpora, thereby reducing harmful social biases and discriminatory behaviors in their outputs 12 ; 6 ; 4 ; 47 ; 11 . While self-reflection is often conceptualized as a corrective mechanism, recent empirical studies reveal that it may diverge from its intended neutrality, potentially precipitating self-preference amplification and systemic overconfidence 44 ; 45 . Thus, advancing self-reflection in LLMs requires interpretability interventions to expose and prevent the entrenchment of biases and value drift. To explore the self-reflection mechanisms of LLMs, 19 19 systematically analyzed the

Read the complete text