KnowBias: Mitigating Social Bias in LLMs via Know-Bias Neuron Enhancement
Jinhao Pan, Chahat Raj, Anjishnu Mukherjee, Sina Mansouri, Bowen Wei, Shloka Yada, Ziwei Zhu · 2026
Read KnowBias: Mitigating Social Bias in LLMs via Know-Bias Neuron Enhancement by Jinhao Pan, Chahat Raj, Anjishnu Mukherjee, Sina Mansouri, Bowen Wei, Shloka Yada, Ziwei Zhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21864.txt.
Introduction
Jinhao Pan and co-authors study how large language models pick up social bias. Models can repeat harmful stereotypes, which limits their safe use. Most attempts to debias them work by suppression: changing parameters, prompts, or the neurons tied to biased behavior.
The authors argue that suppression is brittle, generalizes weakly, wastes data, and can damage general ability. Their 2026 preprint, called KnowBias, takes the opposite road and enhances neurons tied to knowledge about bias itself. Strengthening a model's own grasp of stereotypes, rather than muting parts of it, could offer a steadier fix. The debate matters because these models now answer questions for millions of people every day.
Catalog record
| CREATOR | Jinhao Pan, Chahat Raj, Anjishnu Mukherjee, Sina Mansouri, Bowen Wei, Shloka Yada, Ziwei Zhu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21864
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
KnowBias: Mitigating Social Bias in LLMs via Know-Bias Neuron Enhancement Jinhao Pan, Chahat Raj, Anjishnu Mukherjee, Sina Mansouri, Bowen Wei, Shloka Yada, Ziwei Zhu Abstract Large language models (LLMs) exhibit social biases that reinforce harmful stereotypes, limiting their safe deployment. Most existing debiasing methods adopt a suppressive paradigm by modifying parameters, prompts, or neurons associated with biased behavior; however, such approaches are often brittle, weakly generalizable, data-inefficient, and prone to degrading general capability. We propose KnowBias , a lightweight and conceptually distinct framework that mitigates bias by strengthening, rather than suppressing, neurons encoding bias-knowledge. KnowBias identifies neurons encoding bias knowledge using a small set of bias-knowledge questions via attribution-based analysis, and selectively enhances them at inference time. This design enables strong debiasing while preserving general capabilities, generalizes across bias types and demographics, and is highly data efficient, requiring only a handful of simple yes/no questions and no retraining. Experiments across multiple benchmarks and LLMs demonstrate consistent state-of-the-art debiasing performance with minimal utility degradation. Data and code are available at https://github.com/JP-25/KnowBias . 1 Introduction Despite the impressive capabilities of large language models (LLMs) ( 43 ; 31 ; 24 ) , extensive empirical evidence demonstrates that they systematically encode and reproduce social biases ( 33 ; 34 ; 11 ; 16 ; 5 ) . Such behaviors induce representational harms by reinforcing harmful stereotypes and unjust social associations ( 1 ; 14 ; 4 ; 35 ) . Mitigating social bias in LLMs is therefore not merely a technical challenge, but a critical societal requirement for the responsible deployment of foundation models ( 11 ) . Figure 1 : Large Language Models (LLMs) show social bias but also know this bias simultaneously. Our method enhances the know-bias neurons in LLMs to mitigate social biases. A large body of recent work mitigates social bias in LLMs via prompt steering, fine-tuning, model editing, activation steering, or neuron-level intervention ( 23 ; 36 ; 17 ; 49 ; 42 ; 12 ; 45 ; 2 ) . Despite their differences, most of these methods share a bias behavior suppressing paradigm: they attempt to suppress biased behavior through explicit prompting or by updating/modifying model parameters or neurons. However, this paradigm inherits three structural weaknesses. (1) Fragile adherence . Prompt-based defenses rely on carefully engineered instructions or exemplars, yet compliance is brittle; the same prompt often fails to carry over across tasks, phrasings, or demographics. (2) Data inefficiency and limited generalization . Training- and editing-based approaches typically require bias-annotated data, making them data-hungry and costly to scale. Moreover, these methods are often anchored in curated bias instances, which can limit generalization to unseen bias types and demographics. (3) Degraded general capability . Social bias is distributed across highly superposed representations ( 10 ; 26 ) . As a result, suppressing bias-correlated neurons can induce unintended regressions in unrelated behaviors ( 47 ; 45 ; 42 ) . Together, existing debiasing methods are often brittle, weakly generalizable, data-inefficient, and prone to degrading general capability ( 8 ; 48 ; 37 ) . These limitations motivate robust, data-efficient, and generalizable debiasing strategies that maintain a more favorable fairness-utility trade-off. In this work, we advocate a complementary and conceptually distinct paradigm: instead of suppressing biased behavior directly, we leverage the model’s internal knowledge of bias. In human cognition, awareness of bias is empirically associated with reduced reliance on biased judgments ( 7 ; 39 ) . Motivated by this observation, we hypothesize that LLMs encode bias knowledge (recognizing when a statement, ideology, or opinion is biased) in latent neuronal representations, and that biased behavior can be mitigated by activating this knowledge during generation. As illustrated in Figure 1 (a) and (b), LLMs often exhibit awareness of specific social biases while still producing biased content, revealing a systematic disconnect between knowledge and behavior. We posit that selectively enhancing neurons that encode bias knowledge ( know-bias neurons ), without intervening on neurons directly associated with bias behavior, can causally steer the model toward fairer behavior while preserving general capability (Figure 1 (c)). Building on this insight, we introduce KnowBias , a model-agnostic, inference-time debiasing framework that reduces social bias by selectively enhancing know-bias neurons during generation. Know-bias neurons are identified using a small set of simple bias-knowledge questions that probe the model’s ability to recognize biased opinions. This design yields three key advantages. (1) Strong debiasing and utility : KnowBias achieves strong bias mitigation while preserving general capability, attaining the best average rank (2.1) across all social bias benchmarks in Section 3.2 . (2) Generalizability : the debiasing effects transfer robustly across bias types and demographics (Sections 3.3 and 3.5 ). (3) Data efficiency : a core set of know-bias neurons can be recovered using only a small number of bias-knowledge questions (45 questions across three demographic dimensions) while achieving optimal debiasing performance (Sections 3.4 and 3.5 ). Empirically, KnowBias achieves consistent state-of-the-art performance across five social bias benchmarks and three LLM backbones, while maintaining general ability as measured on four standard datasets. Figure 2 : KnowBias workflow (see Algorithm 1 for details about know-bias neurons identifications and enhancement). 2 Methodology KnowBias mitigates social bias by identifying and enhancing neurons that encode bias knowledge, rather than suppressing neurons that directly manifest biased behaviors. This design is inspired by cognitive science: humans who possess the knowledge of how social bias manifests in daily life are less likely to rely on biased judgments. ( 7 ; 39 ) . Analogously, we posit that LLMs encode knowledge of social bias in latent neuronal representations. Such neurons support the model’s ability to recognize biased content, and we term them know-bias neurons . By enhancing such know-bias neurons at inference time, KnowBias steers generation toward fairer behavior while preserving general capabilities. Table 1 : Bias-knowledge question examples (bias concept: problem-solving) used to identify know-bias neurons. The demographic dimension (e.g., race ) can be replaced by gender or religion with the same expected answers. Question type Example Ans Causal rejection Do you think that race influences problem-solving skills? No Bias recognition Is believing one race has stronger problem-solving skills than another a form of racial bias? Yes Normative judgment Do you think it is racial bias to believe one race has better problem-solving skills than another? Yes 2.1 Overview We propose KnowBias, a data-efficient and generalizable debiasing framework that achieves strong bias mitigation while preserving general model utility. KnowBias operates in three stages: (1) It elicits bias-knowledge signals using a small set of bias-knowledge questions designed to probe whether the model can recognize biased content (Figure 2 KnowBias Workflow Step 1). (2) It identifies know-bias neurons through attribution-based analysis aggregated across demographic dimensions (Figure 2 KnowBias Workflow, Steps 2-3). (3) KnowBias selectively enhances these neurons at inference time, without retraining or modifying model parameters (Figure 2 , Step 4 and Debias Inference). This design yields three key advantages. (1) Strong debiasing with preserved general capability. KnowBias achieves effective bias mitigation while largely preserving general capability. (2) Generalizability. A set of bias-knowledge questions built on general bias concepts and demographic dimensions suffices to recover a core set of neurons encoding bias knowledge, enabling debiasing effects to generalize across bias types and demographics. (3) Data efficiency. The simplicity of