Understanding How Value Neurons Shape the Generation of Specified Values in LLMs

Yi Su, Jiayi Zhang, Shu Yang, Xinhai Wang, Lijie Hu, Di Wang · 2025

Read Understanding How Value Neurons Shape the Generation of Specified Values in LLMs by Yi Su, Jiayi Zhang, Shu Yang, Xinhai Wang, Lijie Hu, Di Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17712.txt.

Introduction

Language models can mouth the right values while nobody knows where those values live inside the network. Yi Su and co-authors go looking for the addresses in a 2025 paper. Their framework, ValueLocate, is grounded in a classic survey of human values with four dimensions of universal value.

First they built a data set that stages opposing values in realistic behavior. Then they located value-critical neurons by comparing activations between the opposing sides, avoiding heavy attribution machinery. Turning those neurons up or down shifted the expressed values of the model in the expected direction. That causal check ties specific neurons to value representation. The authors offer the method as groundwork for aligning models more deliberately.

Catalog record

CREATORYi Su, Jiayi Zhang, Shu Yang, Xinhai Wang, Lijie Hu, Di Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-17712

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Understanding How Value Neurons Shape the Generation of Specified Values in LLMs Yi Su, Jiayi Zhang, Shu Yang, Xinhai Wang, Lijie Hu, Di Wang Abstract * * footnotetext: Equal Contribution. The order of these two authors follows alphabetical order of their last names. † † footnotetext: Corresponding Author Rapid integration of large language models (LLMs) into societal applications has intensified concerns about their alignment with universal ethical principles, as their internal value representations remain opaque despite behavioral alignment advancements. Current approaches struggle to systematically interpret how values are encoded in neural architectures, limited by datasets that prioritize superficial judgments over mechanistic analysis. We introduce ValueLocate, a mechanistic interpretability framework grounded in the Schwartz Values Survey, to address this gap. Our method first constructs ValueInsight, a dataset that operationalizes four dimensions of universal value through behavioral contexts in the real world. Leveraging this dataset, we develop a neuron identification method that calculates activation differences between opposing value aspects, enabling precise localization of value-critical neurons without relying on computationally intensive attribution methods. Our proposed validation method demonstrates that targeted manipulation of these neurons effectively alters model value orientations, establishing causal relationships between neurons and value representations. This work advances the foundation for value alignment by bridging psychological value frameworks with neuron analysis in LLMs. 1 Introduction Recent years have seen unprecedented advances in large language models (LLMs), establishing them as indispensable tools across multiple societal domains ( Yang et al., 2025 ; Yao et al., 2024 ; Park et al., 2023 ; Yang et al., 2024c ) . However, their extensive adoption raises critical concerns about value, as these systems demonstrate persistent challenges in adhering to universal ethical principles. This challenge stems primarily from their fundamental architecture: LLMs trained in data sourced from the Internet inherently absorb and display biases, ideological variances, and cultural specificities present in their training corpora. LLMs weighing values quite differ from human Nie et al. (2023) , give different priorities for different value dimensions Liu et al. (2025) , exhibit diverse ideologies Buyl et al. (2024) , and present nation-specific social values Lee et al. (2024) . Although contemporary alignment techniques have made substantial progress in the behavioral adjustment related to value Kong et al. (2024) ; Kenton et al. (2021) ; Ouyang et al. (2022) ; Yang et al. (2024b) ; Zhang et al. (2025a) , the inner mechanisms regarding value representation are not clearly interpreted. Systematic investigation of these latent value-encoding mechanisms could enable the development of theoretically grounded alignment frameworks and facilitate the design of more robust alignment algorithms in a principled way. Our study presents a novel mechanistic interpretability (MI) framework to systematically analyze value representation in neural architectures. MI, defined as reverse engineering of neural computations into interpretable algorithmic components Elhage et al. (2021) , traditionally includes attributing a model function to specific model components (e.g., neurons) and verifying that localized components have causal effects on model behaviors with causal mediation analysis techniques such as activation patching Zhang et al. (2024) ; Vig et al. (2020) ; Meng et al. (2022) . Previous studies Dai et al. (2022) ; Geva et al. (2021) ; Yu and Ananiadou (2024a) ; Zhang et al. (2025c) ; Hong et al. (2024) demonstrate that neurons could serve as fundamental computational units for knowledge storage in LLM, suggesting that the precise identification of value-critical neurons may allow targeted editing. However, due to the current limitations in the benchmark datasets on the LLM values, we cannot directly adopt them to identify value-related neurons. Specifically, the existing datasets are all based on decision-making judgments Liu et al. (2025) or binary yes/no judgments Nie et al. (2023) to evaluate neurons, which often introduce biases or yield inaccurate results, as they primarily reveal the model’s understanding of values rather than their actual orientation to these principles Yao et al. (2025) . This will lead to an insufficient understanding of its mechanism and storage location. In this paper, we introduce a neuron-based approach called ValueLocate to tackle the aforementioned issues. Our method is rooted in the Schwartz Values Survey Schwarz (1992) , a well-established framework that classifies values into four distinct dimensions: Openness to Change, Self-transcendence, Conservation, and Self-enhancement. Using these four value types, we develop a dataset named ValueInsight, which serves as a valuable tool to locate value-related neurons within LLMs. Unlike existing related datasets mainly in the multichoice format Scherrer et al. (2024) , ValueInsight offers a distinct approach, performing generative value tasks in LLMs using real-world test cases. The dataset enables the generation of contextually appropriate responses that maintain persistent alignment with specific values in various application contexts. We then leverage ValueInsight to locate neurons associated with values. To identify neurons, previous work always considers the activation degree Zhu et al. (2024) or leverages existing feature attribution methods in explainable AI Leng and Xiong (2024) ; Tang et al. (2024) ; Zhang et al. (2025b) . However, feature attribution methods always need high computing resources. From the Schwartz Values Survey, we find that value-related factors generally correspond to two opposite aspects. Therefore, we propose an activation degree-based method by calculating the activation difference when analyzing the opposite aspects of a particular value. Moreover, to validate the causality between the identified neurons and the values by adjusting the neurons, previous work always deactivates the specific neurons Li et al. (2025) . However, this approach cannot be applied to value-related neurons as deactivation will be meaningless. To address this issue, we propose a method that aims to manipulate and edit the values by changing the activations of value-related neurons. In summary, our research aims to provide a mechanistic understanding of the value encoded in LLMs. Our work makes three key contributions: • New dataset for value evaluation: We constructed ValueInsight, a new dataset comprising 640 second-person value descriptions and 15,000 scenario-based open-ended questions, each tailored to the values defined in the Schwartz Values Survey. • Identification of neurons: Using ValueInsight, we propose ValueLocate to identify neurons in LLMs that are associated with specific values. Instead of relying on a one-sided analysis, our method takes both the positive and negative aspects of a single value into account. • Comprehensive analysis: To validate the effectiveness of our neuron identification approach, we propose a new method to manipulate and edit values by changing the activations of value-related neurons. We conducted extensive experiments on different LLMs that evaluated the value of LLMs before and after value-related neuron manipulation. The results confirm that our method can effectively locate neurons related to values. 2 Related work Values in LLMs. As the popularity of LLMs increases, the values encoded within them have drawn significant attention. Pre-trained LLMs inherently exhibit value biases that frequently misalign with human norms, prioritizing mainstream cultural perspectives over minority viewpoints, and showing inconsistent performance across languages Wang et al. (2025) ; Cao et al. (2023) . LLMs risk propagating misinformation and harmful content, potentially exacerbating societal harms Deshpande et al. (2023) ; Yang et al. (2024d) , which threatens both ethical LLM development and user trust. To align LLM values with humans, many methods have been proposed Ziegler et al. (2019) ; Kenton et al. (2021) ; Ouyang et al. (2022) . Multiple benchmarks,

Read the complete text