VISPA : Pluralistic Alignment via Automatic Value Selection and Activation
Shenyan Zheng, Jiayou Zhong, Anudeex Shetty, Heng Ji, Preslav Nakov, Usman Naseem · 2026
Read VISPA : Pluralistic Alignment via Automatic Value Selection and Activation by Shenyan Zheng, Jiayou Zhong, Anudeex Shetty, Heng Ji, Preslav Nakov, Usman Naseem (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-12758.txt.
Introduction
Shenyan Zheng and five co authors work on pluralistic alignment of language models. As models enter high stakes domains, outputs should reflect a range of human perspectives. Reflecting only average preference flattens real disagreement. Achieving pluralism remains challenging, though. Existing approaches consider limited values or rely on prompt level tricks.
Prompt tricks lack real value control and representation, the team argue. Their system, VISPA, works by automatic value selection and activation. It aims to select fitting values for a context and activate them in the model. Pluralistic systems could serve diverse users without erasing minority views. The work speaks to alignment research beyond one size fits all preference.
Catalog record
| CREATOR | Shenyan Zheng, Jiayou Zhong, Anudeex Shetty, Heng Ji, Preslav Nakov, Usman Naseem |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-12758
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
VISPA : Pluralistic Alignment via Automatic Value Selection and Activation Shenyan Zheng, Jiayou Zhong, Anudeex Shetty, Heng Ji, Preslav Nakov, Usman Naseem Abstract As large language models are increasingly used in high-stakes domains, it is essential that their outputs reflect not average human preference, rather range of varying perspectives. Achieving such pluralism , however, remains challenging. Existing approaches consider limited values or rely on prompt-level interventions, lacking value control and representation. To address this, we introduce VISPA , a training-free pluralistic alignment framework, that enables direct control over value expression by dynamic selection and internal model activation steering. Across extensive empirical studies spanning multiple models and evaluation settings, we show VISPA is performant across all pluralistic alignment modes in healthcare and beyond. Further analysis reveals VISPA is adaptable with different steering initiations, model, and/or values. These results suggest that pluralistic alignment can be achieved through internal activation mechanisms, offering a scalable path toward language models that serves all . 1 1 1 We will release our code and data post acceptance. * * footnotetext: Equal contributions. 1 Introduction Figure 1: Overview of VISPA for pluralistic alignment via value selection and activation-level steering. Given a query, the model selects input-relevant subset of values from a shared value pool (Section 3.1 ) and generates value-conditioned comments by steering internal representations along interpretable value directions (Section 3.2 ). These comments are then composed according to Overton , Steerable , and Distributional modes using a backbone model to produce final output reflecting pluralistic values and perspectives (Section 3.3 ). Large language models (LLMs) are increasingly deployed in high-stakes and socially sensitive domains, including but not limited to healthcare, law, education, and public policy ( 14 ; 27 ; 31 ) . In such settings, responses often reflect normative judgements rather than objective facts, and there is rarely a single “correct” answer. When an LLM is aligned only to an averaged notion of preferences, it risks obscuring this diversity and systematically favouring certain perspectives over others ( 21 ; 2 ; 33 ) . Pluralistic alignment ( 23 ; 5 ) has therefore emerged as an effective solution. On contrary to collapsing diverse viewpoints into a single consensus, a pluralistically aligned model represents multiple conflicting perspectives. Existing solutions for pluralistic alignment are via prompting ( 37 ; 29 ) , or aggregation over heterogeneous model ensembles ( 5 ; 9 ) . While effective in some settings, these methods provide limited control over what and how values are internally represented, moreover being brittle to prompt phrasing or role specification. At the same time, a complementary line of research investigates how abstract concepts and values are represented within the latent spaces of LLMs, and how targeted interventions on internal activations can steer model behaviour in more controlled manner compared to prompting ( 11 ; 10 ) . This observation motivates our central hypothesis: Can pluralism be achieved in a controlled and interpretable manner by steering internal value activations? Allowing a single steering model to express multiple, distinct value-conditioned perspectives. To answer the above question, we introduce V alue- I ntegrated S teering for P luralistic A lignment ( VISPA ), a pluralistic alignment framework that utilises value selection and activation-level steering as core building blocks as illustrated in Figure 1 . We maintain a comprehensive, extensible pool of interpretable value vectors (or directions) grounded in established value taxonomies. Using these vectors, we select relevant values for an input and generate corresponding value-conditioned comments via model activation-level steering. These comments are then composed and evaluated under Overton , Steerable , and Distributional pluralistic alignment modes. Empirically, we demonstrate that VISPA advances all three pluralistic alignment objectives on LLMs of varying sizes and architectures for healthcare and the general domain, while remaining agnostic to different steering model and initiations. Our contributions are threefold: • To the best of our knowledge, we are the first to successfully apply model activation steering for a multi-objective task such as pluralistic alignment. • Our training-free framework, VISPA , achieves pluralism through value selection and internal value steering, enabling interpretable control over value expression. We complement it by constructing well-grounded and extensible value pool, including moral, cultural, safety, and other dimensions. • VISPA achieves state-of-the-art performance across Overton , Steerable , and Distributional pluralistic alignment modes on healthcare and general benchmarks for several LLMs. Additionally, it is extensible to different activation-level steering and models. 2 Related Work Pluralistic Alignment. Standard alignment techniques such as Reinforcement Learning from Human Feedback (RLHF) often converge on a single, averaged preference distribution ( 3 ; 23 ) . In response, pluralistic alignment aims to preserve this normative diversity. 23 formalized three modes of pluralism— Overton , Steerable , and Distributional —which have been subsequently implemented via multi-model collaboration in ModPlural ( 5 ) or persona-based prompting in Ethos ( 37 ) . However, ModPlural relies on a fixed pool of community language models, incurring substantial computational cost and limited perspective coverage. Likewise, Ethos , depends on prompting single backbone LLM (via different personas), which may reflect biases or under-represent non-dominant perspectives ( 37 ) . Our work, VISPA , departs from these paradigms by investigating whether pluralism can be realized through internal mechanisms discussed next. Internal Value Steering. A growing body of work explores controlling LLMs by manipulating their internal activation states ( 38 ; 30 ) . This approach, often termed Representation Engineering (RepEng) , identifies directions in latent space that correspond to high-level concepts and modifies model behaviour by shifting activations along these vectors ( 38 ) . This approach demonstrated that attributes like sentiment or truthfulness could be controlled by adding a fixed vector to hidden states. Subsequent techniques have refined this by using contrastive pairs to derive more robust steering directions ( 10 ; 17 ) . Our proposed framework, VISPA , successfully adapts them to the multi-objective setting of pluralistic alignment. 3 VISPA : Value-Integrated Steering for Pluralistic Alignment We address value bias and under-representation in existing works by curating diverse set of human values ( \mathcal{V} ) (drawing from established psychological, cultural, moral, and AI-safety frameworks, as well as non-WEIRD moral traditions, described below): • Schwartz’s Basic Human Values (10) ( 10 ) : Self-Direction, Stimulation, Hedonism, Achievement, Power, Security, Conformity, Tradition, Benevolence, and Universalism. • Cultural Dimensions (6) ( 25 ) : Power Distance, Uncertainty Avoidance, Individualism, Masculinity, Long-Term Orientation, and Indulgence. • Moral Theories (7) ( 34 ) : Commonsense Morality, Deontology, Utilitarianism, Justice, Virtue Ethics, Ubuntu, and Confucianism. • AI Safety–Related (4) ( 34 ) : Fairness, Truthfulness, Toxicity, and Harmfulness. • Non-WEIRD Moral Constructs (4) ( 6 ) : Face, Karma, Honor, and Spirituality. We note these values ( \mathcal{V} ) provide better coverage (as shown in Appendix Figure 6 and 7 ) and are extensible. Additional details and their justification is provided in Appendix B . 3.1 Value Selection Utilising all the human values for every scenario is neither computationally efficient nor conceptually desirable for a single input. We therefore introduce a value selection mechanism that identifies subset of values relevant to the input. Value relevance scoring. For an input x and a candidate value V\in\mathcal{V} , we define a relevance score as g(x,V)\in\mathbb{R} , corresponding