Towards Characterizing Subjectivity of Individuals through Modeling Value Conflicts and Trade-offs
Younghun Lee, Dan Goldwasser · 2025
Read Towards Characterizing Subjectivity of Individuals through Modeling Value Conflicts and Trade-offs by Younghun Lee, Dan Goldwasser (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-12633.txt.
Introduction
Younghun Lee and Dan Goldwasser study how a language model might judge a person's moral views from what that person posts online. Models can already reason well and make calls on touchy questions, yet most work treats their leanings in general terms. Their 2025 paper asks whether a model can instead capture one person's own outlook, clashes and all.
Their framework, SOLAR, reads a user's posts for signs of value conflicts and the trade-offs the user makes between them. From those signs it builds a picture of the person's subjective ground, then uses that picture to infer later judgments. Tests show better inference overall, with the clearest gains on disputed cases. SOLAR also explains which value leanings drove a call, which helps show why the model read the person as it did.
Catalog record
| CREATOR | Younghun Lee, Dan Goldwasser |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-12633
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Characterizing Subjectivity of Individuals through Modeling Value Conflicts and Trade-offs Younghun Lee, Dan Goldwasser Abstract Large Language Models (LLMs) not only have solved complex reasoning problems but also exhibit remarkable performance in tasks that require subjective decision making. Existing studies suggest that LLM generations can be subjectively grounded to some extent, yet exploring whether LLMs can account for individual-level subjectivity has not been sufficiently studied. In this paper, we characterize subjectivity of individuals on social media and infer their moral judgments using LLMs. We propose a framework, SolAr ( S ubjective Gr o und with Va l ue A bst r action), that observes value conflicts and trade-offs in the user-generated texts to better represent subjective ground of individuals. Empirical results show that our framework improves overall inference results as well as performance on controversial situations. Additionally, we qualitatively show that SolAr provides explanations about individuals’ value preferences, which can further account for their judgments. 1 Introduction For the last few years, Large Language Models (LLMs) have shifted the paradigm of solving NLP problems to autoregressive language generation and achieved human-like performance in many downstream tasks ( Raffel et al. 2020 ; Wei et al. 2022 ; Kojima et al. 2022 ; Wang et al. 2022 ; Yu et al. 2022 ; He et al. 2024 ) . Not only have LLMs solved objective problems that require complex reasoning skills, such as STEM-related questions ( Imani et al. 2023 ; Wang et al. 2024c ; Abbasiantaeb et al. 2024 ) , they also exhibit remarkable performance in subjective decision-making processes, such as bias detection ( Hartvigsen et al. 2022 ) , representing opinions in the survey ( Santurkar et al. 2023 ) , generating model evaluation ( Perez et al. 2022 ) , social context grounding ( Pujari et al. 2024 ) , etc. Recent studies explore whether LLMs can generate perspectives and reasoning that align well with a specific persona or demographic information ( Durmus et al. 2023 ; Nie et al. 2024 ; Zheng et al. 2024b ) . The results of these studies show that it is possible, to an extent, to ground LLM generations with these traits, however, LLMs tend to rely on superficial facts and assumptions about the roles rather than apply a deeper understanding. Our goal in this paper is to study a different aspect of subjectivity, focusing on the individual-level (rather than generalizing over demographic traits), which has not been sufficiently studied yet. As personalized AI becomes more widely used ( McClain 2024 ) , understanding whether LLMs can be utilized to characterize individual subjectivity becomes more important. Analyzing individual-level subjectivity using LLMs faces two main challenges. The first challenge is guiding LLM generation to be consistent with a specific subjective view. Existing methods for capturing subjectivity at the level of a generalized persona, role, or demographic information show that it is not trivial to steer LLMs to follow certain aspects. Second, even if an optimal approach for grounding subjective aspects in LLMs generations existed, expressing these aspects at the level of an individual is not straightforward (i.e., two instances of the same persona could still have different subjective preferences). Conceptualizing and operationalizing subjectivity at this level poses a second challenge. Figure 1: Inference process of our framework, SolAr . When an input situation is given, SolAr identifies conflicting values in the story, and retrieve the most relevant value trade-off history from the redditor’s past comments. The retrieved subjective ground is then added to the prompt to infer each redditor’s likely judgments to the situation. In this paper, our objective is to characterize subjectivity of individuals with LLMs by analyzing users’ behaviors in a Reddit community, r/AmITheAsshole . In this community, original posters write about the situations where they have conflicts with others and ask whether their behaviors are acceptable, and other redditors leave comments with their judgments. Figure 1 shows an example of a post and judgments from different redditors. The research hypothesis is that redditors’ subjective ground , principles that play a fundamental role in human moral judgments ( Neuhouser 1990 ) , can be represented by decomposing their past behaviors; we use redditors’ past comments in the community to determine their likely judgments on unseen situations. Value pluralism suggests that there are multiple values that may be equally correct, yet in conflict with one another ( Crowder 1998 ; Galston 2002 ) . Psychological studies adopt this idea and argue that the human cognitive system makes novel judgments by making trade-offs between conflicting values when it encounters situations with colliding moral intuitions ( Fiske and Tetlock 1997 ; Guzmán et al. 2022 ) . In this paper, we propose a framework, SolAr ( S ubjective Gr o und with Va l ue A bst r action), that observes trade-offs between conflicting values in the user-generated texts, identifies the most relevant value conflicts with respect to the input situation, and infer the redditors’ likely judgments using off-the-shelf LLMs. Our framework aims to tackle the two challenges of characterizing individual-level subjectivity described above; it conceptualizes subjectivity of individuals with trade-offs among abstract values and guides LLM generations with Retrieval-Augmented Generation (RAG). Empirical results suggest that SolAr distinguishes redditors’ subjective preferences and further provides explanations of their value trade-offs. Our proposed framework also improves the overall performance of downstream tasks and better guides LLMs with the prompted subjective ground when it is tested on more controversial situations. Key Contributions : To the best of our knowledge, this is the first attempt to explore whether off-the-shelf LLMs can be effectively used to account for subjectivity of individuals in the online community. With value abstraction, we highlight that redditors show distinct subjectivity patterns, which makes this research different from social commonsense or opinion mining. Additionally, we propose a novel framework that encompasses a value trade-off system and performs better in downstream tasks as well as grounding LLM generations. 2 Problem Formulation In this section, we describe four major elements that formulate modules, learning processes, and inference tasks. Situation Situation refers to the text description of what has happened in the real world. We aim to focus on situations that portray conflicts so that one’s point of view can be projected in diverse ways. “Asking my girlfriend to stay out of apartment for poker night” is an example of situations. Individual This research aims to analyze different individuals’ reactions and responses on various social situations. Unlike opinion mining or social commonsense studies, where perspectives and rationales are represented as an aggregate of a large number of humans, our main focus is to observe distinct patterns that characterize each individual and understand the rationales behind their decision-making processes. Subjective Ground Subjective Ground refers to principles or maxims that steer individuals’ moral judgments or perspectives. “One should put their significant other’s needs as top priority.” is a subjective ground item that is relevant to the example situation above. Every individual has a distinct subjective ground and is built from various aspects such as their past experience, demographics, personality, etc. ( Eysenck and Eysenck 1975 ; Schwaba et al. 2023 ; Schoeller et al. 2024 ) . One of our research hypotheses is that the subjective ground of