Modeling Human Perspectives with Socio-Demographic Representations

Leixin Zhang, Çağrı Çöltekin · 2026

Read Modeling Human Perspectives with Socio-Demographic Representations by Leixin Zhang, Çağrı Çöltekin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18069.txt.

Introduction

Leixin Zhang and Coltekin propose Socio-Contrastive Learning, a method that models both annotator perspectives and socio-demographic representations. Past work usually looks at one demographic factor at a time, yet real perspectives grow from complex social contexts, and finer attributes explain them better. Their method combines social features with text to predict perspectives, beating standard concatenation methods. The learned codes also support study and display of how demographic factors relate to perspective gaps.

Catalog record

CREATORLeixin Zhang, Çağrı Çöltekin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39927
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18069

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Modeling Human Perspectives with Socio-Demographic Representations Leixin Zhang, Çağrı Çöltekin Abstract Humans often hold different perspectives on the same issues. In many NLP tasks, annotation disagreement can reflect valid subjective perspectives. Modeling annotator perspectives and understanding their relationship with other human factors, such as socio-demographic attributes, have received increasing attention. Prior work typically focuses on single demographic factors or limited combinations. However, in real-world settings, annotator perspectives are shaped by complex social contexts, and finer-grained socio-demographic attributes can better explain human perspectives. In this work, we propose Socio-Contrastive Learning, a method that jointly models annotator perspectives while learning socio-demographic representations. Our method provides an effective approach for the fusion of socio-demographic features and textual representations to predict annotator perspectives, outperforming standard concatenation-based methods. The learned representations further enable analysis and visualization of how demographic factors relate to variation in annotator perspectives. Our code is available at GitHub . 1 1 1 https://github.com/Leixin-Zhang/Socio_Contrastive_Learning 1 Introduction Recent studies have shown that human disagreement is widespread across many annotation tasks. Some instances lack a single ground truth and annotation variation reflects diverse but valid perspectives 20 ; 1 ; 11 ; 25 ; 19 . This phenomenon is particularly evident in subjective tasks, such as hate speech and offensive content detection 22 ; 26 . Some studies also suggest that individuals’ perspectives are associated with their lived experiences and cultural contexts. For example, 23 find that conservative annotators are more likely to rate African American English as toxic. 10 show that white and non-white annotators differ significantly in their ratings of racist language. Despite these advances, pitfalls remain in analyzing the role of socio-demographic features in perspective modeling. Prior research often examines annotator subgroups using a single demographic attribute at a time, such as gender, and analyzes the statistical difference between its subcategories, such as female and male. However, this approach is limited, as a single attribute cannot fully capture the complex interplay between social contexts and the formation of human perspectives. Instead, richer combinations of socio-demographic attributes are more likely to reflect the nuanced experiences and social context, and to better capture the diversity of annotators’ perspectives. In this work, we adopt a machine learning approach to analyze annotators’ socio-demographic attributes and address the following research questions: • Research Question 1: To what extent do socio-demographic features contribute to perspective prediction in hate speech and toxic content tasks, and which features are most predictive of annotators’ perspectives? • Research Question 2: How should socio-demographic features be encoded and fused with textual representations to improve model performance? As the key contribution of this work, we propose Socio-Contrastive Learning , a novel architecture that jointly learns (i) annotators’ socio-demographic representations inferred from their labeling behavior and (ii) socio-demographic-specific label predictions. Our method outperforms existing models on label prediction while simultaneously producing annotators’ socio-demographic representations that enable analysis of their association with perspective variation. 2 Related Studies This section presents prior work on modeling individual perspectives. Section 2.1 focuses on methods for predicting individual annotators’ labels without using socio-demographic features, while Section 2.2 focuses on approaches that incorporate socio-demographic information into the learning process. 2.1 Individual Perspective Modeling Modeling each annotator’s labels directly, rather than aggregating via majority vote, has been shown to improve performance 16 ; 24 ; 15 ; 29 . 6 propose personalized approaches that leverage annotator label embeddings derived from their partial annotations, showing that even a small number of annotations on highly controversial data can significantly outperform generalized models. 16 introduce three methods for modeling annotation variation: an ensemble approach that aggregates predictions from annotator-specific models, a multi-label approach that represents annotators’ labels as a target vector, and a multi-task approach that assigns a separate prediction head to each annotator. 15 use an embedding layer to represent individual annotators for annotator-specific prediction. 2.2 Socio-Demographics Enriched Modeling Some prior studies show that certain socio-demographic features of annotators are associated with their annotated labels. 5 identify differences in culture-related natural language inference judgments between annotators from the United States and India. In the context of socio-demographic enriched learning, Jury Learning 4 models annotator-specific labels by concatenating socio-demographic features and annotator IDs with text representations. Final predictions are aggregated via a sampling process with a predefined demographic composition, allowing practitioners to control which groups’ perspectives are reflected in the final outputs and in what proportions. 17 investigate the influence of socio-demographic features by grouping annotators according to a single attribute and employing group-specific layers for each subcategory (e.g., Age: 25–34, 35-44, etc.). The results do not show performance improvements over a baseline model without socio-demographic features and randomly shuffled attribute groups, and they conclude that annotation patterns cannot be explained by socio-demographic attributes. However, using the same dataset for toxic content tasks, our study arrives at a conclusion different from that in 17 . We find that incorporating richer combinations (instead of an individual attribute in isolation) reveals a substantial contribution of socio-demographic information to modeling and explaining annotation variation. 3 Methodology To address the first research question: the extent to which socio-demographic features contribute to perspective prediction, we compare model architectures in the following two categories: Category 1: Models that do not use socio-demographic features: • Simple Model: This model uses only text embeddings to predict aggregated labels. When a text item is annotated by multiple annotators, their labels are aggregated into a single ground-truth label via majority voting. • Multi-Task Model: This model uses text embeddings as input but predicts each annotator’s label in a multi-task setup as 16 . The architecture consists of shared layers for all annotators, followed by separate output heads for each annotator. Category 2: Models that leverage socio-demographic features. We experiment with two commonly used methods and introduce a novel approach for encoding annotators’ socio-demographic attributes. • Multi-Hot Encoding: Annotators’ socio-demographic features are encoded as multi-hot vectors and concatenated with text embeddings as model input. • Socio-Demographic Embedding: Socio-demographic features are encoded using the same pretrained model as the text encoder, producing representations in a shared vector space for concatenation. • Socio-Contrastive Learning (Our Method): As shown in Figure 1 , multi-hot socio-demographic encodings are first projected into a learnable space (Projection Layer) and optimized with a contrastive loss to capture annotator-specific patterns. The resulting representations are then concatenated with text embeddings for label prediction. 4 Socio-Contrastive Learning The primary objective of the model is to predict annotator labels. Meanwhile, the model refines socio-demographic representations using a contrastive loss based on each annotator’s labels, enabling them to capture socio-demographic–relevant patterns. 4.1 Motivation We hypothesize that, for certain subjective tasks, an individual’s perspective—reflected in their annotations on text items—is associated with the socio-demographic groups to which they belong. In other words, prediction accuracy of annotator labels is expected to improve when fine-grained socio-demographic attributes are available. Formally, let \hat{y}=\arg\max_{y}P(y\mid\cdot) denote the predicted label and y the ground-truth label. We posit that: \mathbb{P}(\hat{y}=y\mid\text{text},\text{socio-demo})>\mathbb{P}(\hat{y}=y\mid\text{text}) We expect that socio-demographic attributes are not equally predictive of annotators’ perspectives. Certain attributes may be more closely associated with specific judgment patterns, while others may contribute weaker signals. To amplify the most informative attributes, we apply contrastive learning to refine socio-demographic representations based on annotation similarity, encouraging representations to be closer for annotators with

Read the complete text