Semantic Gradients Interactions in SSD: A Case Study in Racial Identity and Hate Speech
Felix Ostrowicki, Hubert Plisiecki · 2026
Read Semantic Gradients Interactions in SSD: A Case Study in Racial Identity and Hate Speech by Felix Ostrowicki, Hubert Plisiecki (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27322.txt.
Introduction
Felix Ostrowicki and Hubert Plisiecki extend Supervised Semantic Differential so meaning shifts across groups can be tested directly. Their interaction model splits a shared semantic gradient from group-linked gaps in what predicts hate-speech ratings. Applied to a Berkeley hate-speech corpus, it finds that rater race shifts judgments, with hostile dehumanizing language versus counter-speech as the shared contrast.
Catalog record
| CREATOR | Felix Ostrowicki, Hubert Plisiecki |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53181 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27322
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Semantic Gradients Interactions in SSD: A Case Study in Racial Identity and Hate Speech Felix Ostrowicki, Hubert Plisiecki Abstract We introduce interaction SSD, an extension of Supervised Semantic Differential that models how semantic meaning varies across moderators such as groups, traits, or conditions making this variation testable and interpretable. The method estimates a main semantic gradient, an interaction gradient, and conditional gradients, all interpretable through standard SSD tools. We illustrate it on the UC Berkeley Measuring Hate Speech corpus, testing whether annotator racial identity moderates hate-speech judgments of comments targeting people of color. The interaction model detects a significant moderation effect: the shared gradient contrasts dehumanizing hostility with counter-speech, while the interaction gradient reveals smaller group-linked differences in which semantic cues predict hate-speech ratings. Interaction SSD makes moderated meaning–outcome relationships statistically testable and interpretable. Content warning: This paper contains examples of hate speech, slurs, and other offensive language included for research and analytical purposes. Slurs are redacted using a partial-asterisk convention (first and last letters retained, middle characters replaced): e.g., n****r , f****t . 1 Introduction Supervised Semantic Differential (SSD) is a recent mixed quantitative–interpretive method for analyzing how the meaning of concepts and texts varies with external variables such as traits, attitudes, or judgments ( 12 ) . SSD represents texts or concept-specific contexts as vectors in an embedding space, regresses outcome variables onto these representations, tracing a semantic gradient in the embedding space which describes the semantic shift of the concept under study. The positive and negative poles of this gradient can then be explored through nearest-neighbor retrieval, clustering, and representative text snippets, allowing researchers to interpret statistical associations as structured differences in meaning. However, the canonical SSD model only estimates a single semantic gradient for the full sample. This is appropriate when the goal is to recover the overall semantic structure associated with an outcome, but many psychological and social-scientific questions are concerned with whether this structure differs across groups, identities, contexts, or conditions. For example, the same textual content may carry different evaluative implications depending on who judges it, and the same semantic cues may be more or less predictive of an outcome across theoretically meaningful subgroups. In such cases, a single SSD gradient can average over heterogeneous meaning–outcome relationships, and obscure the moderation effects that are central to the research question. This work introduces an interaction extension of SSD that allows semantic gradients to vary as a function of a moderator, yielding a main semantic gradient, an interaction gradient, and conditional gradients at substantively meaningful values of the moderator, all interpretable with standard SSD tools. We showcase the method using the Berkeley Measuring Hate Speech corpus ( 5 ) , a large-scale annotation dataset containing online text samples, hate speech ratings, information about the targets of speech, and annotator demographics. Specifically, we examine hate speech judgments for texts aimed at people of color and ask whether annotator racial identity, operationalized as a white / people of color binary split, moderates the semantic structure of these judgments. The case study serves primarily as an illustration of the extended method; the main contribution is methodological. We show how SSD can be extended from estimating a single interpretable semantic gradient to modeling semantic moderation effects, enabling transparent analysis of how meaning–judgment relationships differ across socially meaningful contexts. 2 Background: Supervised Semantic Differential SSD assumes a collection of documents d_{i} paired with continuous outcomes y_{i} . In its canonical formulation, SSD uses a lexicon denoting a concept of interest to aggregate the local semantic contexts in which that concept appears, yielding Personal Concept Vectors (PCVs) that represent how the concept is used in each author’s texts. In whole-document mode, each text is treated as the semantic unit of analysis ( 12 ) . Each document or concept-specific context is mapped to a dense vector x_{i}\in\mathbb{R}^{D} using a fixed embedding model, here with SIF-weighted averaging ( 2 ) and removal of the top principal component to reduce anisotropy ( 8 ) . Because the original embedding space is high-dimensional and partly redundant, SSD applies PCA ( 4 ) before regression. The number of retained components is selected with a PCA sweep, which evaluates candidate dimensionalities K in terms of retained variance, coherence of the gradient’s local semantic neighborhoods ( 6 ) , and stability across nearby values of K ( 13 ) . This yields a reduced representation \tilde{x}_{i}\in\mathbb{R}^{K} used in the standard SSD regression: y_{i}=\alpha+\beta^{\top}\tilde{x}_{i}+\epsilon_{i}. The coefficients \beta are back-projected into the original embedding space to obtain an interpretable semantic gradient \hat{\beta} . SSD interprets the positive and negative poles of this gradient by retrieving nearest neighbors, clustering them separately, and extracting original text snippets aligned with the cluster centroids. The method therefore combines statistical estimation with traceable semantic interpretation: the regression tests whether semantic variation is associated with the outcome, while the back-projected gradient, lexical neighborhoods, and snippets characterize the form of that association. 3 Interaction SSD We introduce an interaction extension of SSD for cases where the meaning–outcome relationship is expected to vary with a moderator, such as a group indicator, individual-difference variable, or experimental condition. After the standard SSD embedding pipeline and PCA sweep, each document is represented by a selected K -dimensional vector \tilde{x}_{i}\in\mathbb{R}^{K} . The outcome y_{i} and moderator m_{i} are standardized before regression. The model augments standard SSD with a moderator main effect and a semantic interaction block: \displaystyle y_{i} \displaystyle=\alpha+\beta^{\top}\tilde{x}_{i}+\gamma m_{i}+\delta^{\top}(\tilde{x}_{i}m_{i})+\epsilon_{i}. Here, \beta captures the baseline semantic association with the outcome, \gamma captures the non-semantic main effect of the moderator, and \delta tests whether the semantic association itself changes as a function of the moderator. The semantic and interaction blocks are evaluated with Wald F tests over their respective K coefficients, while \gamma is evaluated as a single regression coefficient. A full matrix-form specification, including the OLS estimator, covariance matrix, block tests, and back-projection equations, is provided in Appendix C . Model term Estimate SE Test df Effect size Overall model — — F=702.78 125,44687 R^{2}=.663 , R^{2}_{\mathrm{adj}}=.662 Semantic block \boldsymbol{\beta} — — F=1231.21 62,44687 — Race main effect \hat{\gamma} .028 .003 t=8.87 44687 — Interaction block \boldsymbol{\delta} — — F=13.76 62,44687 partial R^{2}=.019 Table 1: Interaction-SSD regression results. n=44{,}813 ; outcome and IV were z -scored; K=62 . Partial R^{2} is reported for the interaction block and represents the proportion of residual variance explained by the interaction after accounting for the shared semantic rating structure and the race main effect. As in standard SSD, coefficient vectors are back-projected from PCA space into the original embedding space. The baseline and interaction blocks yield g_{\mathrm{main}}=P\beta,\qquad g_{\mathrm{int}}=P\delta, where P denotes the linear back-projection from the selected PCA space. The main gradient describes the shared semantic direction associated with higher outcome values, whereas the interaction gradient describes how that direction changes with the moderator. The model also yields conditional gradients analogous to simple slopes in moderated regression ( 1 ) : g(m^{\ast})=g_{\mathrm{main}}+m^{\ast}g_{\mathrm{int}}. For continuous moderators, m^{\ast} can be set to values such as one standard deviation below and above the mean; for binary moderators, it can be evaluated at the standardized group values. The main, interaction, and conditional gradients are then interpreted with the usual SSD nearest-neighbor, clustering, and snippet tools. Thus, the regression tests