PRISM: A Framework for Producing Interpretable Political Bias Embeddings with Political-Aware Cross-Encoder

Yiqun Sun, Qiang Huang, Anthony K. H. Tung, Jun Yu · 2025

Read PRISM: A Framework for Producing Interpretable Political Bias Embeddings with Political-Aware Cross-Encoder by Yiqun Sun, Qiang Huang, Anthony K. H. Tung, Jun Yu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24646.txt.

Introduction

Yiqun Sun and co-authors present, in a 2025 paper, a framework that turns news text into number vectors which openly encode political bias. Standard text vectors capture meaning but blur ideology, which limits bias studies. Their system first mines fine-grained hot topics and the bias markers tied to each from weakly labeled news.

A second stage scores each article against those markers with a paired-text model, building vectors whose axes mean something concrete. On two large data sets, the vectors beat top general models at bias classification. They also support mixed retrieval and ideology mapping because each axis can be read and named. Code is public for other teams to build on.

Catalog record

CREATORYiqun Sun, Qiang Huang, Anthony K. H. Tung, Jun Yu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24646

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PRISM: A Framework for Producing Interpretable Political Bias Embeddings with Political-Aware Cross-Encoder Yiqun Sun, Qiang Huang, Anthony K. H. Tung, Jun Yu Abstract Semantic Text Embedding is a fundamental NLP task that encodes textual content into vector representations, where proximity in the embedding space reflects semantic similarity. While existing embedding models excel at capturing general meaning, they often overlook ideological nuances, limiting their effectiveness in tasks that require an understanding of political bias. To address this gap, we introduce PRISM , the first framework designed to P roduce inte R pretable pol I tical bia S e M beddings. PRISM operates in two key stages: (1) Controversial Topic Bias Indicator Mining, which systematically extracts fine-grained political topics and their corresponding bias indicators from weakly labeled news data, and (2) Cross-Encoder Political Bias Embedding, which assigns structured bias scores to news articles based on their alignment with these indicators. This approach ensures that embeddings are explicitly tied to bias-revealing dimensions, enhancing both interpretability and predictive power. Through extensive experiments on two large-scale datasets, we demonstrate that PRISM outperforms state-of-the-art text embedding models in political bias classification while offering highly interpretable representations that facilitate diversified retrieval and ideological analysis. The source code is available at https://github.com/dukesun99/ACL-PRISM . 1 Introduction Semantic Text Embedding is a fundamental NLP task that encodes texts into vector representations, where proximity in the embedding space reflects semantic similarity. This task has garnered extensive research attention ( Mikolov et al., 2013 ; Pennington et al., 2014 ; Devlin et al., 2019 ; Gao et al., 2021 ; Zhuo et al., 2023 ; Li and Li, 2024 ) due to its broad applications in retrieval ( Karpukhin et al., 2020 ; Thakur et al., 2021 ) , clustering ( Aggarwal and Zhai, 2012 ) , and semantic textual similarity (STS) ( Agirre et al., 2012 ; Agirre et al., 2013 ) . While significant progress has been made in developing advanced models for semantic representation, these approaches primarily capture general meaning while often failing to account for underlying political bias. This limitation becomes apparent in real-world scenarios such as news coverage of the same event–illustrated in Figure 1 –where articles may report on identical topics but convey distinctly different political perspectives. Existing embedding models ( Gao et al., 2021 ; Zhuo et al., 2023 ; Li and Li, 2024 ) , despite assigning high similarity scores based on shared content, struggle to capture these ideological nuances, exposing a crucial gap in current methodologies. Figure 1: Semantic Text Embedding vs. Political Bias Embedding: While the former captures event-level similarity, the latter reveals ideological orientation in news coverage. To address this gap, this work investigates Political Bias Embedding , a new representation learning task that transforms textual content into compact vector representations customized to capture ideological orientations. These specialized embeddings offer significant advantages for various downstream applications, ranging from political bias classification ( Iyyer et al., 2014 ; Liu et al., 2022 ) to diversified retrieval systems that expose content across the ideological spectrum ( Sun et al., 2024 ; Huang et al., 2024 ) . Existing research on political bias analysis has evolved from simple left-right classification ( Iyyer et al., 2014 ; Baly et al., 2020a ) to more nuanced approaches that consider multiple finer-grained political dimensions ( Kim and Johnson, 2022 ; Liu et al., 2023 ) . In parallel, advances in text embeddings have progressed from general-purpose representations Reimers and Gurevych (2019) to domain-specific models tailored for specialized fields Lee et al. (2020) ; Beltagy et al. (2019) . Specifically, for political text analysis, recent work has developed specialized encoder-only Transformer models Devlin et al. (2019) ; Liu et al. (2019) through fine-tuning with political news articles Liu et al. (2022) , while instruction-following text embedding models have emerged as another promising direction Su et al. (2023) ; Peng et al. (2024) . Despite these advancements, developing effective political bias embeddings remains challenging. • Complexity of Political Dimensions: While political bias analysis has moved beyond binary classification toward multi-dimensional perspectives ( Kim and Johnson, 2022 ; Liu et al., 2023 ) , enumerating a comprehensive political bias taxonomy remains challenging. Automatically extracting fine-grained political topics from a news corpus is essential for learning robust and interpretable representations of political bias. • Scarcity of Fine-Grained Annotations: High-quality, large-scale datasets capturing nuanced political perspectives are scarce, as manually annotating political bias is resource-intensive and subjective ( Sinno et al., 2022 ; Kim and Johnson, 2022 ; Liu et al., 2023 ) . • Black-box Models: While recent studies have explored interpretable embeddings using yes/no questions as dimensions McInerney et al. (2023) ; Benara et al. (2024) ; Sun et al. (2025) , these approaches are not directly applicable to political bias analysis due to the complexity and subjectivity of political viewpoints. To the best of our knowledge, no existing work has systematically addressed the challenge of constructing interpretable embeddings for political bias. To overcome these challenges, we introduce PRISM , the first framework developed to P roduce inte R pretable pol I tical bia S e M bedding. PRISM comprises two core stages: • Controversial Topic Bias Indicator Mining: We extract fine-grained political topics and bias indicators from weakly labeled news data, addressing the scarcity of fine-grained annotations through an automated topic discovery process. • Cross-Encoder Political Bias Embedding: We use mined topics as interpretable dimensions and bias indicators as reference points for bias scoring, developing a weak-label training strategy to enable nuanced political bias comprehension with a political-aware cross-encoder while designing topic retrieval to enhance efficiency. Contributions The key contributions of this work are summarized as follows: (1) Task Formulation and Framework Design: We introduce the novel task of political bias embedding and present PRISM, the first framework specifically designed to generate interpretable political bias embeddings that go beyond surface-level semantics to capture ideological orientation. (2) Annotation-Free, Interpretable Embedding Approach: PRISM operates without requiring fine-grained manual annotations. It leverages distant supervision to automatically mine controversial political topics and their associated bias indicators. Utilizing a political-aware cross-encoder, PRISM produces embeddings that are inherently interpretable, with dimensions explicitly grounded in semantically meaningful bias indicators. (3) Empirical Effectiveness Across Tasks: Extensive experiments show that PRISM consistently outperforms state-of-the-art baselines on key downstream tasks such as political bias classification and politically diversified content retrieval, while offering transparent insight into ideological representation. 2 Related Work Political Bias Mining Political bias in news articles has been extensively studied ( Baly et al., 2020b ; Nakov et al., 2024 ; Martinez et al., 2024 ) , with much of the research focused on political bias classification. Early work predominantly framed this as a binary classification problem, distinguishing between left-leaning and right-leaning viewpoints ( Iyyer et al., 2014 ; Chen et al., 2017 ; Kulkarni et al., 2018 ; Fan et al., 2019 ; Baly et al., 2020a ; Spinde et al., 2021 ; Kim and Johnson, 2022 ; Liu et al., 2022 ; Liu et al., 2023 ; Hong et al., 2023 ; Lin et al., 2024 ; Liu et al., 2024 ) . SLAP4SLIP by Hofmann et al. (2022) focuses on concept discovery and framing analysis, modeling ideological polarization along the dimensions of salience and

Read the complete text