Political Ideology Shifts in Large Language Models DOI: XXXXXXX.XXXXXXX CCS: Information systems Language models

Pietro Bernardelle, Stefano Civelli, Leon Fröhling, Riccardo Lunardi, Kevin Roitero, Gianluca Demartini · 2025

Read Political Ideology Shifts in Large Language Models DOI: XXXXXXX.XXXXXXX CCS: Information systems Language models by Pietro Bernardelle, Stefano Civelli, Leon Fröhling, Riccardo Lunardi, Kevin Roitero, Gianluca Demartini (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-16013.txt.

Introduction

Pietro Bernardelle and co-authors test how fake personas can bend the political leanings of language models. Models now work in politically tender settings, so their drift matters. The team used a standard sixty-two statement compass test as their probe.

Seven open models, from small to very large, answered under two hundred thousand synthetic personas. More than two hundred sixty million replies were logged. Larger models covered a wider spread of leanings when personas hinted softly. Direct priming toward one corner moved every model that way, as intended. Cues also varied by topic theme. The scale of the study makes the patterns hard to dismiss. It warns deployers that a persona prompt is also a political dial.

Catalog record

CREATORPietro Bernardelle, Stefano Civelli, Leon Fröhling, Riccardo Lunardi, Kevin Roitero, Gianluca Demartini
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-16013

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Political Ideology Shifts in Large Language Models DOI: XXXXXXX.XXXXXXX CCS: Information systems Language models Pietro Bernardelle, Stefano Civelli, Leon Fröhling, Riccardo Lunardi, Kevin Roitero, Gianluca Demartini Abstract . Large language models (LLMs) are increasingly deployed in politically sensitive settings, raising concerns about their potential to encode, amplify, or be steered toward specific ideologies. We investigate how adopting synthetic personas influences ideological expression in LLMs across seven models (7B–70B+ parameters) from multiple families, using the Political Compass Test as a standardized probe. Our analysis reveals four consistent patterns: (i) larger models display broader and more polarized implicit ideological coverage; (ii) susceptibility to explicit ideological cues grows with scale; (iii) models respond more strongly to right-authoritarian than to left-libertarian priming; and (iv) thematic content in persona descriptions induces systematic and predictable ideological shifts, which amplify with size. These findings indicate that both scale and persona content shape LLM political behavior. As such systems enter decision-making, educational, and policy contexts, their latent ideological malleability demands attention to safeguard fairness, transparency, and safety. 1. Introduction As humans, we rarely process information in a neutral vacuum. Our political, moral, and cultural beliefs shape how we interpret facts, reason through arguments, and engage with others—often in ways that reflect deep-seated ideological biases ( Nickerson 1998 ; Lord et al. 1979 ) . While some of these biases can be traced to the limits of human’s information-processing capacity—what Herbert Simon described as bounded rationality ( Simon 1957 ) —they are not merely cognitive shortcomings. Rather, they emerge from the heuristics and interpretive frameworks we rely on to navigate complex, uncertain, and value-laden domains ( Tversky and Kahneman 1974 ; Raue and Scholl 2018 ) . The rapid adoption of large language models (LLMs) introduces new complexity to this dynamic. As these systems play an increasingly central role in mediating information—shaping how it is sourced, framed, interpreted, and communicated—individuals are progressively outsourcing key aspects of reasoning to them, relying on LLMs for explanations, summaries, and decisions ( Bick et al. 2024 ; Liang et al. 2025 ) . Whether intentional or not, the outputs of these models encode ideological bias that can subtly shape users’ views, not through deliberation but through cumulative exposure to generated responses. This raises pressing questions about the nature and malleability of ideological bias in LLMs, particularly as they are integrated into domains that should promise objectivity and trustworthiness. Reflecting these concerns, the US AI Action Plan published in 2025 emphasizes that “ […] AI systems must be free from ideological bias and be designed to pursue objective truth rather than social engineering agendas when users seek factual information or analysis. ’’ 1 1 1 https://www.whitehouse.gov/wp-content/uploads/2025/07/Americas-AI-Action-Plan.pdf Yet this policy ideal remains difficult to achieve in practice ( Gabriel et al. 2025 ) , making it critical to examine the conditions under which LLMs might express or suppress ideological perspectives. In this paper we show that when these models are prompted to adopt different personas they exhibit ideologically malleable behaviors—shifting their responses in predictable directions depending on persona content, scale, and ideological cues. Recent research demonstrated that LLMs exhibit ideological patterns that mirror the aforementioned human tendencies ( Hartmann et al. 2023 ; Rozado 2024 ; Santurkar et al. 2023 ) . Although they are not sentient agents with beliefs or intentions, their outputs often reflect political or moral leanings—biases that are neither random nor purely surface-level. These patterns appear to arise from the very mechanisms that make LLMs effective: they are trained to model human language ( Devlin et al. 2019 ; Dai and Le 2015 ; Radford 2018 ) and align with their preferences ( Bernardelle and Demartini 2024 ; Ouyang et al. 2022 ; Rafailov et al. 2023 ; Liu et al. 2024 ; Azar et al. 2024 ; Ethayarajh et al. 2024 ; Christiano et al. 2017 ) . In doing so, LLMs internalize many of the same sociocultural priors, assumptions, and values that shape human reasoning. Much like people, they do not process information in a vacuum. Instead, their outputs reflect not only statistical regularities, but the ideological landscape of the society that produced their training text ( Feng et al. 2023 ; Jiang et al. 2022 ) . At the same time, recent studies have also indicated that LLMs have the ability, to a certain degree, to dynamically adopt different personas through prompting. While this has proven effective in enhancing annotation diversity ( Fröhling et al. 2024 ) , simulating human survey responses ( Argyle et al. 2023 ) , and improving cognitive capabilities ( Yeo et al. 2025 ) , it also introduces novel risks. Persona prompting has been found to increase the likelihood of toxic outputs ( Deshpande et al. 2023 ) , shift political expressions ( Bang et al. 2024 ) , and enable targeted ideological manipulation ( Chen et al. 2024 ; Shanahan et al. 2023 ) . While prior work has examined ideological bias in language models as a static property embedded in their weights, persona-driven behaviors suggest the presence of a more dynamic and controllable layer of ideological expression. Surprisingly, studies directly examining the ideological malleability of LLMs are lacking. In this article, we take a step in addressing this and investigate whether, how and to what extent language models can adapt their responses in ways that reflect, reinforce, or resist ideological perspectives. We address three specific research questions in this context. First, how does the adoption of diverse personas influence the ideological content of LLM-generated responses? That is, to what extent does persona conditioning shape the expression of their political perspectives? Second, can explicit ideological cues embedded within persona descriptions lead to measurable shifts in language model responses? Third, do themes within persona descriptions consistently correlate with specific ideological leanings in model outputs? Figure 1 . Experimental framework for probing ideological malleability in large language models. We evaluate how seven LLMs respond to political statements when adopting synthetic personas across three studies. In study 1 , 200,000 personas are prompted to answer 62 Political Compass Test (PCT) statements, establishing a baseline map of ideological variation ( implicit malleability ). In study 2 , we follow the same procedure as in study 1 but modify the personas with explicit ideological labels (“left leaning libertarian” or “right leaning authoritarian”) to quantify shifts in political orientation ( explicit malleability ). In study 3 , persona descriptions are embedded and clustered into 15 thematic groups (e.g., history, politics, business) to assess how thematic content correlates with systematic ideological deviations. Hexbin density plots show the distribution of model responses in the ideological space, and standard deviation maps highlight theme-specific directional biases. Our contributions are threefold. First, we develop an experimental framework to evaluate how LLMs respond to both implicit and explicit ideological conditioning. Second, we demonstrate that thematic content within persona descriptions can reliably steer model outputs in politically directional ways that echo sociocultural stereotypes embedded in the training data. Third, we find that this ideological responsiveness is scale-dependent, with larger models exhibiting stronger and more consistent shifts. 2. Probing ideological malleability We designed three studies to investigate how language models interpret and respond to persona-based adoption (Figure 1 ). Throughout these studies, we prompted seven LLMs

Read the complete text