Analysing LLM Persona Generation and Fairness Interpretation in Polarised Geopolitical Contexts
Maida Aizaz, Quang Minh Nguyen · 2026
Read Analysing LLM Persona Generation and Fairness Interpretation in Polarised Geopolitical Contexts by Maida Aizaz, Quang Minh Nguyen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22837.txt.
Introduction
Aizaz and Nguyen analyze personas that language models generate for Palestinian and Israeli identities. Five models are tested across 640 conditions, varying war context and assigned role. In war settings, Palestinian profiles often get lower status and survival-focused roles. Israeli profiles mostly keep middle-class status and specialist jobs. Prompts that warn against harmful assumptions change the outputs in varied ways. The deeper status gap often stays, though. Reasoning traces mention fairness, yet final personas do not mirror those ideas in a steady way.
Catalog record
| CREATOR | Maida Aizaz, Quang Minh Nguyen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44902 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.22837
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Analysing LLM Persona Generation and Fairness Interpretation in Polarised Geopolitical Contexts Maida Aizaz, Quang Minh Nguyen Abstract Large language models (LLMs) are increasingly utilised for social simulation and persona generation, necessitating an understanding of how they represent geopolitical identities. In this paper, we analyse personas generated for Palestinian and Israeli identities by five popular LLMs across 640 experimental conditions, varying context (war vs non-war) and assigned roles. We observe significant distributional patterns in the generated attributes: Palestinian profiles in war contexts are frequently associated with lower socioeconomic status and survival-oriented roles, whereas Israeli profiles predominantly retain middle-class status and specialised professional attributes. When prompted with explicit instructions to avoid harmful assumptions, models exhibit diverse distributional changes, e.g., marked increases in non-binary gender inferences or a convergence toward generic occupational roles (e.g., "student"), while the underlying socioeconomic distinctions often remain. Furthermore, analysis of reasoning traces reveals an interesting dynamics between model reasoning and generation: while rationales consistently mention fairness-related concepts, the final generated personas follow the aforementioned diverse distributional changes. These findings illustrate a picture of how models interpret geopolitical contexts, while suggesting that they process fairness and adjust in varied ways; there is no consistent, direct translation of fairness concepts into representative outcomes. 1 Introduction Large language models (LLMs) are increasingly adopted in many social applications, e.g., political science ( 14 ) , social language use and cultural analysis ( 34 ) , persona generation and simulation ( 8 ) . As these models are deployed in high-stakes domains, their ability to avoid biases and represent diverse identities with fidelity and nuance becomes critical ( 28 ; 33 ; 27 ; 15 ) . However, the majority of existing research focuses on broad demographic categories situated within Western-centric contexts. It remains unclear how models handle complex, polarised geopolitical identities where representational attributes are historically deep and contested. In this paper, we focus on one such setting: the generation of Palestinian and Israeli personas. We select this context due to the ongoing war in Gaza, characterised by severe humanitarian asymmetries with over 70,000 Palestinians and over 1,200 Israelis killed since its advent on 7 October, 2023 ( 18 ) . This setting allows us to investigate how models construct personas when the underlying training data is likely dominated by conflict-related narratives. We do not aim to propose or evaluate alignment mechanisms; rather, we use this setting to probe how models represent identities and interpret "fairness" under the weight of such polarised context. Through our experiments with five popular LLMs and 640 different prompts, we observe significant distributional patterns in the generated profiles. Specifically, we find that models consistently associate Palestinian profiles in war contexts with lower socioeconomic status and survival-oriented roles, whereas Israeli profiles predominantly retain middle-class status and professional attributes. These patterns indicate that the models integrate the geopolitical environment into the persona generation process in distinct ways for each identity group, resulting in divergent representational outcomes. When prompted with explicit instructions to avoid harmful assumptions, models exhibit diverse distributional changes. For instance, we observe marked increases in non-binary gender inferences or a convergence toward generic occupational roles (e.g., "student"), while the underlying socioeconomic distinctions often remain. To further interpret these behaviours, we analyse the rationales generated by the models. We employ a Sparse Autoencoder (SAE) trained on Llama 3.1 8B as a document embedding tool to identify interpretable features within the reasoning traces of the target models. This analysis reveals a dissociation between the reasoning process and the final generation: while the reasoning traces actively and consistently contain features related to fairness and caution, the subsequent generated personas follow the diverse distributional shifts described above. Our research highlights the complexity of persona generation in geopolitically sensitive domains . We find that models interpret the same safety instructions in varying directions in socioeconomic outcomes in the generated content . We call for future research to examine these interpretative dynamics in broader geopolitical contexts, explain mechanisms more deeply, and develop a clear framework for geopolitical fairness. 2 Related Works Representation risks and social biases in LLMs Several benchmarks have been proposed to measure LLM biases in various contexts: gender ( 33 ; 12 ) , nationality ( 17 ) , hiring decisions ( 27 ) , country-specific ( 20 ) , disability ( 10 ) , and cultural practice ( 26 ; 16 ) , amongst others. While there have been efforts in characterising model biases in geopolitical contexts ( 13 ; 23 ) , the question of how models handle identities in geopolitical conflicts remains unanswered. Our paper contributes through focusing on LLM-generated profiles of Palestinians and Israelis, identities that are involved in an ongoing war ( 18 ) as well as past hostilities potentially covered from various perspectives in the pretraining data of LLMs. Here, we note, importantly, that we do not claim a specific, fixed definition of unbiasedness which all models must follow in this war context; we shall instead draw observations from how models navigate representations in the context and how they interpret fairness themselves. Safety intervention for LLMs As shown through the various aforementioned benchmarks, LLMs equipped with safety alignment are still imperfect. A rich body of literature has explored the possibilities of intervening model outputs with methods ranging from prompt injections 29 ; 7 to representation steering ( 1 ; 31 ) , both to red-team and to improve fairness and safety. Though we examine a simple prompt-level intervention, hinting models to avoid harmful stereotypes, our main goal is to audit LLMs in how they handle the concept of fairness; we do not hypothesise that our intervention will make models safer. Interpretability as a tool The study of mechanical interpretability aims to explain model behaviours using their internal representations and reasoning traces 21 ; 4 ; 32 . The tools involved in interpretability studies can be applied in downstream tasks, e.g., harmful behaviour monitoring through activation probing 6 . In this paper, we make use of SAEs 5 —an interpretability tool—as a human-readable document feature extraction method, which is publicly available through the InterpEmbed toolkit ( 11 ) . Our analysis of social texts with this feature extraction method is a novel application of SAEs. 3 Methods 3.1 Models In this research, we use five models of various sizes, each being the flagship in its family: Gemma 3 27B ( 24 ) , Qwen3 32B ( 30 ) 1 1 1 We use Qwen3 32B instead of mixture-of-expert models in the same series for comparability with Gemma 3 27B and Llama 3.3 70B, which are also dense models. , Llama 3.3 70B Instruct ( 9 ) , Gemini 2.5 Pro ( 3 ) , and GPT-4.1 ( 19 ) . Inferences are done at temperature 0.7 through OpenRouter. We also make use of an SAE at layer 19 of Llama 3.1 8B Instruct trained on the LMSYS-Chat-1M dataset by Goodfire ( 2 ) . 3.2 Experimental Design Our experiments serve to answer three main research questions. Representative model-generated responses can be found in Appendix A . RQ1: What profiles do models typically assign to Palestinians and Israelis in various conditions? We first identify distributional patterns that appear in model-generated profiles for Palestinians and Israelis. To