Examining the Alignment of Large Language Models through Representative Heuristics: the case of political stereotypes
Sullam Jeoung Yubin Ge Haohan Wang Jana Diesner · 2025
Read Examining the Alignment of Large Language Models through Representative Heuristics: the case of political stereotypes by Sullam Jeoung Yubin Ge Haohan Wang Jana Diesner (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-14294.txt.
Description
Sullam Jeoung, Yubin Ge, Haohan Wang, and Jana Diesner tested in 2025 whether large language models exaggerate the views of political parties. Models are known to lean in their answers, but how far they drift from real party positions was unclear. The team borrowed an idea from the study of human judgment: people lean on standout traits of a group and overshoot. They checked model answers through that lens.
Models did copy party stances, but often pushed them further than human survey answers did. They also leaned on standout traits more heavily than people. Prompt tricks that calm this bias in humans worked on the models too. The authors warn that the habit could feed political stereotyping at scale if left unchecked.
Catalog record
| CREATOR | Sullam Jeoung Yubin Ge Haohan Wang Jana Diesner |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-14294