Are Stereotypes Leading LLMs’ Zero-Shot Stance Detection ?
Anthony Dubreuil, Antoine Gourru, Christine Largeron, Amine Trabelsi · 2025
Read Are Stereotypes Leading LLMs’ Zero-Shot Stance Detection ? by Anthony Dubreuil, Antoine Gourru, Christine Largeron, Amine Trabelsi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-20154.txt.
Description
Anthony Dubreuil and three co-authors test whether stereotypes sway large language models when they label stance in text with no training examples. Stance detection marks a statement as against, in favor of, or neutral toward a target, and it often touches political views. Bias in this task has been largely overlooked compared with hate speech or sentiment work.
The team automatically tagged posts in existing stance datasets with two attributes: the dialect of a social group and the complexity of the text. Model decisions shifted with those attributes in stereotyped ways, for example linking pro-marijuana views with low text complexity and African American dialect with opposition to Donald Trump. The findings show a measurable fairness risk.
Catalog record
| CREATOR | Anthony Dubreuil, Antoine Gourru, Christine Largeron, Amine Trabelsi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-20154