No for Some, Yes for Others: Persona Prompts and Other Sources of False Refusal in Language Models
Flor Miriam Plaza-del-Arco, Paul Röttger, Nino Scherrer, Emanuele Borgonovo, Elmar Plischke, Dirk Hovy · 2025
Read No for Some, Yes for Others: Persona Prompts and Other Sources of False Refusal in Language Models by Flor Miriam Plaza-del-Arco, Paul Röttger, Nino Scherrer, Emanuele Borgonovo, Elmar Plischke, Dirk Hovy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-08075.txt.
Description
Telling a language model to act as a persona can make it refuse harmless requests, measure Flor Miriam Plaza-del-Arco and 5 co-authors in a 2025 paper on model behaviour. Personalisation is spreading, yet recent work hinted that persona prompts raise false refusals, cases where the model wrongly declines a legitimate task. Nobody had quantified the effect properly.
Fifteen sociodemographic personas, spanning gender, race, religion, and disability, are tested across sixteen models and three tasks, with nine prompt paraphrases controlling for wording luck. The design separates genuine persona effects from noise. False refusals are not harmless: if they cluster on particular identities, personalised systems quietly give worse service to the very users they imitate.
Catalog record
| CREATOR | Flor Miriam Plaza-del-Arco, Paul Röttger, Nino Scherrer, Emanuele Borgonovo, Elmar Plischke, Dirk Hovy |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-08075