When Names Change Verdicts: Intervention Consistency Reveals Systematic Bias in LLM Decision-Making
Abhinaba Basu, Pavan Chakraborty · 2026
Read When Names Change Verdicts: Intervention Consistency Reveals Systematic Bias in LLM Decision-Making by Abhinaba Basu, Pavan Chakraborty (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18530.txt.
Description
Basu and Chakraborty test whether large language models change verdicts when only names, credentials, or wording change. Their ICE-Guard framework swaps these features across 3,000 short cases in ten high-stakes fields. They test 11 models and find authority bias and framing bias beat demographic bias. Finance shows the strongest authority bias. A fix that splits feature extraction from a fixed rubric cuts flip rates sharply. Checks on real COMPAS data suggest the test may understate real bias.
Catalog record
| CREATOR | Abhinaba Basu, Pavan Chakraborty |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31659 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.18530