When Names Change Verdicts: Intervention Consistency Reveals Systematic Bias in LLM Decision-Making

Abhinaba Basu, Pavan Chakraborty · 2026

Read When Names Change Verdicts: Intervention Consistency Reveals Systematic Bias in LLM Decision-Making by Abhinaba Basu, Pavan Chakraborty (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18530.txt.

Description

Basu and Chakraborty test whether large language models change verdicts when only names, credentials, or wording change. Their ICE-Guard framework swaps these features across 3,000 short cases in ten high-stakes fields. They test 11 models and find authority bias and framing bias beat demographic bias. Finance shows the strongest authority bias. A fix that splits feature extraction from a fixed rubric cuts flip rates sharply. Checks on real COMPAS data suggest the test may understate real bias.

Catalog record

CREATORAbhinaba Basu, Pavan Chakraborty
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31659
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.18530

Browse the full library · About the Tower of Babel