Do Large Language Models Reflect Demographic Pluralism in Safety?

Usman Naseem, Gautam Siddharth Kashyap, Sushant Kumar Ray, Rafiq Ali, Ebad Shabbir, Abdullah Mohammad · 2026

Read Do Large Language Models Reflect Demographic Pluralism in Safety? by Usman Naseem, Gautam Siddharth Kashyap, Sushant Kumar Ray, Rafiq Ali, Ebad Shabbir, Abdullah Mohammad (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07376.txt.

Description

Safety judgments vary across cultures and demographics, yet match data sets draw annotators from narrow pools. Usman Naseem and five co-authors build Demo-SafetyBench to model demographic pluralism at the prompt level, separating value framing from responses.

First, prompts from an current dataset are reclassified into fourteen safety domains, retaining demographic metadata and expanding thin domains, yielding 43,050 samples. Then several language models rate pluralistic sensitivity under zero-shot inference, with balanced thresholds reaching high reliability. Alignment teams get a benchmark that asks whose safety values a model reflects, not just whether it refuses.

Catalog record

CREATORUsman Naseem, Gautam Siddharth Kashyap, Sushant Kumar Ray, Rafiq Ali, Ebad Shabbir, Abdullah Mohammad
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07376

Browse the full library · About the Tower of Babel