Responsible Intelligence in Practice: A Fairness Audit of Open Large Language Models for Library Reference Services

Haining Wang, Jason Clark, Angelica Peña · 2026

Read Responsible Intelligence in Practice: A Fairness Audit of Open Large Language Models for Library Reference Services by Haining Wang, Jason Clark, Angelica Peña (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-18935.txt.

Description

Libraries are turning to language models for reference services, raising a fairness question. Can those services treat all patrons impartially, regardless of demographic identity? Haining Wang, with two co-authors, audits three widely used open models in 2026. The protocol pairs diagnostic classification, which spots systematic gaps between replies, with linguistic analysis, which helps explain them.

Across the three models, no compelling evidence of systematic distinction by race or ethnicity emerges. Only minor evidence of sex-linked differentiation appears, in one model and one setting. The authors discuss what that means for equitable AI adoption in libraries. Ongoing monitoring matters, they argue, for keeping LLM-based services aligned with social justice goals. Fairness here is not a one-time check, but a standing commitment.

Catalog record

CREATORHaining Wang, Jason Clark, Angelica Peña
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-18935

Browse the full library · About the Tower of Babel