Uncovering Bias in Foundation Models: Impact, Testing, Harm, and Mitigation

Shuzhou Sun, Li Liu, Yongxiang Liu, Zhen Liu, Shuanghui Zhang, Janne Heikkilä, Xiang Li · 2025

Read Uncovering Bias in Foundation Models: Impact, Testing, Harm, and Mitigation by Shuzhou Sun, Li Liu, Yongxiang Liu, Zhen Liu, Shuanghui Zhang, Janne Heikkilä, Xiang Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10453.txt.

Introduction

Shuzhou Sun and co-authors probe bias in foundation models in a 2025 paper. These large models absorb stereotypes from their vast training data, and the distortions can deepen discrimination in fields like health care, education, and finance.

The authors introduce a probe-based testing method that hunts both open and hidden bias across single traits and mixed ones, such as gender combined with race or age. Four well-known vision-language models all showed pervasive bias. They then propose a post-processing fix that rebalances output probabilities without retraining. The adjustment improved fairness markedly, and the paper argues for routine bias auditing.

Catalog record

CREATORShuzhou Sun, Li Liu, Yongxiang Liu, Zhen Liu, Shuanghui Zhang, Janne Heikkilä, Xiang Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE166 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-10453

Browse the full library · About the Tower of Babel