Intrinsic Bias is Predicted by Pretraining Data and Correlates with Downstream Performance in Vision-Language Encoders
Kshitish Ghate, Isaac Slaughter, Kyra Wilson, Mona Diab, Aylin Caliskan · 2025
Read Intrinsic Bias is Predicted by Pretraining Data and Correlates with Downstream Performance in Vision-Language Encoders by Kshitish Ghate, Isaac Slaughter, Kyra Wilson, Mona Diab, Aylin Caliskan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-07957.txt.
Description
Kshitish Ghate and co-authors trace social bias in vision language models back to their training data in a 2025 paper. One hundred thirty-one models, twenty-six datasets, and fifty-five builds enter the sweep. Twenty-six bias tests grade each model in text, image, and mixed modes. The team asks which upstream choices drive the bias found inside.
Training dataset choice dwarfed build shape as a bias predictor. Fancy filtering that boosts task scores tended to raise bias as well. Bias inside the model tracked real task performance with fair strength. Text and image tests disagreed on which groups face bias. Fixes must span the full build pipeline, not just final tuning.
Catalog record
| CREATOR | Kshitish Ghate, Isaac Slaughter, Kyra Wilson, Mona Diab, Aylin Caliskan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-07957