Understanding and Mitigating Bias Inheritance in LLM-based Data Augmentation on Downstream Tasks

Miaomiao Li, Hao Chen, Yang Wang, Tingyuan Zhu, Weijia Zhang, Kaijie Zhu, Kam-Fai Wong, Jindong Wang · 2025

Read Understanding and Mitigating Bias Inheritance in LLM-based Data Augmentation on Downstream Tasks by Miaomiao Li, Hao Chen, Yang Wang, Tingyuan Zhu, Weijia Zhang, Kaijie Zhu, Kam-Fai Wong, Jindong Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04419.txt.

Description

Miaomiao Li and co-authors study, in 2025, how bias passes from language models into the fake data they generate for training. Synthetic data can improve models, but the generator's own biases ride along and may grow. The team calls this bias inheritance and gives it a first systematic treatment.

Across ten tasks, they varied how much synthetic data was mixed with real data and tracked six bias types. Inheritance hurt fairness and strength mainly on tasks where bias was directly at stake. Three sources of mismatch were identified, covering values, group data, and distributions. Three fixes were tried, with mixed success, showing the problem is far from solved.

Catalog record

CREATORMiaomiao Li, Hao Chen, Yang Wang, Tingyuan Zhu, Weijia Zhang, Kaijie Zhu, Kam-Fai Wong, Jindong Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04419

Browse the full library · About the Tower of Babel