Understanding and Mitigating Bias Inheritance in LLM-based Data Augmentation on Downstream Tasks
Miaomiao Li, Hao Chen, Yang Wang, Tingyuan Zhu, Weijia Zhang, Kaijie Zhu, Kam-Fai Wong, Jindong Wang · 2025
Read Understanding and Mitigating Bias Inheritance in LLM-based Data Augmentation on Downstream Tasks by Miaomiao Li, Hao Chen, Yang Wang, Tingyuan Zhu, Weijia Zhang, Kaijie Zhu, Kam-Fai Wong, Jindong Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04419.txt.
Description
Miaomiao Li and co-authors study, in 2025, how bias passes from language models into the fake data they generate for training. Synthetic data can improve models, but the generator's own biases ride along and may grow. The team calls this bias inheritance and gives it a first systematic treatment.
Across ten tasks, they varied how much synthetic data was mixed with real data and tracked six bias types. Inheritance hurt fairness and strength mainly on tasks where bias was directly at stake. Three sources of mismatch were identified, covering values, group data, and distributions. Three fixes were tried, with mixed success, showing the problem is far from solved.
Catalog record
| CREATOR | Miaomiao Li, Hao Chen, Yang Wang, Tingyuan Zhu, Weijia Zhang, Kaijie Zhu, Kam-Fai Wong, Jindong Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04419