Multi-Faceted Studies on Data Poisoning can Advance LLM Development
Pengfei He, Yue Xing, Han Xu, Zhen Xiang, Jiliang Tang · 2025
Read Multi-Faceted Studies on Data Poisoning can Advance LLM Development by Pengfei He, Yue Xing, Han Xu, Zhen Xiang, Jiliang Tang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14182.txt.
Description
Poisoning a model's training data is usually framed as pure attack, and Pengfei He and co-authors argue the field is missing half the story. Real poisoning, they note, is hard: data collection is guarded, cleaning is rigorous, and language models train in stages, so injected poison rarely behaves as the attacker hopes. Rather than dropping the topic, their position paper proposes studying poisoning from three angles at once. As a threat, it exposes real safety risks worth defending. As a probe, it can surface hidden biases, harmful outputs, and hallucinations, and help build them out.
As a mechanism, poisoning experiments reveal how data steers model behavior from the inside. The authors argue these studies, taken together, would speed up language model development itself.
Catalog record
| CREATOR | Pengfei He, Yue Xing, Han Xu, Zhen Xiang, Jiliang Tang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-14182