Multi-Faceted Studies on Data Poisoning can Advance LLM Development

Pengfei He, Yue Xing, Han Xu, Zhen Xiang, Jiliang Tang · 2025

Read Multi-Faceted Studies on Data Poisoning can Advance LLM Development by Pengfei He, Yue Xing, Han Xu, Zhen Xiang, Jiliang Tang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14182.txt.

Description

Poisoning a model's training data is usually framed as pure attack, and Pengfei He and co-authors argue the field is missing half the story. Real poisoning, they note, is hard: data collection is guarded, cleaning is rigorous, and language models train in stages, so injected poison rarely behaves as the attacker hopes. Rather than dropping the topic, their position paper proposes studying poisoning from three angles at once. As a threat, it exposes real safety risks worth defending. As a probe, it can surface hidden biases, harmful outputs, and hallucinations, and help build them out.

As a mechanism, poisoning experiments reveal how data steers model behavior from the inside. The authors argue these studies, taken together, would speed up language model development itself.

Catalog record

CREATORPengfei He, Yue Xing, Han Xu, Zhen Xiang, Jiliang Tang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-14182

Browse the full library · About the Tower of Babel