Do We Really Need Curated Malicious Data for Safety Alignment in Multi-modal Large Language Models?
Yanbo Wang, Jiyang Guan, Jian Liang, Ran HeSchool of Artificial Intelligence, University of Chinese Academy of SciencesNLPR & MAIS, Institute of Automation, Chinese Academy of Sciences [email protected] [email protected] · 2025
Read Do We Really Need Curated Malicious Data for Safety Alignment in Multi-modal Large Language Models? by Yanbo Wang, Jiyang Guan, Jian Liang, Ran HeSchool of Artificial Intelligence, University of Chinese Academy of SciencesNLPR & MAIS, Institute of Automation, Chinese Academy of Sciences [email protected] [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-10000.txt.
Description
Yanbo Wang, Jiyang Guan, and co-authors ask if sight tongue models need hand made bad data to learn safe replies, in a 2025 paper. Such models lean on tongue side safe tune, which leaves sight tricks a gap. Hand made bad sets cost much work, and what they teach was not clear till now.
Side by side tests pin the gap on data mix skew, not shot facts or reply grade. Plain kind teach data with short no replies swapped in lifts safe marks a lot. A set share of no replies in the tune set does the trick in runs. Safe tune may just be hid, not lost, in such models. Mix fix may close the sight gap.
Catalog record
| CREATOR | Yanbo Wang, Jiyang Guan, Jian Liang, Ran HeSchool of Artificial Intelligence, University of Chinese Academy of SciencesNLPR & MAIS, Institute of Automation, Chinese Academy of Sciences [email protected] [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-10000