Do We Really Need Curated Malicious Data for Safety Alignment in Multi-modal Large Language Models?

Yanbo Wang, Jiyang Guan, Jian Liang, Ran HeSchool of Artificial Intelligence, University of Chinese Academy of SciencesNLPR & MAIS, Institute of Automation, Chinese Academy of Sciences [email protected] [email protected] · 2025

Read Do We Really Need Curated Malicious Data for Safety Alignment in Multi-modal Large Language Models? by Yanbo Wang, Jiyang Guan, Jian Liang, Ran HeSchool of Artificial Intelligence, University of Chinese Academy of SciencesNLPR & MAIS, Institute of Automation, Chinese Academy of Sciences [email protected] [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-10000.txt.

Description

Yanbo Wang, Jiyang Guan, and co-authors ask if sight tongue models need hand made bad data to learn safe replies, in a 2025 paper. Such models lean on tongue side safe tune, which leaves sight tricks a gap. Hand made bad sets cost much work, and what they teach was not clear till now.

Side by side tests pin the gap on data mix skew, not shot facts or reply grade. Plain kind teach data with short no replies swapped in lifts safe marks a lot. A set share of no replies in the tune set does the trick in runs. Safe tune may just be hid, not lost, in such models. Mix fix may close the sight gap.

Catalog record

CREATORYanbo Wang, Jiyang Guan, Jian Liang, Ran HeSchool of Artificial Intelligence, University of Chinese Academy of SciencesNLPR & MAIS, Institute of Automation, Chinese Academy of Sciences [email protected] [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-10000

Browse the full library · About the Tower of Babel