UniSAFE: A Comprehensive Benchmark for Safety Evaluation of Unified Multimodal Models
Segyu Lee, Boryeong Cho, Hojung Jung, Seokhyun An, Juhyeong Kim, Jaehyun Kwak, Yongjin Yang, Sangwon Jang, Youngrok Park, Wonjun Chang, Se-Young Yun, KAIST AI, Department of Computer Science, Engineering, UNIST, Department of Mathematical Sciences, KAIST, University of Toronto, KAIST CS {segyu.lee, venntum, ghwjd7281 }@kaist.ac.kr · 2026
Read UniSAFE: A Comprehensive Benchmark for Safety Evaluation of Unified Multimodal Models by Segyu Lee, Boryeong Cho, Hojung Jung, Seokhyun An, Juhyeong Kim, Jaehyun Kwak, Yongjin Yang, Sangwon Jang, Youngrok Park, Wonjun Chang, Se-Young Yun, KAIST AI, Department of Computer Science, Engineering, UNIST, Department of Mathematical Sciences, KAIST, University of Toronto, KAIST CS {segyu.lee, venntum, ghwjd7281 }@kaist.ac.kr (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-17476.txt.
Introduction
Lee and co-authors introduce UniSAFE, a benchmark for the safety of unified multimodal models. Older safety tests split across tasks and formats, missing system-level flaws. UniSAFE spans seven input-output modality mixes with 6,802 curated cases. A shared-target design lets users compare failures across setups fairly. Tests of 15 leading models found more violations in multi-image and multi-turn cases, they report. Image-output tasks proved weakest overall.
Catalog record
| CREATOR | Segyu Lee, Boryeong Cho, Hojung Jung, Seokhyun An, Juhyeong Kim, Jaehyun Kwak, Yongjin Yang, Sangwon Jang, Youngrok Park, Wonjun Chang, Se-Young Yun, KAIST AI, Department of Computer Science, Engineering, UNIST, Department of Mathematical Sciences, KAIST, University of Toronto, KAIST CS {segyu.lee, venntum, ghwjd7281 }@kaist.ac.kr |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 155881 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.17476