UniSAFE: A Comprehensive Benchmark for Safety Evaluation of Unified Multimodal Models

Segyu Lee, Boryeong Cho, Hojung Jung, Seokhyun An, Juhyeong Kim, Jaehyun Kwak, Yongjin Yang, Sangwon Jang, Youngrok Park, Wonjun Chang, Se-Young Yun, KAIST AI, Department of Computer Science, Engineering, UNIST, Department of Mathematical Sciences, KAIST, University of Toronto, KAIST CS {segyu.lee, venntum, ghwjd7281 }@kaist.ac.kr · 2026

Read UniSAFE: A Comprehensive Benchmark for Safety Evaluation of Unified Multimodal Models by Segyu Lee, Boryeong Cho, Hojung Jung, Seokhyun An, Juhyeong Kim, Jaehyun Kwak, Yongjin Yang, Sangwon Jang, Youngrok Park, Wonjun Chang, Se-Young Yun, KAIST AI, Department of Computer Science, Engineering, UNIST, Department of Mathematical Sciences, KAIST, University of Toronto, KAIST CS {segyu.lee, venntum, ghwjd7281 }@kaist.ac.kr (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-17476.txt.

Introduction

Lee and co-authors introduce UniSAFE, a benchmark for the safety of unified multimodal models. Older safety tests split across tasks and formats, missing system-level flaws. UniSAFE spans seven input-output modality mixes with 6,802 curated cases. A shared-target design lets users compare failures across setups fairly. Tests of 15 leading models found more violations in multi-image and multi-turn cases, they report. Image-output tasks proved weakest overall.

Catalog record

CREATORSegyu Lee, Boryeong Cho, Hojung Jung, Seokhyun An, Juhyeong Kim, Jaehyun Kwak, Yongjin Yang, Sangwon Jang, Youngrok Park, Wonjun Chang, Se-Young Yun, KAIST AI, Department of Computer Science, Engineering, UNIST, Department of Mathematical Sciences, KAIST, University of Toronto, KAIST CS {segyu.lee, venntum, ghwjd7281 }@kaist.ac.kr
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE155881
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.17476

Browse the full library · About the Tower of Babel