Self-adaptive Dataset Construction for Real-World Multimodal Safety Scenarios

Jingen Qu, Lijun Li, Bo Zhang, Yichen Yan, Jing Shao · 2025

Read Self-adaptive Dataset Construction for Real-World Multimodal Safety Scenarios by Jingen Qu, Lijun Li, Bo Zhang, Yichen Yan, Jing Shao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-04403.txt.

Description

Jingen Qu and four co-authors build safety training data for multimodal AI by starting from pictures in a 2025 research paper. Models that read images and text together face growing safety risks in messy real situations. Older data-building methods start from known risks and miss much of that complexity, and no shared yardstick proved their worth. The new image-oriented method grows paired text and guidance replies outward from each image automatically, adapting as it goes.

Their generated set holds thirty-five thousand pairs of images and text, each with a guidance response. A standardized evaluation trick fine-tunes a safety judge model and tests it on other safety collections. Experiments confirmed the pipeline scales and works. The data set is posted publicly for other teams.

Catalog record

CREATORJingen Qu, Lijun Li, Bo Zhang, Yichen Yan, Jing Shao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-04403

Browse the full library · About the Tower of Babel