Understanding and Mitigating Toxicity in Image-Text Pretraining Datasets: A Case Study on LLaVA

Karthik Reddy Kanjula, Surya Guthikonda, Nahid Alam, Shayekh Bin Islam · 2025

Read Understanding and Mitigating Toxicity in Image-Text Pretraining Datasets: A Case Study on LLaVA by Karthik Reddy Kanjula, Surya Guthikonda, Nahid Alam, Shayekh Bin Islam (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06356.txt.

Description

Karthik Reddy Kanjula, Surya Guthikonda, Nahid Alam, and Shayekh Bin Islam published this paper in 2025. It audits toxicity in a popular image-text training set for multimodal AI, the LLaVA pretraining data drawn from the web. Models learn what their data teaches, including its hate speech, explicit imagery, and harassment.

The team measured how harmful content appears across the two modalities, since a clean caption can ride on a toxic image and the reverse. They built detection pipelines for the main toxicity categories, then produced a cleaned version of the data set, removing about seven and a half thousand toxic pairs. The refined set is released openly. Guidelines for robust filtering pipelines accompany it. The authors argue dataset hygiene is a first-class engineering task for multimodal systems, not an afterthought. Their case study gives other dataset builders a worked example of what to scan for and how.

Catalog record

CREATORKarthik Reddy Kanjula, Surya Guthikonda, Nahid Alam, Shayekh Bin Islam
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE14 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-06356

Browse the full library · About the Tower of Babel