On the robustness of multimodal language model towards distractions

Ming Liu, Hao Chen, Jindong Wang, Wensheng Zhang · 2025

Read On the robustness of multimodal language model towards distractions by Ming Liu, Hao Chen, Jindong Wang, Wensheng Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09818.txt.

Introduction

Vision-language models answer questions about images, but real inputs often contain noise and irrelevant detail. Ming Liu, Hao Chen, Jindong Wang, and Wensheng Zhang tested that weakness in 2025 with a new benchmark built on science questions. They added distractions to both the pictures and the text of the questions, then measured how well leading models still reasoned.

Most models, including GPT-4, lost clear accuracy when distractions were present. Text distractions hurt more than visual ones. One model family, InternVL2, held up better than the rest. Prompt tricks that the team tried raised scores somewhat, but the authors say large room for improvement remains before such models can be trusted in messy settings.

Catalog record

CREATORMing Liu, Hao Chen, Jindong Wang, Wensheng Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-09818

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On the robustness of multimodal language model towards distractions Ming Liu, Hao Chen, Jindong Wang, Wensheng Zhang Abstract Although vision-language models (VLMs) have achieved significant success in various applications such as visual question answering, their resilience to prompt distractions remains as an under-explored area. Understanding how distractions affect VLMs is crucial for improving their real-world applicability, as inputs could have noisy and irrelevant information in many practical scenarios. This paper aims to assess the robustness of VLMs against both visual and textual distractions in the context of science question answering. Built on the ScienceQA dataset, we developed a new benchmark that introduces distractions in both the visual and textual contexts. To evaluate the reasoning capacity of VLMs amidst these distractions, we analyzed the performance of ten state-of-the-art VLMs, including GPT-4o. Our findings reveal that most VLMs are vulnerable to various types of distractions, experiencing noticeable degradation in reasoning capabilities when confronted with distractions. Notably, models such as InternVL2 demonstrates a higher degree of robustness to these distractions. We also found that models exhibit greater sensitivity to textual distractions than visual ones. Additionally, we explored various mitigation strategies, such as prompt engineering, to counteract the impact of distractions. While these strategies improved model resilience, our analysis shows that there remain significant opportunities for improvement. 1 Introduction Despite the impressive capabilities of vision-language models (VLMs) in understanding images and generating human-like text [ 17 , 5 , 11 ] , their susceptibility to irrelevant information remains a critical challenge. In real-world, it is common that visual and text inputs could have noisy distractions. Such distractions can lead to performance degradation, potentially resulting in incorrect interpretations or responses with hallucination from VLMs [ 36 , 4 ] . Figure 1 : Diagram illustrating various scenario of distraction we apply to the samples in Science-QA dataset. Existing benchmarks for VLMs are typically designed under the assumption that inputs in both visual and textual domains are carefully curated without distractions. This assumption, however, fails to reflect real-world scenarios. Previous research [ 30 ] has demonstrated that large language models (LLMs) are vulnerable to textual distractions. With the rapid development of VLMs, it is crucial to understand how these models handle distractions not only in the textual domain but also in the visual domain. Compared to LLMs, VLMs face the additional challenge of potential distractions from bi-modal inputs, making the situation more complex. Moreover, current evaluation benchmarks [ 19 , 31 , 20 ] do not adequately account for the presence of distractions within the input. They often emphasize clean and well-structured datasets, which do not mirror the complexities and noise inherent in real-world data. This oversight limits the ability to assess the true robustness and reliability of VLMs when deployed in practical settings where distractions are inevitable. Consequently, there is a pressing need for benchmarks that systematically introduce and evaluate various types of distractions to better understand and improve VLM performance under realistic conditions. To address this gap, we present I-ScienceQA, a comprehensive benchmark designed to investigate the robustness of VLMs towards distractions. Our benchmark, built upon the ScienceQA dataset [ 19 ] , incorporates various types of distractions to simulate more realistic scenarios. Specifically, we aim to answer the following questions: • How vulnerable are VLMs towards distractions across different modalities? • Which modality, visual or textual, causes more degradation in model performance when distracted? • What techniques can mitigate the impact of distractions and improve the robustness of VLMs? To build I-ScienceQA , we leveraged different generative models, including GPT-3.5-turbo [ 23 ] and Stable diffusion models [ 27 ] . Our benchmark comprises 8,100 samples with four scenarios of distractions in both visual and textual domains. Specifically, we utilized stable diffusion models to generate visual distractions, such as neutral backgrounds, generic landscapes, abstract art, and everyday objects. For textual distractions, we employed GPT-3.5-turbo to produce textual distractions such as contradictory information, irrelevant details. This approach allowed us to simulate a wide range of real-world scenarios where VLMs might encounter noisy or irrelevant information. More information about the definition of distractions can be found in Appendix. Through extensive evaluation of the various state-of-the-art VLMs, our key findings include: • VLMs exhibit varying degrees of vulnerability to distractions, with performance degradation observed across different models and scenarios (see Section 5 ). • Textual distractions tend to have a more significant impact on VLMs compared to visual distractions, particularly in the “Add Hints” scenario (see Section 5 ). • Larger models generally demonstrate better robustness against distractions, with some models like Internvl2 (8B) showing minimal performance drops in certain scenarios (see Section 6.1 ). • Prompt engineering techniques or robust encoders offer limited enhancement to VLM performance against distractions, with their effectiveness varying across different models and tasks (see Section 6.3 ). • The impact of bi-modal distractions (both visual and textual) on VLMs is nuanced, with some models showing consistent performance while others exhibiting minor fluctuations (see Section 6.4 ). Our research not only provides valuable insights into the current limitations of VLMs but also highlights potential areas for improvement in model design and training methodologies. By addressing these challenges, we can develop more robust and reliable VLMs for real-world applications. 2 Related Work Model Evaluations VLMs have traditionally been evaluated using standard Visual Question Answering (VQA) tasks such as TextVQA [ 31 ] , VQAv2 [ 1 ] , and GQA [ 12 ] . Mecently, studies like MM-Vet [ 34 ] , POPE [ 16 ] , and MM-Bench [ 18 ] have emerged to evaluate VLMs, in key challenges such as hallucination, reasoning. These efforts have demonstrated that multimodal LLMs encounter significant issues, such as hallucination [ 9 ] and insufficient robustness [ 7 ] . In this papr, we introduce the I-ScienceQA benchmark, which highlights that even advanced VLMs, such as GPT-4o [ 22 ] , struggle with basic visual questions when irrelevant distractions are present in the input. Robustness of VLM To test the robustness of model reasoning, researchers have constructed arithmetic reasoning benchmarks by paraphrasing or rewriting sentences from clean datasets [ 24 , 14 , 30 ] . Recent studies have increasingly concentrated on the adversarial robustness of VLMs [ 26 , 2 , 28 , 35 , 6 ] . Schlarmann and Hein [28] demonstrate that imperceptible perturbations in input images can enable attackers to manipulate LVLMs into generating specific outputs. Visual adversarial attacks designed to jailbreak LVLMs are introduced in works such as Carlini et al. [2] and Qi et al. [26] . Recently, studies have focused on training adversary-robust vision encoders [ 29 , 21 ] . 3 Benchmark 3.1 Overview of I-ScienceQA In order to create a comprehensive benchmark for assessing the robustness of VLMs, it is essential to introduce minor distractions while ensuring that the hints for solving the questions remain accessible in either the textual or visual context. Developing I-ScienceQA presented several challenges. Firstly, ensuring the diversity and relevance of distractions across both visual and textual modalities required meticulous selection and generation strategies. Additionally, maintaining the semantic integrity of the original questions while injecting distractions demanded advanced techniques in data augmentation and validation. To overcome these challenges, we leveraged state-of-the-art generative

Read the complete text