Preemptive Hallucination Reduction: An Input-Level Approach for Multimodal Language Model

Nokimul Hasan Arif, Shadman Rabby, Md Hefzul Hossain Papon, Sabbir Ahmed · 2025

Read Preemptive Hallucination Reduction: An Input-Level Approach for Multimodal Language Model by Nokimul Hasan Arif, Shadman Rabby, Md Hefzul Hossain Papon, Sabbir Ahmed (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24007.txt.

Introduction

Nokimul Hasan Arif and co-authors cut visual hallucinations in multimodal language models by fixing the input before the model ever sees it, in a 2025 paper. These models sometimes describe things that are not in the image. Most fixes retrain the model or correct answers afterward. Input-level cleaning has been little explored.

Their ensemble picks the best preparation for each question. Options include noise reduction, edge enhancement, or leaving the image untouched. The right choice depends on what the question asks. Hallucinations drop without any model retraining. That makes the method portable across systems. Developers of image-aware assistants gain a cheap safety layer. Reliability matters most in medical and legal image tasks.

Catalog record

CREATORNokimul Hasan Arif, Shadman Rabby, Md Hefzul Hossain Papon, Sabbir Ahmed
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24007

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Preemptive Hallucination Reduction: An Input-Level Approach for Multimodal Language Model Nokimul Hasan Arif, Shadman Rabby, Md Hefzul Hossain Papon, Sabbir Ahmed Abstract Visual hallucinations in Large Language Models (LLMs), where the model generates responses that are inconsistent with the visual input, pose a significant challenge to their reliability, particularly in contexts where precise and trustworthy outputs are critical. Current research largely emphasizes post-hoc correction or model-specific fine-tuning strategies, with limited exploration of preprocessing techniques to address hallucination issues at the input stage. This study presents a novel ensemble-based preprocessing framework that adaptively selects the most appropriate filtering approach—noise reduced (NR), edge enhanced (EE), or unaltered input (org) based on the type of question posed, resulting into reduced hallucination without requiring any modifications to the underlying model architecture or training pipeline. Evaluated on the ‘HaloQuest’ dataset- a benchmark designed to test multimodal reasoning on visually complex inputs, our method achieves a 44.3% reduction in hallucination rates, as measured by Natural Language Inference (NLI) scores using SelfCheckGPT. This demonstrates that intelligent input conditioning alone can significantly enhance factual grounding in LLM responses. The findings highlight the importance of adaptive preprocessing techniques in mitigating hallucinations, paving the way for more reliable multimodal systems capable of addressing real-world challenges. keywords Large Language Models (LLMs), Hallucination Mitigation, Vision-Language Model, Multimodal Reasoning, Visual Hallucination, Ensemble Filtering, SelfCheckGPT, HaloQuest Dataset 1 Introduction The rapid growth of Large Language Models (LLMs) has revolutionized many fields, starting from natural language processing to computer vision and artificial intelligence Hamadi (2023) ; Budnikov et al. (2025) ; Abrar et al. (2024) . Their increasing scale and adaptability have facilitated the deployment across a diverse spectrum of tasks, including multimodal reasoning, embodied agents, medical assistance, mental health assessment, creative text understanding, etc., demonstrating their broad applicability in both technical and socially impactful domains Lee et al. (2025) ; Khan et al. (2023) ; Ahmed et al. (2024) ; Mahbub et al. (2023) . These models excel in generating coherent, contextually relevant responses by integrating textual and visual data Zhang et al. (2024) ; Ivan et al. (2024) ; Wei et al. (2024) . However, their utility is hindered by a persistent issue: visual hallucinations Huang et al. (2025) as shown in Figure 1 . These hallucinations, where models generate information misaligned with the provided visual input, undermine their reliability and trustworthiness, especially in high-stakes domains Li et al. (2025) ; Xu et al. (2025) . Figure 1 : An example of visual hallucination of an AI model. The RED text shows the deviation from the ground-truth answer of the question—“There are 3 bird-like creatures in the image.” Modern models, such as GPT-4V OpenAI (2023) , MiniGPT Zhu et al. (2023) , frequently suffer from hallucinations while generating text conditioned on visual inputs Huang et al. (2024) ; Mohammed et al. (2025) . These may manifest as invented objects or relationships and raise concerns about trusting such models in real-world application scenarios Miyai et al. (2024) . With LLMs becoming integrated into fields such as healthcare, autonomous systems, and customer service, the need to look closer at such visual hallucinations has increased Li et al. (2025) ; Rafi et al. (2025) ; Chen et al. (2024) . Research on mitigating visual hallucinations can logically fall into four major areas: data-related strategies, model-related approaches, training-related techniques, and inference-related methods Bai et al. (2024) . In this context, the common stream in the data-related strategies is the enhancement of visual instruction data to clear inaccuracies or misleading descriptions that may not match the actual visual contents Kim et al. (2024) . Generally, model-based methods improve either the structure or the training process of LLMs in enhancing their ability to distinguish accurate information from visual displays, and data-related strategies are computationally extensive and time-consuming Li et al. (2023) . Our work falls under the data-related strategy, where we improve the visual instructions to get better output from the model. This work presents a novel ensemble-based preprocessing framework that mitigates visual hallucinations in large language models (LLMs) by selectively modifying the input images before they are processed. The method dynamically selects between three image variants: original, noise-reduced, and edge-enhanced, depending on the type of question, and uses Natural Language Inference (NLI) scores obtained via SelfCheckGPT to evaluate the grounding of each response. This adaptive mechanism enables the system to route each input through the most effective visual transformation, thus minimizing hallucination rates without requiring any additional training or architectural modifications to the underlying language model. By intervening at the input level, our approach provides a lightweight and scalable solution to improve factual consistency in multimodal reasoning tasks. The pipeline is rigorously evaluated using 1000 samples from the HaloQuest dataset, a benchmark comprising visually complex scenarios designed to test multimodal reasoning. Our findings reveal that the ensemble method achieves a 44.3% reduction in hallucination rates, measured by NLI scores. These results highlight the potential of the pipeline to improve multimodal reasoning in LLMs, making them more reliable and robust in practical applications. This study contributes to the body of research on LLM reliability by demonstrating the importance of preprocessing techniques in mitigating hallucinations. 2 Literature Review Visual hallucinations in LLMs represent a critical challenge to their reliability, which has led to a great deal of research to address the issue in recent years Bai et al. (2024) ; Li et al. (2025) . Previous studies have attempted to benchmark visual hallucinations in multimodal large language models (MLLMs). Huang et al. Huang et al. (2024) revealed that advanced models such as GPT-4V OpenAI (2023) , MiniGPT Zhu et al. (2023) , and LLaVA Liu et al. (2023) frequently produce hallucinated content, such as inventing non-existent objects or relationships when processing visual input. For example, GPT-4V, LLaVA-1.5 and MiniGPT-v2 showed general accuracies of 38.3%, 29.9%, and 7.5%, respectively, on the benchmark, indicating significant room for improvement. In another work, Wu et al. introduced ‘AUTOHALLUSION’ Wu et al. (2024) introduced the first automated benchmark generation framework for probing language priors and creating visually misleading inputs via object insertion, removal, or pairing, and as a result, it exposes common biases in Large Vision Language Models (LVLMs). However, AUTOHALLUSION serves as a diagnostic tool, to deliberately trigger and record hallucinations rather than trying to prevent them directly. Visual instruction data for MLLMs often include inaccurate or misleading descriptions that do not align with the actual visual content. HalluciDoctor Yu et al. (2024) automated the detection and elimination of these hallucinations by cross-checking visual descriptions with external models such as ChatGPT to create a cleaner and more accurate dataset. To assess the method, the authors extended the CHAIR benchmark Rohrbach et al. (2018) with object, relation, and attribute hallucination metrics. Their model reduced object hallucinations by 44.6% over standard LLaVA. However, it relies on external tools for rewriting, which increases computational overhead. A common observation is that MLLMs are more likely to produce hallucinations when generating longer texts. To resolve this issue, instruction tuning techniques Liu et al. (2023) have been proposed, which involve limiting the length of instruction data. Another promising approach is contrastive learning, which aligns visual and textual representations to reduce hallucinations in generated responses. Hallucination Augmented Contrastive Learning (HACL) Jiang

Read the complete text