Toward Robust Hyper-Detailed Image Captioning: A Multiagent Approach and Dual Evaluation Metrics for Factuality and Coverage
Saehyung Lee, Seunghyun Yoon, Trung Bui, Jing Shi, Sungroh Yoon · 2024
Read Toward Robust Hyper-Detailed Image Captioning: A Multiagent Approach and Dual Evaluation Metrics for Factuality and Coverage by Saehyung Lee, Seunghyun Yoon, Trung Bui, Jing Shi, Sungroh Yoon (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-15484.txt.
Introduction
Five authors tackle errors in very detailed image captions in this 2024 paper. Multimodal models write rich, long descriptions of pictures, but they also hallucinate, and current detectors fail on such long texts. As captions grow, the models lean on their own earlier words more than on the image.
Their fix is a multiagent setup where language and vision models cooperate to correct a given caption. They also build an evaluation framework and benchmark that score factuality and coverage separately, matching human judgment better than older metrics. The method markedly improved factual accuracy, even for captions written by a leading commercial model.
Catalog record
| CREATOR | Saehyung Lee, Seunghyun Yoon, Trung Bui, Jing Shi, Sungroh Yoon |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-15484
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Toward Robust Hyper-Detailed Image Captioning: A Multiagent Approach and Dual Evaluation Metrics for Factuality and Coverage Saehyung Lee, Seunghyun Yoon, Trung Bui, Jing Shi, Sungroh Yoon Abstract Multimodal large language models (MLLMs) excel at generating highly detailed captions but often produce hallucinations. Our analysis reveals that existing hallucination detection methods struggle with detailed captions. We attribute this to the increasing reliance of MLLMs on their generated text, rather than the input image, as the sequence length grows. To address this issue, we propose a multiagent approach that leverages LLM-MLLM collaboration to correct given captions. Additionally, we introduce an evaluation framework and a benchmark dataset to facilitate the systematic analysis of detailed captions. Our experiments demonstrate that our proposed evaluation method better aligns with human judgments of factuality than existing metrics and that existing approaches to improve the MLLM factuality may fall short in hyper-detailed image captioning tasks. In contrast, our proposed method significantly enhances the factual accuracy of captions, even improving those generated by GPT-4V. Finally, we highlight a limitation of VQA-centric benchmarking by demonstrating that an MLLM’s performance on VQA benchmarks may not correlate with its ability to generate detailed image captions. Our code and data are available at https://github.com/adobe-research/CapMAS . † † affiliationnotice: \intern 1 Introduction Numerous image captioning methods utilizing deep neural networks (DNNs) have been proposed ( Vinyals et al., 2015 ; Xu et al., 2015 ) . However, they are generally limited to generating short captions, which constrains their broader application in real-world scenarios. For instance, in cases such as assistance for visually impaired individuals, where it is necessary to provide highly detailed descriptions of the scene in front of the user, these methods may not be suitable. Following the recent success of large language models (LLMs) ( Brown et al., 2020 ) , there have been attempts to use text and information from other modalities as input to LLMs. Notably, many studies have explored multimodal large language models (MLLMs) that incorporate visual information ( Li et al., 2023a ; Dai et al., 2023 ; Liu et al., 2024b ) . These models have demonstrated significantly superior performance compared to traditional models in tasks such as visual question answering (VQA) and captioning ( Liu et al., 2024a ) . In particular, MLLMs, leveraging the advanced language capabilities of LLMs, are able to generate much longer and more detailed captions than conventional captioning models. However, these generated captions frequently contain inaccurate information, including descriptions of objects that are not present in the input image ( Leng et al., 2024 ) . Such hallucination problems hinder the practical application of MLLMs in real-world settings. Three major approaches have been recently proposed to improve the factuality of MLLMs: (i) Decoding-based methods ( Leng et al., 2024 ) reduce the probabilities of hallucination-related tokens during the model’s decoding process without requiring additional training; (ii) Training-based methods ( Liu et al., 2023a ) further train the models on curated multimodal datasets to ensure they generate only accurate responses; (iii) Corrector-based methods ( Zhou et al., 2024 ) employ a corrector model that detects and either removes or revises hallucinations present in the model’s responses. In this paper, we propose Caption factuality enhancing MultiAgent System (CapMAS), a multiagent approach to correct hyper-detailed image captions. Unlike existing corrector-based approaches that require training a corrector ( Lee et al., 2024 ) , CapMAS improves the factuality of detailed image captions by leveraging the collaboration between an LLM and MLLM, without the need for additional training. Moreover, unlike methods that target specific types of hallucinations ( Li et al., 2023b ; Zhou et al., 2024 ) , our approach does not pre-define the hallucination types, allowing it to address a broader range of issues. The method proceeds as follows: (i) an LLM decomposes a given detailed caption into atomic propositions; (ii) an MLLM verifies the truthfulness of each atomic proposition based on the image; and (iii) the LLM revises the caption accordingly. Our design is particularly motivated by the observation that, as the length of a model’s response increases, hallucinations generated later in the sequence become more difficult for existing methods ( Wang et al., 2023 ; Zhou et al., 2024 ) to detect. Evaluating the factuality of detailed captions is not straightforward. Through experiments, we demonstrate that conventional caption evaluation metrics such as BLEU ( Papineni et al., 2002 ) , ROUGE ( Lin, 2004 ) , METEOR ( Banerjee & Lavie, 2005 ) , and CIDEr ( Vedantam et al., 2015 ) , as well as recently proposed methods ( Hessel et al., 2021 ; Petryk et al., 2024 ) , fail to accurately assess the factuality of detailed captions. To address this issue, we propose a GPT-based method for factuality evaluation and validate its effectiveness through experiments that include human evaluations . Even if a caption contains factual information, however, it may still be considered inadequate if it does not sufficiently capture the visual information. To measure the coverage of captions, we construct a detailed VQA dataset through a collaboration between humans and an AI agent ( Achiam et al., 2023 ) . If a caption fully encapsulates the information of a given image, questions about the image should be answerable accurately using only the caption, without referencing the image itself. Our experiments surprisingly reveal that methods designed to improve the factuality of MLLMs, which have proven effective in tasks like VQA ( Huang et al., 2024 ) , may be ineffective for hyper-detailed image captioning tasks that require longer responses. In contrast, CapMAS significantly enhances the factuality of captions and can be applied in a plug-and-play manner to any captioning model; notably, this improvement extends to captions generated by the state-of-the-art closed model, GPT-4V ( Achiam et al., 2023 ) . Finally, we highlight an issue with the current VQA-centric benchmarking ( Duan et al., 2024 ) by showing that an MLLM’s performance on VQA benchmarks may not correlate with its ability to generate detailed image captions. 2 Related Work Multimodal large language models. LLMs that process inputs from multiple modalities, including text and other types of data, are referred to as multimodal LLMs ( Yin et al., 2023a ) . Among these, LLMs that handle visual input have been the most actively researched, and the MLLMs discussed in this paper are focused on this category . Research on these models primarily explores methods for fusing the output of an independent vision encoder into the input of an LLM. The BLIP models ( Li et al., 2023a ; Dai et al., 2023 ) align the frozen vision encoder and LLM using a lightweight transformer ( Vaswani, 2017 ) called Q-Former. The trainable input tokens of the Q-Former interact with the output tokens from the vision encoder through cross-attention, transforming them into input tokens for the LLM. The LLaVA models ( Liu et al., 2024b ; Liu et al., 2024a ) use a simple MLP connector to align the vision encoder with the LLM. All output tokens from the vision encoder, passed through the MLP connector, are used as input to the LLM. The vision encoder’s parameters remain fixed during the training of the MLP connector and the LLM. Unlike existing