Sens-VisualNews: A Benchmark Dataset for Sensational Image Detection

Andreas Goulas, Damianos Galanopoulos, Evlampios Apostolidis, Vasileios Mezaris · 2026

Read Sens-VisualNews: A Benchmark Dataset for Sensational Image Detection by Andreas Goulas, Damianos Galanopoulos, Evlampios Apostolidis, Vasileios Mezaris (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10394.txt.

Introduction

Andreas Goulas and three colleagues introduce a new task for fighting disinformation: sensational image detection. Sensational content grabs attention and triggers strong emotion, often bypassing critical judgment and speeding viral sharing. Existing detection work focuses on text, while image-based sensationalism has lacked a dedicated benchmark. Their 2026 paper fills that gap.

The authors built Sens-VisualNews, a benchmark of 9,576 images from news items, annotated for the presence of sensational concepts and events in visual content. Using it, they studied prompt sensitivity, performance, and robustness across a wide range of open state-of-the-art multimodal language models, in both zero-shot and fine-tuned settings. The dataset gives fact-checkers a filtering tool for spotting check-worthy items and flagging potential disinformation.

Catalog record

CREATORAndreas Goulas, Damianos Galanopoulos, Evlampios Apostolidis, Vasileios Mezaris
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.10394

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sens-VisualNews: A Benchmark Dataset for Sensational Image Detection Andreas Goulas, Damianos Galanopoulos, Evlampios Apostolidis, Vasileios Mezaris Abstract The detection of sensational content in media items can be a critical filtering mechanism for identifying check-worthy content and flagging potential disinformation, since such content triggers physiological arousal that often bypasses critical evaluation and accelerates viral sharing. In this paper we introduce the task of sensational image detection, which aims to determine whether an image contains shocking, provocative, or emotionally charged features to grab attention and trigger strong emotional responses. To support research on this task, we create a new benchmark dataset (called Sens-VisualNews) that contains 9,576 images from news items, annotated based on the (in-)existence of various sensational concepts and events in their visual content. Finally, using Sens-VisualNews, we study the prompt sensitivity, performance and robustness of a wide range of open SotA Multimodal LLMs, across both zero-shot and fine-tuned settings. † † address: ⋆ Information Technologies Institute (ITI), CERTH, Thessaloniki, Greece † Queen Mary University of London, London, UK {agoulas, dgalanop, apostolid, bmezaris}@iti.gr 1 Introduction Several recent works point out the tendency of disinformation to adopt a sensationalist story format [ 1 , 2 , 3 ] . So, the detection of sensational content seems to be essential for spotting news items that require fact-checking. For this, several approaches have been described to identify media that uses provocative, exaggerated, or emotionally charged language to grab attention, e.g., [ 2 , 4 , 5 ] . Nevertheless, disinformation can also include the use of sensational images that aim to grab immediate attention, provoke intense emotional reactions, or manipulate user perception through dramatic or shocking imagery. Such visual content serves as a potent catalyst for spreading disinformation, since its ability to trigger physiological arousal often bypasses critical evaluation and accelerates content sharing. Hence, there is a need for technologies for sensational image detection, that could be used as a filtering mechanism and assist fact-checkers to identify check-worthy content and flag potential disinformation. As stated above, existing methods for sensational content detection analyze textual content aiming to identify emotionally charged language or phrases designed to evoke fear, anger or extreme curiosity [ 2 , 4 , 5 ] . Two different classes of methods that focus on the impact of visual content on humans, are the ones dealing with NSFW (Not Safe For Work) content detection, and visual sentiment analysis. The methods of the first class aim to spot visual material that is inappropriate for public, professional or general viewing (e.g., visually disturbing content) or violates safety guidelines [ 6 , 7 , 8 ] . The methods of the second class aim to identify the emotional tone or attitude expressed in the visual content [ 9 , 10 , 11 ] . Hence, such methods can support the detection of sensational images for flagging disinformation, only to a limited extent. To fill this gap, in this paper, we introduce the task of sensational image detection, which aims to determine whether an image contains shocking, provocative, or emotionally charged features to grab attention and trigger strong emotional responses (e.g., shock, fear, anger, disgust, anxiety). Following, we employ the VisualNews [ 12 ] large-scale dataset for news image captioning, and annotate a subset of images (9,576 in total) according to the (in-)existence of various sensational visual concepts and events that appear in disinformation items, formulating a new benchmark dataset (called Sens-VisualNews) for sensational image detection. Using the created dataset, we investigate the performance of several SotA Multimodal Large Language Models (MLLMs) on the proposed task. Our contributions are as follows: • We introduce the task of sensational image detection that deals with the identification of images that aim to trigger strong emotional responses. • We create the Sens-VisualNews 1 1 1 Our dataset annotations and code are available at https://github.com/IDT-ITI/Sens-VisualNews benchmark dataset with 9,576 annotated images based on the (in-)existence of various sensational visual concepts and events. • Using Sens-VisualNews, we study the performance of families of open SotA Multimodal LLMs on this task, across both zero-shot and fine-tuned settings. 2 Related Work The research domain on sensational content detection , deals with the development of methods for identifying news, social media posts, or digital content designed to provoke intense emotions (e.g., fear, anger, shock), often to maximize clicks or engagement. So, it focuses on the analysis of textual content , using NLP and machine or deep learning methodologies. For example, Hamby et al., [ 2 ] investigated the role of different narrative characteristics in identifying sensational stories and predicting the spread of disinformation. Wang et al., [ 4 ] described a clickbait detection method that uses prompt-tuning for leveraging the few-shot labeled titles during the training of the detector. Finally, Alarfaj et al., [ 5 ] presented a transformer-based network architecture for automated detection of clickbait news headlines, and compared its performance against SotA machine- and deep-learning approaches from the literature, using a benchmarking dataset. With regards to the emotional impact of visual content on humans, this is assessed by methods from two different research domains. The methods for NSFW content detection aim to identify visual content that is inappropriate for public, professional or general viewing (e.g., visually disturbing content) or violates safety guidelines . For example, Zhang et al., [ 6 ] presented an approach that leverages scene graph generation and classification to detect harmful attributes and relationships within images. Chandra et al., [ 7 ] investigated the performance of CNN and VGG-16 network architectures in identifying pornographic content. Finally, Tzelepi et al., [ 8 ] represented the generic semantic descriptions and elicited emotions encoded in LMMs using CLIP-based representations, and combined the obtained representations with CLIP-based image embeddings for performing visually-disturbing image detection. From a different standpoint, the methods for visual sentiment analysis try to identify the emotional tone or attitude expressed in the visual content . For example, Jiang et al., [ 9 ] described a network architecture for visual sentiment analysis, comprising a fine-tuned VGG16 model using SVM with augmented training data from two Twitter image datasets. Wang et al., [ 10 ] presented a method for multimodal sentiment analysis, that takes into account the internal correlation between sentiment-related representations from textual and visual data. On the same direction, Mu et al., [ 11 ] fine-tuned the BLIP-2 Vision-Language Model (VLM) with LoRA, to align and adapt the learned representations for the needs of multimodal sentiment prediction. Our literature review demonstrates the limited capacity of existing methods from the domains of sensational content detection, NSFW content detection and visual sentiment analysis, to support the detection of sensational images for flagging disinformation. This observation motivated us to introduce the task of sensational image detection and propose a new benchmark for performance comparison. 3 Proposed benchmark 3.1 Problem statement The task of sensational image detection aims to identify the existence of shocking, provocative or emotionally charged visual features, intended to grab the viewers’ attention and trigger strong emotional responses (e.g., shock, fear, anger, disgust and anxiety). It differs from the task of sensational content detection, which focuses on the detection of provocative, exaggerated or emotionally charged language. Moreover, it has a different and broader scope compared to the task of NSFW visual

Read the complete text