ThumbnailTruth: A Multi-Modal LLM Approach for Detecting Misleading YouTube Thumbnails Across Diverse Cultural Settings
Wajiha Naveed, Zartash Afzal Uzmi, Zafar Ayyub Qazi · 2025
Read ThumbnailTruth: A Multi-Modal LLM Approach for Detecting Misleading YouTube Thumbnails Across Diverse Cultural Settings by Wajiha Naveed, Zartash Afzal Uzmi, Zafar Ayyub Qazi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-04714.txt.
Introduction
A thumbnail that promises what a video never delivers damages trust on YouTube. Wajiha Naveed, lead author with two co-authors, build a detector for such misleading thumbnails in a 2025 paper. Their dataset spans thousands of videos from eight countries, including many misleading examples with billions of combined views.
Their pipeline combines video-to-text descriptions, thumbnail images, and subtitle transcripts for a full view of each video. They test several leading large language models with extensive prompt design. One model reaches strong accuracy, precision, and recall in their scenarios. The authors discuss moderation, user experience, and ethics of deployment at scale.
Catalog record
| CREATOR | Wajiha Naveed, Zartash Afzal Uzmi, Zafar Ayyub Qazi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-04714
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ThumbnailTruth: A Multi-Modal LLM Approach for Detecting Misleading YouTube Thumbnails Across Diverse Cultural Settings Wajiha Naveed, Zartash Afzal Uzmi, Zafar Ayyub Qazi Abstract Misleading video thumbnails on platforms like YouTube are a pervasive problem, undermining user trust and platform integrity. This paper proposes a novel multi-modal detection pipeline that uses Large Language Models (LLMs) to flag misleading thumbnails. We first construct a comprehensive dataset of 2,843 videos from eight countries, including 1,359 misleading thumbnail videos that collectively amassed over 7.6 billion views—providing a unique cross-cultural perspective on this global issue. Our detection pipeline integrates video-to-text descriptions, thumbnail images, and subtitle transcripts to holistically analyze content and flag misleading thumbnails. Through extensive experimentation and prompt engineering, we evaluate the performance of state-of-the-art LLMs, including GPT-4o, GPT-4o Mini, Claude 3.5 Sonnet, and Gemini-1.5 Flash. Our findings show the effectiveness of LLMs in identifying misleading thumbnails, with Claude 3.5 Sonnet consistently showing strong performance, achieving an accuracy of 93.8%, precision over 92%, and recall exceeding 94% in certain scenarios. We discuss the implications of our findings for content moderation, user experience, and the ethical considerations of deploying such systems at scale. Our findings pave the way for more transparent, trustworthy video platforms and stronger content integrity for audiences worldwide. I INTRODUCTION In today’s digital landscape, user-generated video content has become a dominant form of communication and entertainment. Platforms like YouTube, with over 2 billion logged-in monthly users, serve as global hubs for information sharing and creative expression. However, this vast ecosystem faces a persistent challenge: the proliferation of misleading thumbnail images. These deceptive previews, designed to entice clicks rather than accurately represent content, not only undermine user trust but also contribute to the spread of misinformation and clickbait culture. The detection of misleading thumbnail videos is a critical problem with far-reaching implications for online platforms and their users. According to a recent study [ 1 ] , misleading thumbnails can lead to a 14% increase in click-through rates compared to accurate thumbnails, incentivizing content creators to employ deceptive practices. Furthermore, a survey conducted by the Pew Research Center found that 64% of adults have encountered misleading content online, with video thumbnails being a significant contributor to this issue [ 2 ] . The prevalence of such content not only erodes user trust but also impacts the spread of misinformation and users perception of reality. Detecting misleading thumbnails presents a multifaceted challenge for content platforms. The sheer volume of content uploaded daily—with over 500 hours of video uploaded to YouTube every minute—makes manual review impractical [ 3 ] . Moreover, the subjective nature of what constitutes a misleading thumbnail, coupled with cultural and contextual nuances, further complicates automated detection efforts. Traditional image recognition techniques often fall short in capturing the nuanced relationship between a thumbnail and its corresponding video content. As a result, platforms struggle to effectively identify and moderate misleading thumbnails at scale, relying heavily on user reports and limited automated systems that may not capture the full spectrum of deceptive practices. Large Language Models (LLMs) emerge as a promising solution to this complex problem. Their ability to understand and process multimodal inputs—combining text, images, and contextual information—makes them well-suited for the task of misleading thumbnail detection. LLMs can analyze the semantic relationship between a thumbnail, video title, and actual content, potentially identifying discrepancies that traditional methods might miss. Furthermore, their capacity for few-shot learning and adaptability to diverse contexts could address the challenge of detecting misleading thumbnails across different cultures and content types. As LLMs continue to advance in their multimodal capabilities, they offer a scalable and potentially more accurate approach to tackling the pervasive issue of misleading thumbnails in online video platforms. This paper addresses this critical problem by developing and evaluating a novel approach to detect misleading thumbnails using state-of-the-art LLMs. Our study makes several key contributions: • Comprehensive Dataset: We have compiled a diverse and substantial dataset comprising 2,843 videos from YouTube across eight countries, evenly split between misleading and non-misleading thumbnails videos. Specifically, our dataset includes 1,359 misleading thumbnail videos, which collectively garnered over 7.6 billion views. Notably, each of the top 10 misleading thumbnail videos in our dataset had amassed over 100 million views individually. This extensive reach underscores the widespread impact of misleading thumbnails and the urgent need for effective detection methods. Our dataset provides a robust foundation for training and evaluating our detection models across various cultural contexts and content types. We have made the dataset, annotation codebook, scripts and a subset of misleading thumbnails publicly available via our GitHub repository for further replication and understanding: https://github.com/wajihanaveed/ThumbnailTruth.git . • Multi-Modal Analysis: Our approach integrates video-to-text descriptions, thumbnail images, and subtitle information, offering a holistic analysis of content discrepancies. This multi-modal strategy enables a more nuanced and accurate assessment of whether a thumbnail is deceptive. • Multiple LLMs Evaluation: We conduct a thorough evaluation of four state-of-the-art LLMs: GPT-4o, GPT-4o Mini, Claude 3.5 Sonnet, and Gemini-1.5 Flash. This comparative analysis provides insights into the relative strengths and capabilities of these models in tackling the complex task of misleading thumbnail detection. • Improvements from Prompt Engineering : Our study explores the efficacy of various prompt engineering techniques, including chain-of-thought reasoning, fixed few-shot examples, and RAG-based dynamic few-shot examples. Through careful ablation studies, we quantify the performance benefits of each prompting strategy. • Comparison with Task-Specific Solutions: Our best performing LLM-based configuration—Claude 3.5 Sonnet with dynamic few-shot prompts—was benchmarked against Checker [ 4 ] , the leading supervised multimodal pipeline for detecting misleading thumbnails. Claude matched or outperformed Checker on every metric, showing that prompt-based LLMs can reach state-of-the-art accuracy without task-specific model training, offering a more flexible, easily deployable alternative for content-moderation workloads We comprehensively evaluated each model’s performance using four complementary metrics: accuracy, precision, recall, and specificity, providing a balanced view of their respective strengths. Our results confirm the promise of LLM-based detection. Among the models tested, Claude 3.5 Sonnet demonstrated superior performance across all metrics and prompt settings. Specifically, our observations include: • Robust accuracy: With dynamic few-shot prompts, Claude 3.5 Sonnet reaches 93.8\% accuracy. For content moderators, this means most thumbnails are triaged correctly, sharply reducing manual review volume. • High precision: Claude 3.5 Sonnet maintains precision above 92\% across all prompt styles, so the vast majority of flagged thumbnails are truly deceptive. This keeps false alarms low and sustains reviewer trust. • High recall: GPT-4o Mini and Claude 3.5 Sonnet exceed 94\% in several settings, capturing most misleading thumbnails and preventing harmful content from slipping through automated checks. • Strong specificity: Claude 3.5 Sonnet consistently delivers specificity above 93\% , rarely mislabeling legitimate thumbnails. This protects honest creators from unwarranted takedowns and lets moderators focus on genuine violations. • Cultural variation: Accuracy varies by country, underscoring the need for culturally adaptive prompts (e.g., dynamic examples in local languages). Our results indicate that LLMs hold promise for detecting misleading thumbnails, potentially strengthening platform integrity and user trust. Effective deployment will hinge on tuning false-positive thresholds, providing transparent appeals, and continually adapting to evolving manipulations—challenges we discuss in § VIII . The remainder of the paper covers our methodology, results with ablations and model benchmarks, and the implications for real-world deployment, content moderation, and user