Towards Automated Community Notes Generation with Large Vision Language Models for Combating Contextual Deception

Jin Ma, Jingwen Yan, Mohammed Aldeen, Ethan Anderson, Taran Kavuru · 2026

Read Towards Automated Community Notes Generation with Large Vision Language Models for Combating Contextual Deception by Jin Ma, Jingwen Yan, Mohammed Aldeen, Ethan Anderson, Taran Kavuru (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22453.txt.

Introduction

Ma and co-authors build XNote, a dataset for automated community notes on misleading image posts. A real image paired with false context can deceive even when the photo itself is genuine. Human-written notes fix such posts, but they arrive slowly and do not scale. XNote gathers posts with their notes, outside context, and labels for topics and deception types. The team benchmarks frontier vision-language models on spotting deception and drafting notes. Results show the note-writing task remains hard for current models.

Catalog record

CREATORJin Ma, Jingwen Yan, Mohammed Aldeen, Ethan Anderson, Taran Kavuru
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77136
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.22453

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Automated Community Notes Generation with Large Vision Language Models for Combating Contextual Deception Jin Ma, Jingwen Yan, Mohammed Aldeen, Ethan Anderson, Taran Kavuru Abstract Community Notes have emerged as an effective crowd-sourced mechanism for combating online deception on social media platforms. However, its reliance on human contributors limits both the timeliness and scalability. In this work, we study the automated Community Notes generation method for image-based contextual deception , where an authentic image is paired with misleading context ( e.g. , time, entity, and event). Unlike prior work that primarily focuses on deception detection ( i.e. , judging whether a post is true or false in a binary manner), Community Notes-style systems need to generate concise and grounded notes that help users recover the missing or corrected context. This problem remains underexplored due to three reasons: (i) datasets that support the research are scarce; (ii) methods must handle the dynamic nature of contextual deception; (iii) evaluation is difficult because standard metrics do not capture whether notes actually improve user understanding. To address these gaps, we curate a real-world dataset, XCheck , comprising X posts with associated Community Notes and external contexts. We further propose the Automated Context-Corrective Note generation method, named ACCNote , which is a retrieval-augmented, multi-agent collaboration framework built on large vision-language models. Finally, we introduce a new evaluation metric, Context Helpfulness Score ( CHS ), that aligns with user study outcomes rather than relying on lexical overlap. Experiments on our XCheck dataset show that the proposed ACCNote improves both deception detection and note generation performance over baselines, and exceeds a commercial tool GPT5-mini. Together, our dataset, method, and metric advance practical automated generation of context-corrective notes toward more responsible online social networks. 1 Introduction In recent years, the rapid spread of online deception 1 1 1 Here the online deception indicates that deceivers use social media platforms to deliver false beliefs to audiences [ 49 ] . on social media platforms has emerged as a significant threat to social trust and public health [ 49 , 37 , 19 , 4 ] . For instance, misinformation surrounding the COVID-19 vaccine has led to hesitancy and undermined public health efforts during the pandemic period [ 7 , 5 ] . To curb the spread of online deception and build responsible online social networks, major social platforms have started to flag suspicious content by overlaying reminder text or adding extra context. On X (formerly Twitter), Community Notes offer a crowd-sourced fact-checking approach [ 53 ] that allows registered contributors to add context-corrective notes to deceptive posts. Meta has also introduced a similar community note feature on Facebook and Instagram [ 31 ] , as announced in March 2025. Figure 1 (a) illustrates the typical Community Notes workflow: registered contributors first draft candidate notes, other contributors then rate them, and a note is published only after receiving sufficient approval. However, this pipeline depends on broad and sustained human participation in both writing and rating, introducing latency and constraining responsiveness at scale. These limitations underscore the need for automated approaches that can generate notes in a timely manner while reducing manual effort. Figure 1 : (a) Workflow by which a Community Note becomes publicly available. (b) Pipeline of the proposed ACCNote for automated context-corrective notes generation. Recent studies have shown that on social media platforms, image-based posts attract higher user engagement and can be more persuasive than text-only deception [ 56 , 13 , 21 , 51 ] . Consequently, we focus on image-based deception, which is commonly launched by attackers through two mechanisms [ 13 ] : (i) content manipulation, where the image itself is fabricated or altered, i.e. , via Photoshop [ 3 ] or deepfake tools [ 52 ] ; and (ii) context manipulation (also known as out-of-context, OOC), where an authentic image is paired with misleading text. These two types of deception require different mitigation strategies. Content manipulation is typically addressed with pixel-level forensics that target AI artifacts or fingerprints [ 32 , 23 ] , while context manipulation is addressed by retrieving external evidence to determine the correct context [ 38 , 57 ] . Our work targets context manipulation ( i.e. , contextual deception) because it naturally aligns with the goals of Community Notes. Specifically, X’s Community Notes guide [ 53 ] emphasizes that helpful notes should satisfy five criteria: (1) credibility: cite high-quality sources; (2) clarity: be easy to understand; (3) relevance: directly address the post’s claim; (4) veracity: provide important context; and (5) neutrality: use neutral or unbiased language. Meeting these criteria depends primarily on grounding claims in credible external evidence and clearly conveying corrective context [ 12 , 46 ] , rather than detecting pixel-level manipulation within the image itself. Despite extensive research on automated online deception detection, i.e. , determining whether the information is true or false [ 1 , 17 ] , little effort has been put into Community Notes generation. This gap stems from three practical challenges. First, dataset limitations: most existing image-based deception datasets are either synthetic and fail to capture real-world complexity [ 29 , 55 , 26 ] , are designed primarily for detection without explanatory notes [ 33 , 35 ] , or provide rationales that are not directly usable in a Community Notes-style format [ 40 , 13 ] . Second, methodological difficulty: contextual deception is inherently dynamic, making it hard for pre-trained models to reliably infer the correct context. Third, evaluation mismatch: the goal of a note is to improve users’ understanding of the true context of a post, but standard text generation metrics that emphasize grammatical or lexical overlap with reference text do not measure user helpfulness and can misrepresent real-world effectiveness. To overcome these three challenges, we take a “dataset \rightarrow method \rightarrow evaluation” research approach accordingly. First, we curate a real-world dataset, XCheck , consisting of X posts (image, text, timestamp, and metadata, etc. ), their corresponding Community Notes, and external contexts collected via reverse web search. Second, we develop an A utomated C ontext- C orrective Note generation method ( ACCNote ), which is a retrieval-augmented multi-agent framework built on large vision-language models (LVLMs). It filters and organizes retrieved evidence, generates multiple candidate notes through diverse reasoning paths, and selects the best note using Community Notes criteria, improving grounding while mitigating noise from naive RAG [ 20 , 43 , 10 ] . Third, we introduce a new evaluation metric Context Helpfulness Score ( CHS ) that measures user-aligned helpfulness, addressing the mismatch between real-world goals and commonly used overlap-based text generation metrics. The contributions of this paper are as follows: • We curate XCheck , a real-world multimodal dataset to facilitate research on automated Community Notes generation. XCheck contains X posts paired with ground-truth Community Notes, retrieved external context from reverse search, and annotations of topics and manipulation factors. • We propose ACCNote , a retrieval-augmented multi-agent framework that can be integrated with diverse foundation LVLMs to generate context-corrective notes, with explicit evidence filtering, stance-aware organization, and grounded citation. • We conduct a pilot user study and develop Context Helpfulness Score ( CHS ), a metric that evaluates generated notes along five Community Notes criteria, including credibility,

Read the complete text