Can dialogues with AI systems help humans better discern visual misinformation?
Anku Rani, Valdemar Danry, Andy Lippman, Pattie Maes · 2025
Read Can dialogues with AI systems help humans better discern visual misinformation? by Anku Rani, Valdemar Danry, Andy Lippman, Pattie Maes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06517.txt.
Introduction
Anku Rani, Valdemar Danry, Andy Lippman, and Pattie Maes asked in 2025 whether talks with an AI can help people spot fake news images. False or altered images spread fast online and can mislead many readers. The team set up talks where an AI and a person looked at news headline and image pairs side by side. They logged 1,310 such talks with eighty people.
With the AI's help, scores in telling real from fake rose from about sixty percent to about ninety percent. The gain did not last. On new pairs without the AI, scores fell back near sixty percent. The authors say talks can change a view on the spot, but they do not yet build a skill that carries over.
Catalog record
| CREATOR | Anku Rani, Valdemar Danry, Andy Lippman, Pattie Maes |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 9 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-06517
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Can dialogues with AI systems help humans better discern visual misinformation? Anku Rani, Valdemar Danry, Andy Lippman, Pattie Maes Abstract Keywords: Visual Misinformation, Human-AI Interaction, AI Dialogue System, Persuasive Dialogue, Media Literacy 1 Abstract The widespread emergence of manipulated news media content poses significant challenges to online information integrity. This study investigates whether dialogues with AI about AI-generated images and associated news statements can increase human discernment abilities and foster short-term learning in detecting misinformation. We conducted a study with 80 participants who engaged in structured dialogues with an AI system about news headline-image pairs, generating 1,310 human-AI dialogue exchanges. Results show that AI interaction significantly boosts participants’ accuracy in identifying real versus fake news content from approximately 60% to 90% (p < 0.001). However, these improvements do not persist when participants are presented with new, unseen image-statement pairs without AI assistance, with accuracy returning to baseline levels ( 60%, p=0.88). These findings suggest that while AI systems can effectively change immediate beliefs about specific content through persuasive dialogue, they may not produce lasting improvements that transfer to novel examples, highlighting the need for developing more effective interventions that promote durable learning outcomes. 2 Related Work The proliferation of altered news media content presents major threats to the reliability of online information ecosystems ( Farouk and Fahmi, 2024 ; Zhang and Ghorbani, 2020 ) . As digital editing tools become more sophisticated and accessible, along with AI-generated content, the creation and dissemination of manipulated images alongside misleading statements have increased exponentially across social media platforms ( Giansiracusa, 2021 ) . The combination of visual and textual misinformation is particularly persuasive, as research has shown that humans tend to place heightened trust in visual evidence while often lacking the skills to detect subtle manipulations or critically evaluate accompanying headlines ( Jagadish and Jasmine, 2024 ; Pennycook and Rand, 2019 ; Vosoughi et al., 2018 ) . Recent advances in AI have demonstrated promising capabilities in detecting manipulated media content ( Akram, 2023 ; Wang et al., 2023 ; Sadasivan et al., 2023 ) . However, the role of AI systems extends beyond mere detection. They have the potential to serve as interactive tools that can improve human critical thinking and evaluation skills ( Walter, 2024 ; Pedro et al., 2019 ; Costello et al., 2024 ) . Although existing research has extensively explored automated detection systems ( Huang et al., 2024 ; Wang et al., 2023 ; Yang et al., 2024 ) , only recently has attention been paid to how AI can be used as a dialogue partner to improve the human ability to discern truth in the news media. In an experiment with 2,190 conspiracy believers, researchers found that dialogues with an AI chatbot could durably reduce beliefs in conspiracy theories ( Costello et al., 2024 ) . However, it is unclear how these findings generalize to other modalities, such as images with statements, which currently are estimated to make up about 84% of posts on social media ( Yang et al., 2023 ) . In this research, we study whether the diminished beliefs in false information were caused by the persuasiveness of the AI chatbot or its ability to teach users to better discern misinformation in the future. 3 Study Design To evaluate this research question, we conducted a study with 80 participants interacting with an AI system developed using a prompt similar to previous work on AI dialogues and conspiracy theories ( Costello et al., 2024 ) , and adapted to fake image detection ( Jia et al., 2024 ) . We report the accuracy, request rejection rate, and accuracy of non-rejected requests for three prompts using GPT-4o in Table 1 under four conditions: (i) Google search on headline and images passed to GPT-4o for artifact detection, (ii) Google search on headline and no images were passed to GPT-4o, (iii) No Google search on headline and images were passed to GPT-4o, and (iv) No Google search on headline and no images were passed to GPT-4o. Overall accuracy is defined as the model’s ability to correctly differentiate between real and fake news headlines and their associated images across the four conditions. Rejection rate is defined as the frequency at which the model declines to provide an answer for a given prompt and non-rejected accuracy is defined as the model’s accuracy in the cases where it responded. Figure 1: Examples of real and fabricated news stories alongside performance metrics. We compiled a dataset consisting of eight news headline-image pairs that challenged conventional credibility assessment. The dataset included two categories of news content: (1) authentic stories with seemingly implausible elements, and (2) fabricated content crafted to appear credible. This careful selection of materials was designed to test participants’ ability to evaluate news content beyond surface-level plausibility judgments. During the intervention phase, participants were presented with four random statement-image pairs from this dataset. One illustrative example features Donald Trump at McDonald’s, which is a real image that many participants initially perceived as fabricated. In the experiment, prior to each AI dialogue on image and statement pairs, participants rated their initial belief in the statement and image pair. Next, each participant engaged in three rounds of structured dialogue with the AI system for each headline-image pair as shown in Figure 3 , culminating in a final authenticity assessment where they rated their belief in the news authenticity. The study generated 1,310 human-AI dialogue exchanges across all participants. Prompt Metric Condition 1 google search on headline + image on GPT-4o Condition 2 google search + no image Condition 3 no google search + image Condition 4 no google search + no image Prompt 1: News forensic expert (Artifact detection only) Overall Accuracy 71.43% 78.57% 35.71% 0.00% Rejection Rate 21.43% 21.43% 50.00% 92.86% Accuracy (Non Rejected) 90.91% 100.00% 71.43% 0.00% Prompt 2: Persuasion (Belief change only) Overall Accuracy 71.40% 78.57% 28.57% 0.00% Rejection Rate 14.20% 14.20% 78.57% 92.00% Accuracy (Non Rejected) 83.30% 91.60% 66.66% 0.00% Prompt 3: Combined (News Forensic Expert + Persuasion) Overall Accuracy 100% 78.5% 42.8% 0% Rejection Rate 0% 14.20% 21.42% 71.4% Accuracy (Non Rejected) 100% 91.60% 54.45% 0% Table 1: Comparison of Different Prompt Conditions and Their Impact on Accuracy and Rejection Rates. These prompts are described in Figure 2 . 4 Results To assess learning during the AI system interaction, we also measured participants’ final accuracy performance on four unseen image and statement pairs without AI assistance after their interactions with the chatbot. The accuracy results are reported in Figure 1 . To analyze differences in accuracy measures, we conducted a one-way analysis of variance (ANOVA) which revealed significant differences among initial accuracy, final accuracy, and learning accuracy ( F=39.28 , p<0.001 ). Subsequent pairwise post-hoc t-tests showed that final accuracy was significantly higher than initial accuracy ( t=-7.16 , p<0.001 ), indicating participants improved their performance over time. Learning accuracy was not significantly different from initial accuracy ( t=-0.15 , p=0.88 ), but was significantly lower than final accuracy ( t=10.53 , p<0.001 ). These results suggest that while participants achieved better final performance on pairs in which they had engaged in dialogues compared to their initial accuracy on the same pairs, their learning accuracy was not significantly