From Generation to Detection: A Multimodal Multi-Task Dataset for Benchmarking Health Misinformation
Zhihao Zhang, Yiran Zhang, Xiyue Zhou, Liting Huang, Imran Razzak, Preslav Nakov, Usman Naseem, Macquarie University, University of Sydney, UTS, MBZUAI · 2025
Read From Generation to Detection: A Multimodal Multi-Task Dataset for Benchmarking Health Misinformation by Zhihao Zhang, Yiran Zhang, Xiyue Zhou, Liting Huang, Imran Razzak, Preslav Nakov, Usman Naseem, Macquarie University, University of Sydney, UTS, MBZUAI (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18685.txt.
Introduction
Zhihao Zhang and co-authors present in this 2025 paper a large data set for testing how well machines spot false health news. Modern AI can now fake both text and images, which speeds the spread of bad health claims. Past data sets leaned on social media posts and often lacked AI-made items or raw files, so the team built a wider base.
Their set, MM Health, holds 34,746 news items with text and pictures. About a sixth are human-made, and the rest come from top generative models. Tests on three tasks, from trust checks to spotting AI work, show today's best models still struggle to tell real from fake and human from machine.
Catalog record
| CREATOR | Zhihao Zhang, Yiran Zhang, Xiyue Zhou, Liting Huang, Imran Razzak, Preslav Nakov, Usman Naseem, Macquarie University, University of Sydney, UTS, MBZUAI |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18685
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Generation to Detection: A Multimodal Multi-Task Dataset for Benchmarking Health Misinformation Zhihao Zhang, Yiran Zhang, Xiyue Zhou, Liting Huang, Imran Razzak, Preslav Nakov, Usman Naseem, Macquarie University, University of Sydney, UTS, MBZUAI Abstract Infodemics and health misinformation have significant negative impact on individuals and society, exacerbating confusion and increasing hesitancy in adopting recommended health measures. Recent advancements in generative AI, capable of producing realistic, human-like text and images, have significantly accelerated the spread and expanded the reach of health misinformation, resulting in an alarming surge in its dissemination. To combat the infodemics, most existing work has focused on developing misinformation datasets from social media and fact-checking platforms, but has faced limitations in topical coverage, inclusion of AI-generation, and accessibility of raw content. To address these gaps, we present MM-Health, a large scale multimodal misinformation dataset in the health domain consisting of 34,746 news article encompassing both textual and visual information. MM-Health includes human-generated multimodal information (5,776 articles) and AI-generated multimodal information (28,880 articles) from various SOTA generative AI models. Additionally, We benchmarked our dataset against three tasks—reliability checks, originality checks, and fine-grained AI detection—demonstrating that existing SOTA models struggle to accurately distinguish the reliability and origin of information. Our dataset aims to support the development of misinformation detection across various health scenarios, facilitating the detection of human and machine-generated content at multimodal levels 1 1 1 Our code and data is available at: https://github.com/grantzyr/MM-Health-Dataset . 1 Introduction Health misinformation refers to information that is inaccurate, misleading, or false according to the best available health evidence at the time. Such misinformation tends to spread at unprecedented speed and scale on the World Wide Web and social media Office of the Surgeon General (OSG) (2021) , and has been shown to have significant negative effects on society Borges do Nascimento et al. (2022) ; Abbott et al. (2021) ; Wang et al. (2019) ; Muhammed T and Mathew (2022) ; Nathan Walter and Suresh (2021) . During crises, such as outbreaks of infectious diseases like COVID-19, the overproduction of health misinformation in both digital and physical environments is defined as an infodemic. As society transitions into a long COVID era Davis et al. (2023) , the infodemic continues to evolve, leading to a reduction in public trust in health professionals Nathan Walter and Suresh (2021) . Furthermore, unfiltered exposure to health misinformation can delay or prevent effective disease treatment and even threaten the lives of individuals Wang et al. (2019) . Additionally, the recent advent of generative image models, such as Stable Diffusion Rombach et al. (2022) , MidjourneyV5 Holz et al. () , DALL-E2 Ramesh et al. (2022) , as well as human-level text generators like ChatGPT Ouyang et al. (2022) and LLaMa Touvron et al. (2023) , has amplified both the quantity and spread of misinformation Zhou et al. (2023a) . The ease with which generative AI models can replicate or manipulate multimodal content, including text and images Huang et al. (2024) , further contributes to the emergence of health misinformation Park (2024) ; Ahmad et al. (2025) ; Shah et al. (2024) . This presents a significant new challenge in combating the infodemic. Name Year Human Context Machine Context Multiple AI Models Reliability Originality General Avaliable Text Image Text Image MedHelp 2013 ✔ ✘ ✘ ✘ ✘ ✔ ✘ ✘ COAID 2020 ✔ ✘ ✘ ✘ ✘ ✔ ✘ ✘ ANTi-Vax 2021 ✔ ✘ ✘ ✘ ✘ ✔ ✘ ✘ MM-COVID 2020 ✔ ✔ ✘ ✘ ✘ ✔ ✘ Partly ReCOVery 2020 ✔ ✔ ✘ ✘ ✘ ✔ ✘ Partly Monant 2022 ✔ ✔ ✘ ✘ ✘ ✘ ✘ Partly MMCOVAR 2021 ✔ ✔ ✘ ✘ ✘ ✔ ✘ Partly Med-MMHL 2023 ✔ ✔ ✔ ✘ ✘ ✔ ✔ Partly Ours 2025 ✔ ✔ ✔ ✔ ✔ ✔ ✔ ✔ Table 1: Comparison between our MM-Health dataset and other health related misinformation datasets. Recent studies have focused on developing and analyzing datasets and detection methods to combat the infodemic. Common methods for collecting multimodal health misinformation include scraping social media platforms Kinsora et al. (2017) ; Hayawi et al. (2022) ; Cui and Lee (2020) ; Zhou et al. (2020) ; Srba et al. (2022) ; Sun et al. (2023) ; Li et al. (2020) ; Chen et al. (2021b) , such as Twitter (now known as X), and parsing fact-checking websites Li et al. (2020) ; Chen et al. (2021b) ; Srba et al. (2022) ; Sun et al. (2023) , such as Snopes and Poynter. However, these datasets exhibit the following notable limitations: • Exclusion of AI-generated misinformation: The majority of existing datasets focus solely on human-generated misinformation, ignoring the growing trend of AI-generated misinformation Zhou et al. (2023b) ; Bashardoust et al. (2024) ; Xu et al. (2023) . With AI models now capable of generating and manipulating both text and image content Liz-López et al. (2024) , it is crucial to include AI-generated misinformation to ensure data diversity. • Lack of accessible raw content: Many datasets only provide URLs or Twitter IDs as delivery artifacts instead of the raw content of the misinformation. Due to ongoing censorship by news and social media platforms, much of this data is no longer accessible, severely limiting the usability of these datasets. The limitation of the previous health misinformation datasets are summarised in Table 1 . Most of the existing methods for automatically detecting health misinformation include content-based CNNs Cui and Lee (2020) ; Zhou et al. (2020) ; Dai et al. (2020) , attention-based hierarchical encoders Kinkead et al. (2020) , and graph-based attention methods Cui et al. (2020) . These methods have demonstrated competitive performance after being trained on health misinformation benchmarks. However, they require extensive training on benchmark datasets to achieve expected performance, which limits the models’ ability to generalise to new health misinformation. Since health misinformation is constantly evolving Okoro et al. (2024) , it is important to evaluate generalised models under zero-shot settings. Additionally, these models only accept structured input and provide labelled output without human-readable explanations. This constraint limits the usability of existing detection methods for the general public outside of the research community. To address the aforementioned limitations, we develop MM-Health, a comprehensive multimodal dataset designed for detecting both human and AI generated health misinformation. Additionally, we conduct extensive experiments using state-of-the-art (SOTA) Vision-Language Models (VLLMs) to evaluate their performance in assessing both the reliability and originality of the health information in MM-Health, as well as performing a fine-grained AI detection analysis. Our key contributions are as follows: • We create and release a new large-scale multimodal (text and images) dataset called MM-Health, which contains 34,746 news articles. These articles were collected from existing multimodal health datasets and generated using state-of-the-art (SOTA) AI generative models. • We conduct a preliminary analysis of the data for both human and AI-generated content, establishing our dataset as a benchmark for baseline evaluation against several SOTA Vision Large Language Models (VLLMs) across three tasks: reliability checks, originality checks, and fine-grained AI detection. • Our experimental results and analysis show that current VLLMs, including GPT-4o 2 2 2 https://openai.com/index/hello-gpt-4o/ , struggle to accurately verify content reliability and originality. This highlights the importance of developing generalised models