MultiHoax: A Dataset of Multi-hop False-Premise Questions

Mohammadamin Shafiei, Hamidreza Saffari, Nafise Sadat Moosavi · 2025

Read MultiHoax: A Dataset of Multi-hop False-Premise Questions by Mohammadamin Shafiei, Hamidreza Saffari, Nafise Sadat Moosavi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00264.txt.

Introduction

Mohammadamin Shafiei and co-authors built MultiHoax, a 2025 dataset of questions built on false premises. Trick questions expose models that swallow bad assumptions. Most older tests need only one reasoning hop. Real traps hide across several steps, needing cross-checks.

The set spans seven countries and ten knowledge areas. Wikipedia grounds the facts behind each item. Top models still missed many planted falsehoods. Surface cues were not enough to catch them. Better critical checking is the skill this benchmark demands. Training models to question the question itself is the long-term goal here.

Catalog record

CREATORMohammadamin Shafiei, Hamidreza Saffari, Nafise Sadat Moosavi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00264

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MultiHoax: A Dataset of Multi-hop False-Premise Questions Mohammadamin Shafiei, Hamidreza Saffari, Nafise Sadat Moosavi Abstract As Large Language Models are increasingly deployed in high-stakes domains, their ability to detect false assumptions and reason critically is crucial for ensuring reliable outputs. False-premise questions (FPQs) serve as an important evaluation method by exposing cases where flawed assumptions lead to incorrect responses. While existing benchmarks focus on single-hop FPQs, real-world reasoning often requires multi-hop inference, where models must verify consistency across multiple reasoning steps rather than relying on surface-level cues. To address this gap, we introduce MultiHoax, a benchmark for evaluating LLMs’ ability to handle false premises in complex, multi-step reasoning tasks. Our dataset spans seven countries and ten diverse knowledge categories, using Wikipedia as the primary knowledge source to enable factual reasoning across regions. Experiments reveal that state-of-the-art LLMs struggle to detect false premises across different countries, knowledge categories, and multi-hop reasoning types, highlighting the need for improved false premise detection and more robust multi-hop reasoning capabilities in LLMs. 1 1 1 The MultiHoax dataset is publicly available at https://github.com/Mamin78/MHFPQ 1 Introduction Which Iranian wrestler won gold in the Men’s freestyle 125 kg at the first Olympics when Zahra Nemati was the flag bearer ? Komeil Ghasemi Ghasem Rezaei Hassan Yazdani I do not know 1. The first hop: At which Olympics did Zahra Nemati carry the flag for the first time? The answer: Zahra Nemati carried the flag for the first time at the 2016 Rio Olympics . 2. The second hop: Which Iranian wrestler won gold in the Men’s freestyle 125 kg at the 2016 Rio Olympics? Falsehood: No Iranian wrestler won gold in the Men’s freestyle 125 kg at the 2016 Rio Olympics. The only Iranian wrestler to win gold in the Men’s freestyle at the 2016 Rio Olympics was Hassan Yazdani in 74 kg . Figure 1: A sample MHFPQ from the Sports category related to Iran. In recent years, the evolution of large language models (LLMs) has demonstrated their immense potential across a wide range of natural language processing tasks. However, despite their impressive successes in many domains, their ability to recognize and properly handle false premises in reasoning tasks remains a significant challenge Hu et al. 2023 ; Yu et al. 2023 . When engaging with false premises, an LLM should be able to identify and reject flawed assumptions rather than proceed as if they were valid. False premises can appear in various forms, such as misleading statements, logically inconsistent claims, or factually incorrect contextual narratives Leite et al. 2023 ; Zhuang et al. 2023 ; Ghosh et al. 2024 ; Galitsky et al. 2024 ; Chen and Shu 2023 ; Yamin et al. 2024 ; Zhang et al. 2024b ; Csönge 2015 . A common approach to evaluating an LLM’s ability to handle false premises is through question-answering (QA) tasks, where a question implicitly contains a misleading or incorrect assumption Yu et al. 2023 ; Hu et al. 2023 ; Kim et al. 2023 . For example, a well-performing LLM should recognize that “Which year did Albert Einstein win the Nobel Prize in Chemistry?” contains a false premise—Einstein never won a Nobel Prize in Chemistry—and responds appropriately, rather than attempting to provide an incorrect or misleading answer. Existing benchmarks focus on single-hop false premise detection, where the incorrect assumption can be identified within a single reasoning step Yu et al. 2023 ; Hu et al. 2023 ; Kim et al. 2023 . However, multi-hop reasoning presents a greater challenge, as it requires models to connect multiple pieces of information across multiple inference steps before arriving at an answer Mavi et al. 2022 . Unlike single-hop questions, multi-hop questions (MHQs) require models to derive intermediate conclusions, making them a critical area of research in the evaluation and improvement of LLM reasoning abilities Mavi et al. 2022 ; Chen et al. 2024 ; Yang et al. 2024b ; Tang and Yang 2024 ; Chakraborty 2024 . The complexity of MHQs arises from the necessity of bridging multiple facts, understanding implicit dependencies between reasoning steps, and maintaining logical consistency throughout the inference process Mavi et al. 2022 . While MHQs are already challenging, the problem becomes even more difficult when false premises are embedded within the reasoning chain, requiring models not only to answer questions correctly but also to detect and reject incorrect assumptions at intermediate steps. To evaluate LLMs’ ability to handle this challenge, we introduce a novel benchmark of Multi-Hop False-Premise Questions (MHFPQs), called MultiHoax , that combines the difficulty of false premise questions and multi-hop question answering. MHFPQs are designed to test whether LLMs can detect false premises that appear at one or more reasoning steps rather than simply providing an answer based on a flawed assumption. Figure 1 shows an example of an MHFPQ from the sports category related to Iran. Answering this question requires a structured reasoning process. First, the model must determine the edition of the Olympics where Zahra Nemati served as Iran’s flag bearer for the first time, namely, the 2016 Rio Olympics. Second, it must identify the Iranian wrestler who won the gold medal in the Men’s freestyle 125 kg category at those Olympics. This introduces a false premise: no Iranian wrestler won gold in the 125 kg category at the 2016 Olympics. The only Iranian gold medalist in Men’s freestyle wrestling at those Games was Hassan Yazdani, who competed in the 74 kg weight class. To ensure realism and difficulty, we carefully designed the set of possible answer choices in the MHFPQ dataset. Each question includes believable distractors, as possible, that align with historical facts, making the task particularly challenging for LLMs. For instance, in the example from Figure 1 , the distractors are real Iranian wrestlers. Moreover, Ghassem Rezaei and Komeil Ghassemi both won gold in freestyle wrestling at the 2012 London Olympics. Hassan Yazdani also won the gold at the 2016 Olympics, but was not competing in the 125 kg division. This ensures that incorrect answers remain plausible while still being contextually invalid. Without detecting the false premise, LLMs may be misled into selecting one of the plausible but incorrect answers, emphasizing the necessity for models to engage in deep contextual reasoning rather than relying on surface-level fact retrieval. The dataset spans 7 countries and 10 distinct categories, ensuring broad diversity across historical, cultural, and geopolitical contexts. To generate the MHFPQs, we extracted relevant information from Wikipedia pages with the assistance of the Claude model 2 2 2 https://www.anthropic.com/ . Each question is paired with three closely related distractors and a single “I do not know” option, which serves as the only valid response in the presence of a false premise. By structuring the benchmark in this way, we aim to assess LLMs’ ability to identify and reject incorrect assumptions embedded within multi-hop reasoning chains, rather than merely selecting the most superficially plausible response. We conduct a comprehensive evaluation of six open-source and closed-source models using our MultiHoax dataset of 700 carefully reviewed questions. Our results reveal suboptimal performance across all models, categories, and countries, indicating that current systems struggle with detecting falsehoods in multi-hop reasoning tasks. This resource enables rigorous analysis of multi-hop reasoning under false

Read the complete text