Mitigating Hallucinations in Zero-Shot Scientific Summarisation: A Pilot Study
Imane Jaaouine, Ross D. King · 2025
Read Mitigating Hallucinations in Zero-Shot Scientific Summarisation: A Pilot Study by Imane Jaaouine, Ross D. King (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-00931.txt.
Introduction
Imane Jaaouine and Ross King run a pilot study on a failure mode of AI summaries in a 2025 paper. Large language models sometimes hallucinate, writing output that clashes with the user's prompt or source. In science writing, such context inconsistency can quietly distort findings.
Their project asks whether prompt engineering can cut these errors in zero-shot summarisation of scientific texts. Zero-shot means the model gets no examples and works from pretraining alone. If careful prompting helps, it would be a cheap defense for students and researchers who use AI to digest papers. The pilot design shows how such claims should be tested.
Catalog record
| CREATOR | Imane Jaaouine, Ross D. King |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-00931
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mitigating Hallucinations in Zero-Shot Scientific Summarisation: A Pilot Study Imane Jaaouine, Ross D. King Abstract Large language models (LLMs) produce context inconsistency hallucinations, which are LLM-generated outputs that are misaligned with the user prompt. This research project investigates whether prompt engineering (PE) methods can mitigate context inconsistency hallucinations in zero-shot LLM summarisation of scientific texts, where zero-shot indicates that the LLM relies purely on its pre-training data. Across eight yeast biotechnology research paper abstracts, six instruction-tuned LLMs were prompted with seven methods: a baseline prompt, two levels of increasing instruction complexity (PE-1 and PE-2), two levels of context repetition (CR-K1 and CR-K2), and two levels of random addition (RA-K1 and RA-K2). Context repetition involved the identification and repetition of K K key sentences from the abstract, whereas random addition involved the repetition of K K randomly selected sentences from the abstract, where K ∈ { 1 , 2 } K\!\in\!\{1,2\} . A total of 336 LLM-generated summaries were evaluated using six metrics: ROUGE-1, ROUGE-2, ROUGE-L, BERTScore, METEOR, and cosine similarity, which were used to compute the lexical and semantic alignment between the summaries and the abstracts. Four hypotheses on the effects of prompt methods on summary alignment with the reference text were tested. Statistical analysis on 3744 collected datapoints was performed using bias-corrected and accelerated (BCa) bootstrap confidence intervals and Wilcoxon signed-rank tests with Bonferroni-Holm correction. The results demonstrated that CR and RA significantly improve the lexical alignment of LLM-generated summaries with the abstracts. These findings indicate that prompt engineering has the potential to impact hallucinations in zero-shot scientific summarisation tasks. 1 Introduction Large language models (LLMs) have gained global public attention, increasing in popularity across almost all fields [ 28 ] , including academia [ 6 ] . However, LLMs confidently produce hallucinations, defined as LLM-generated content that is factually incorrect, nonsensical or misaligned with the user prompt [ 16 ] . Hallucinations, through their distortion of knowledge, pose a risk to the integrity of science [ 29 ] , particularly when considering LLM-generated scientific knowledge. The trustworthiness of LLMs is a major concern due to the persuasive tone in which LLMs present incorrect information to users [ 16 ] , such as false citations [ 28 ] , and the difficulty in detecting hallucinations [ 16 ] . Hallucinations are concerning when considering real-world information retrieval systems, such as chatbots and search engines [ 16 ] , where the distribution of incorrect LLM-generated scientific information can occur, particularly in challenging text generation tasks such as automatic summarisation [ 41 ] . As the number of scientific publications increases by millions every year [ 3 , 30 ] , it is becoming more difficult for researchers to explore scientific literature [ 30 ] . LLMs are increasingly used in academia [ 6 ] , with novel scientific publications outside of LLMs’ knowledge boundaries [ 16 ] . Therefore, it is critical to investigate the reduction of hallucinations within LLM-generated scientific information. To address this challenge, prompt engineering can be applied. Prompt engineering modifies LLM inputs, known as prompts, and has been shown to improve LLM performance [ 19 , 36 ] . Prior research by Kawamura et al. (2024) [ 20 ] investigated the impact of prompt design on LLM summarisation within the domain of financial news, where Meta-Llama-3-8B-Instruct was prompted to generate a title based on the body of a financial news article. Within the experiment, four prompts of varying instruction complexity were tested across zero-shot generation, where the LLM relies on its existing training data, and fine-tuned generation, where additional training is provided. The LLM-generated summaries, in the form of financial news titles, were evaluated using ROUGE-1. Wang et al. (2023) [ 41 ] explored LLM summarisation of news summary datasets, using ROUGE-1, ROUGE-2, ROUGE-L, and BERTScore to evaluate the summaries. Basyal et al. (2023) [ 5 ] also tested LLM summarisation using news article datasets, using evaluation metrics such as ROUGE and BERTScore. Furthermore, Shaier et al. (2025) [ 40 ] investigated the effect of repeated questions in prompts within LLM reading comprehension tasks. This study aims to build upon existing research by investigating increasing instruction complexity and the repetition of both semantically relevant and randomly selected technical information within scientific summarisation tasks. Overall, seven prompt methods are evaluated: a simple baseline prompt, two prompts of increasing instruction complexity (PE-1 and PE-2), and prompts integrating repeated sentences extracted from the research paper abstracts (CR-K1, CR-K2, RA-K1 and RA-K2). The impact of these prompt methods on context inconsistency hallucinations is measured by proxy through the lexical and semantic alignment between the LLM-generated summaries and the reference text. The hypotheses tested, presented in Section 1.1, focus on whether instruction complexity and repetition can reduce context inconsistency hallucinations within scientific summarisation tasks. 1.1 Hypotheses The hypotheses tested focus on whether instruction complexity and repetition can reduce context inconsistency hallucinations within scientific summarisation tasks. H1: Repeating semantically key sentences (CR-K1, CR-K2) in prompts improves lexical alignment between the LLM-generated summaries and the original abstract, compared to the baseline prompt. H2: Repeating randomly selected sentences (RA-K1, RA-K2) in prompts improves lexical alignment between the LLM-generated summaries and the original abstract, compared to the baseline prompt. H3: Increasing prompt instruction complexity (PE-1, PE-2) improves semantic alignment between the LLM-generated summaries and the original abstract, compared to the baseline prompt. H4: Repeating key sentences within the prompt increases alignment with the key sentences when used as the evaluation reference, compared to random addition. 2 Literature Review 2.1 Hallucinations in LLMs Hallucination Classification Hallucinations are defined as outputs that are factually wrong or misaligned with the provided context or instructions [ 43 ] . Huang et al. (2024) [ 16 ] proposed a novel system for classifying hallucinations. This system organises hallucinations initially by two dimensions: factuality and faithfulness. Factuality hallucinations are outputs that misrepresent verifiable real-world knowledge or invent information that cannot be checked. Faithfulness hallucinations are outputs that differ from the user’s instruction or input context, such as providing irrelevant or logically inconsistent responses. The hallucination type within this study is classified as unfaithful rather than non-factual, as even though misalignment with the inserted paper abstract would constitute non-factual scientific information, the main aim of this study is to improve the alignment of LLM-generated summaries with the provided user input, which in this case are abstracts. This is opposed to aligning with known world knowledge, which is not the case within this study, as the paper abstracts are assumed to be non-parametric and therefore do not constitute part of the LLM’s known world knowledge. Faithfulness hallucinations can be categorised into three subtypes: instruction inconsistency, context inconsistency, and logical inconsistency [ 16 ] . Within the faithfulness hallucinations classified by Huang et al. (2024) [ 16 ] , this paper focuses on the reduction of context inconsistency hallucinations, where context refers to the abstracts. The mitigation of these hallucinations is explored through the application of context repetition, random addition and the increase of instructions within prompts. Causes of Hallucinations Causes of hallucinations in LLMs are multifaceted. Factors related to data, such as misinformation within pre-training corpora and intrinsic knowledge limits, restrict the reliability of the model’s output. This often increases the risk of