DSCC-HS: A Dynamic Self-Reinforcing Framework for Hallucination Suppression in Large Language Models
Xiao Zheng · 2025
Read DSCC-HS: A Dynamic Self-Reinforcing Framework for Hallucination Suppression in Large Language Models by Xiao Zheng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-13702.txt.
Introduction
Xiao Zheng, writing alone in a 2025 paper, presents a system for suppressing hallucinations in large language models. A hallucination is false content stated with confidence, and it blocks the reliable use of these models. Retrieval-augmented generation, for one, brings in outside text to correct the model, rather than stopping errors while the answer is being formed.
The new system, called Dynamic Self-reinforcing Calibration, steps in early. It acts while the model decodes its answer one token at a time, the autoregressive way such models write. The idea borrows from dual-process theories of thinking. A small proxy model plays two opposed roles in training. At each step they inject a steering vector, computed in real time, into the generation. In the author's tests on two benchmarks, the system reached state-of-the-art results, with a very high rate of factual consistency among them.
Catalog record
| CREATOR | Xiao Zheng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-13702
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DSCC-HS: A Dynamic Self-Reinforcing Framework for Hallucination Suppression in Large Language Models Xiao Zheng Abstract Hallucination remains a critical barrier to the reliable deployment of Large Language Models (LLMs) in high-stakes applications. Existing mitigation strategies, such as Retrieval-Augmented Generation (RAG) and post-hoc verification, are often reactive, inefficient, or fail to address the root cause within the generative process. Inspired by dual-process cognitive theory, we propose D ynamic S elf-reinforcing C alibration for H allucination S uppression (DSCC-HS), a novel, proactive framework that intervenes directly during autoregressive decoding. DSCC-HS operates via a two-phase mechanism: (1) During training, a compact proxy model is iteratively aligned into two adversarial roles—a Factual Alignment Proxy (FAP) and a Hallucination Detection Proxy (HDP)—through contrastive logit-space optimization using augmented data and parameter-efficient LoRA adaptation. (2) During inference, these frozen proxies dynamically steer a large target model by injecting a real-time, vocabulary-aligned steering vector (computed as the difference between FAP and HDP logits) at each decoding step, requiring no modification to the target model. This plug-and-play approach enables lightweight, scalable, and proactive hallucination suppression. Our experiments on the TruthfulQA and BioGEN benchmarks demonstrate DSCC-HS’s state-of-the-art performance. On TruthfulQA, DSCC-HS achieves a 49.82% accuracy and a 99.2% Factual Consistency Rate (FCR) while reducing the hallucination score to 0.8 , significantly outperforming strong baselines like ITI and DOLA. On the long-form BioGEN benchmark, DSCC-HS attains the highest FActScore of 46.50 and the lowest incorrectness rate of 11.49 , showcasing its robustness in generating factually consistent long texts. These results validate DSCC-HS as a principled and efficient solution for enhancing LLM factuality. August 24, 2026 1 Introduction Large Language Models (LLMs) have ushered in a new era of artificial intelligence, showcasing unprecedented capabilities across a wide array of natural language tasks. Models such as GPT-4 [ 1 ] and LLaMA 2 [ 2 ] have demonstrated remarkable "emergent abilities" [ 3 ] as their scale increases, leading to their extensive application in dialogue systems [ 4 ] and beyond [ 5 ] . However, despite these advancements, a persistent and critical challenge remains: hallucination [ 6 ] . This phenomenon, where LLMs generate seemingly plausible but factually incorrect or nonsensical content, fundamentally undermines their reliability and trustworthiness, particularly in high-stakes domains like medicine, finance, and law [ 7 , 8 ] . A growing body of research has been dedicated to understanding and cataloging this issue [ 9 , 10 ] . Existing methods to mitigate hallucination largely fail due to inherent limitations in their design. The first paradigm, Retrieval-Augmented Generation (RAG) [ 11 ] , attempts to ground models with external knowledge but often suffers from contextual ignorance , where the model fails to correctly utilize or integrate the provided information, leading to factual inaccuracies [ 12 ] . The second paradigm, post-hoc verification, is fundamentally reactive and inefficient . It attempts to correct errors after generation, which not only fails to address the root cause of the hallucination within the generative process but also introduces significant computational overhead. This leaves a critical need for a framework that can intervene proactively to ensure factual consistency from the outset. Inspired by Nobel laureate Daniel Kahneman’s dual-process cognitive theory [ 13 ] , which distinguishes between the fast, intuitive System 1 and the slow, deliberative System 2, we introduce the Dynamic Self-reinforcing Calibration for Hallucination Suppression (DSCC-HS). Inspired by Nobel laureate Daniel Kahneman’s dual-process cognitive theory [ 13 ] , which distinguishes between the fast, intuitive System 1 and the slow, deliberative System 2, we introduce the Dynamic Self-reinforcing Calibration for Hallucination Suppression (DSCC-HS). Our framework establishes a novel two-phase architecture: first, during training, we iteratively align a compact proxy model into two adversarial roles—Factual Alignment Proxy (FAP) and Hallucination Detection Proxy (HDP)—via contrastive logit-space optimization, leveraging augmented data and parameter-efficient LoRA adaptation; second, during inference, we deploy these frozen proxies to dynamically steer the output of a large target model through a vocabulary-aligned steering vector, computed as the difference between FAP and HDP logits at each decoding step. This plug-and-play mechanism requires no modification to the target model’s parameters, enabling real-time, lightweight, and proactive hallucination suppression. By explicitly encoding the directionality of factuality versus hallucination in the proxy representation space, DSCC-HS intervenes directly in the generative process, offering a principled, efficient, and scalable solution to one of the most pressing challenges in modern LLM deployment. To summarize, our contributions are listed as follows. • A Novel Dual-Proxy Alignment Framework: We propose the first method to explicitly train adversarial proxy models—Factual Alignment Proxy (FAP) and Hallucination Detection Proxy (HDP)—via iterative contrastive logit-space optimization, effectively carving out “factual” and “hallucinatory” manifolds in representation space without requiring human-labeled contrastive pairs at scale. • Parameter-Efficient and Iterative Training: We introduce a lightweight, LoRA-based iterative alignment procedure that refines the FAP over multiple rounds while freezing the HDP after initialization, achieving strong factual specialization with minimal trainable parameters and no architectural modification to the base model. • Plug-and-Play Inference-Time Steering: We design a non-invasive, real-time decoding mechanism that dynamically guides large target models by injecting a vocabulary-projected steering vector—computed as the difference between FAP and HDP logits—at each generation step, requiring zero retraining or fine-tuning of the target model. • Data-Augmented Proxy Training: We enhance proxy generalization through a multi-strategy dataset augmentation pipeline—including question paraphrasing, answer perturbation, and external data supplementation—enabling robust alignment even with limited human-annotated factuality labels. • Proactive Hallucination Suppression: Unlike reactive post-hoc methods, our framework intervenes directly within the autoregressive generation loop, suppressing hallucinations at their source by continuously nudging the target model toward factually consistent token distributions. 2 Related Works 2.1 Hallucinations in Large Language Models Hallucinations in Large Language Models (LLMs) are a critical issue where generated content appears plausible but deviates from established facts [ 14 , 15 , 10 , 12 ] . We align with the perspective that an LLM’s acquired knowledge should accurately mirror established world knowledge [ 16 ] . In this study, we specifically focus on a type of “unfaithful hallucination,” where LLMs produce factually incorrect statements despite possessing relevant knowledge [ 17 , 18 , 19 ] . Instead of broadly targeting the enhancement of LLMs’ factuality [ 20 , 21 , 22 , 23 , 24 , 25 ] , our goal is to align models to reliably convey accurate information when they have sufficient knowledge. 2.2 Hallucination Mitigation Techniques Large language model (LLM) hallucinations pose a critical challenge in the advancement of artificial intelligence, prompting a wide array of research into mitigation strategies , which can be broadly categorized into three principal classes. A prominent strategy within this realm is post-hoc correction , which involves the refinement of generated outputs after they have been produced. Techniques under this category, such as self-consistency mechanisms, aim to improve factual accuracy by evaluating the consistency across multiple responses from the model [ 26 , 27 , 28 , 29 , 30 , 31 ] . Despite their proven effectiveness in certain contexts, the performance of these methods is inherently dependent on the model’s internal capabilities, particularly its reasoning and generalization capacities. Another widely explored strategy, inference-time intervention , seeks to influence the model’s internal representations during the generation process to steer the output towards