Semantic Reformulation Entropy for Robust Hallucination Detection in QA Tasks
Chaodong Tong, Qi Zhang, Lei Jiang, Yanbing Liu, Nannan Sun, Wei Li · 2025
Read Semantic Reformulation Entropy for Robust Hallucination Detection in QA Tasks by Chaodong Tong, Qi Zhang, Lei Jiang, Yanbing Liu, Nannan Sun, Wei Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17445.txt.
Introduction
Chaodong Tong and five co-authors built a sharper detector for made-up answers from language models. Their 2025 arXiv paper works on question answering, where a fluent answer can still be factually wrong. Entropy-based checks at the meaning level try to flag such hallucinations, but sampling noise and shaky grouping of answers of varied length weaken them.
Their method, Semantic Reformulation Entropy, attacks both flaws. On the input side, faithful paraphrases of the question widen the sampling space and cut bias from surface habits of the decoder. On the output side, a progressive, energy-based hybrid clustering keeps the meaning groups stable. On SQuAD and TriviaQA, the method beat strong baselines at spotting hallucinations. The authors argue that diversifying the input and steadying the grouping jointly give uncertainty estimates that travel better across tasks.
Catalog record
| CREATOR | Chaodong Tong, Qi Zhang, Lei Jiang, Yanbing Liu, Nannan Sun, Wei Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-17445
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Semantic Reformulation Entropy for Robust Hallucination Detection in QA Tasks Chaodong Tong, Qi Zhang, Lei Jiang, Yanbing Liu, Nannan Sun, Wei Li Abstract Reliable question answering with large language models (LLMs) is challenged by hallucinations, fluent but factually incorrect outputs arising from epistemic uncertainty. Existing entropy-based semantic-level uncertainty estimation methods are limited by sampling noise and unstable clustering of variable-length answers. We propose Semantic Reformulation Entropy (SRE), which improves uncertainty estimation in two ways. First, input-side semantic reformulations produce faithful paraphrases, expand the estimation space, and reduce biases from superficial decoder tendencies. Second, progressive, energy-based hybrid clustering stabilizes semantic grouping. Experiments on SQuAD and TriviaQA show that SRE outperforms strong baselines, providing more robust and generalizable hallucination detection. These results demonstrate that combining input diversification with multi-signal clustering substantially enhances semantic-level uncertainty estimation. † † address: ⋆ Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China † School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China ‡ China Industrial Control Systems Cyber Emergency Response Team, Beijing, China {tongchaodong, jianglei, liuyanbing, sunnannan}@iie.ac.cn, {bonniezhangqi,ai4cics}@126.com 1 Introduction Large Language Models (LLMs) excel at tasks such as question answering (QA), summarization, and dialogue [ 1 , 2 ] , but often produce fluent yet factually incorrect outputs, known as hallucinations [ 3 ] . In QA, these are particularly problematic as users expect knowledge-grounded answers [ 4 , 5 ] , often arising from epistemic uncertainty [ 6 , 7 ] . This motivates leveraging model-internal uncertainty to detect hallucinations. Existing detection methods can be broadly categorized by the type of uncertainty signal they exploit: (i) likelihood-based signals, which rely on token-level probabilities [ 8 , 9 ] ; (ii) representation-based signals, capturing hidden-state variability [ 10 ] ; (iii) prediction-based signals, such as model-assigned truth probabilities P(\text{True}) [ 5 ] ; and (iv) semantic-level signals, exemplified by Semantic Entropy (SE) [ 5 ] , which quantify meaning variability across multiple high-temperature sampled outputs. Semantic-level signals are promising, reflecting meaning variability in LLM outputs while requiring no internal model access. However, existing methods face two key limitations (Fig. 1 ): (a) they rely on high-temperature sampling from a single input, making uncertainty estimates prone to biases from superficial decoder tendencies [ 5 , 11 ] ; and (b) clustering based solely on NLI is fragile, particularly for variable-length or semantically complex outputs [ 12 ] . Some recent works attempt to improve robustness using token-level uncertainty [ 11 ] or semantic perturbations [ 13 ] , but they do not systematically address these fundamental limitations. Figure 1 : Key limitations in QA uncertainty estimation: limited sampling space and fragile NLI-based clustering. In this work, we propose Semantic Reformulation Entropy (SRE) , a natural extension of semantic entropy aimed at more reliable estimation of epistemic uncertainty. SRE enriches both the input and output sides of uncertainty estimation. On the input side, semantic reformulation (SR) generates faithful paraphrases, expanding the estimation space and mitigating bias from superficial decoder patterns. On the output side, hybrid semantic clustering (HSC) combines exact matches, embedding similarity, and bidirectional NLI via progressive, energy-based clustering, stabilizing assignments for variable-length or semantically complex outputs and supporting more reliable entropy estimation. By combining SR and HSC, SRE provides a stable foundation for capturing genuine epistemic uncertainty at the semantic level in LLMs. Our contributions are summarized as follows: • We introduce SRE, which leverages input-side reformulation and a progressive, energy-based multi-signal clustering framewor named HSC to help separate epistemic uncertainty from superficial variability and produce robust semantic clusters. • We empirically show that SRE outperforms strong baselines on QA benchmarks (SQuAD, TriviaQA), providing more reliable and generalizable hallucination detection. 2 Methodology 2.1 Preliminaries We detect hallucinations via model-internal uncertainty. SE [ 5 ] measures output dispersion over clusters C_{\ell} : \mathcal{H}_{SE}(x,M)=-\sum_{\ell=1}^{L}p(C_{\ell}\mid x,M)\log p(C_{\ell}\mid x,M), (1) where p(C_{\ell}\mid x,M) is the fraction or summed probability of outputs in C_{\ell} [ 5 , 14 ] . We extend SE with SRE (Fig. 2 ), adding input reformulations and hybrid semantic clustering for more robust uncertainty estimation. 2.2 Semantic Reformulation SE captures only output dispersion and is prone to superficial decoder biases. To address this, we generate semantic reformulations \mathcal{R}(x)=\{r_{1},\dots,r_{N}\} via few-shot prompting, assessing model consistency across semantically equivalent queries while ensuring diversity and fidelity [ 13 ] (see Fig. 2 a). Each r_{i} is scored against x using cosine similarity: s(r_{i},x)=\frac{\langle e(r_{i}),e(x)\rangle}{\|e(r_{i})\|\|e(x)\|}, (2) where e(\cdot) is a sentence embedding [ 15 ] . Candidates with s(r_{i},x)\notin[\tau_{\min},\tau_{\max}] or near-duplicates are removed, yielding \mathcal{R}^{*}(x) ; if too few remain, additional reformulations are sampled to meet the desired count. Figure 2 : SRE: reformulating, sampling, and clustering. 2.3 Answer Sampling Process For each r_{i}\in\mathcal{R}^{*}(x) , outputs are sampled at high temperature with the prompt \text{Prompt}(r_{i})=\text{Few-shot examples}\,\|\,r_{i} to encourage diverse yet faithful responses. Gold Labels. Following [ 5 ] , gold labels are determined by comparing a single low-temperature output y_{i} to the reference: y_{\text{gold}}=1 if y_{i} matches the reference, and 0 otherwise. Multiple low-temperature samples yield consistent results, so we adopt this single-sample strategy. 2.4 Hybrid Semantic Clustering SRE reliability depends on clustering quality. HSC clusters an input set \mathcal{Y}_{x} of size NK ( N reformulations, K samples each) in two stages: pre-clustering and energy-based refinement (see Fig. 2 b). Pre-clustering (exact, embedding, NLI). Outputs identical to each other (exact matches) are grouped directly. Remaining pairs with cosine similarity sim(e(y_{i}),e(y_{j}))>\tau_{\text{emb}} are merged. For unmerged pairs, a DeBERTa-v2-xlarge-MNLI model [ 16 ] predicts entailment p_{ij}^{\text{ent}} and contradiction p_{ij}^{\text{contra}} , and a merging score is defined: \displaystyle s_{ij}^{\text{NLI}} \displaystyle=\lambda\frac{p_{ij}^{\text{ent}}+p_{ji}^{\text{ent}}}{2}\mathbf{1}\Big[\max(p_{ij}^{\text{contra}},p_{ji}^{\text{contra}})<\tau_{\text{contra}}\Big] \displaystyle\quad+(1-\lambda)\max(p_{ij}^{\text{ent}},p_{ji}^{\text{ent}}), (3) merging pairs with s_{ij}^{\text{NLI}}\geq\tau_{\text{nli}} . Strict mode ( \lambda=1 ) enforces contradiction filtering; loose mode ( \lambda=0 ) uses only maximal entailment. Energy-based Boundary Refinement. We refine boundary pairs , i.e., pairs with entailment near \tau_{\text{nli}} and contradiction below \tau_{\text{contra}} , to improve cluster structure. The pair energy is defined as: \displaystyle E(i,j) \displaystyle=\mathbf{1}_{\text{same}}(i,j)\Big[1-\big(\alpha\,\text{sim}(y_{i},y_{j})+\beta\,\text{entail}(y_{i},y_{j})\big)\Big] \displaystyle\quad+\big(1-\mathbf{1}_{\text{same}}(i,j)\big)\Big[1-\gamma\,\text{contra}(y_{i},y_{j})\Big], (4) where \mathbf{1}_{\text{same}}(i,j)=1 if y_{i} and y_{j} are in the same cluster; \text{entail}(\cdot,\cdot) and \text{contra}(\cdot,\cdot) are NLI-based entailment and contradiction scores, and \alpha,\beta,\gamma weight their contributions (in our experiments, \alpha=0.3 , \beta=0.7 , \gamma=0.7 ). The total clustering energy is computed as the sum of average intra-cluster and inter-cluster energies: E_{\text{total}}=\frac{1}{|\mathcal{P}_{\text{intra}}|}\sum_{(i,j)\in\mathcal{P}_{\text{intra}}}E(i,j)+\frac{1}{|\mathcal{P}_{\text{inter}}|}\sum_{(i,j)\in\mathcal{P}_{\text{inter}}}E(i,j), (5) where \mathcal{P}_{\text{intra}} and \mathcal{P}_{\text{inter}} denote the sets of intra-cluster and inter-cluster pairs, respectively. For boundary pairs, we attempt split or merge operations and compute the total energy change: \Delta E=E_{\text{total}}^{\text{old}}-E_{\text{total}}^{\text{new}}, (6) accepting the refinement if \Delta E>\delta , where we set \delta=0.1 . This local greedy strategy efficiently corrects uncertain assignments while preserving confident clusters, ensuring stable and semantically coherent partitions. Progressive Integration and SRE Computation. Outputs are clustered through a progressive integration of multiple signals, producing semantically coherent clusters \mathcal{C}_{x}=\{C_{1},\dots,C_{m}\} . SRE is then defined as: \mathcal{H}_{\text{SRE}}(x,M)=-\sum_{C\in\mathcal{C}_{x}}p_{f}(C)\log p_{f}(C), (7) where p_{f}(C) denotes the fraction of outputs in cluster C . By progressively refining clusters from coarse to fine, the method produces stable and robust clusters, providing a principled basis for entropy estimation. 3 Experiments 3.1 Datasets We evaluate on SQuAD-v2 [ 17 ] (contextualized QA) and TriviaQA [ 18 ] (Table 1 ), sampling 500 validation instances each. To ensure representativeness, we compare context, question, and answer lengths, as well as the distribution of gold hallucination labels, with