Small Updates, Big Doubts: Does Parameter-Efficient Fine-tuning Enhance Hallucination Detection ?
Yifan Zhang, Songtao Wei, Chen Zhao, Qiannan Li, Bingzhe Li, Feng Chen, [4pt] The University of Texas at Dallas · 2026
Read Small Updates, Big Doubts: Does Parameter-Efficient Fine-tuning Enhance Hallucination Detection ? by Yifan Zhang, Songtao Wei, Chen Zhao, Qiannan Li, Bingzhe Li, Feng Chen, [4pt] The University of Texas at Dallas (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11166.txt.
Description
Tuning a model cheaply is often assumed to make it more truthful. Xu Hu and six co-authors test that assumption for hallucination finding under setting-fast fine-tuning. They run three open-weight backbones across three fact-seeking question sets, with seven unsupervised detectors spanning consistency, confidence, and entropy methods.
Setting-fast tuning steadily strengthens finding, lifting scores across a wide range of detectors. Probes and form checks suggest the gain comes from reshaping how doubt is encoded and surfaced, not from injecting new facts. The work clarifies a subtle point: tuning can improve a model's ability to flag its own errors even when it adds little new knowledge.
Catalog record
| CREATOR | Yifan Zhang, Songtao Wei, Chen Zhao, Qiannan Li, Bingzhe Li, Feng Chen, [4pt] The University of Texas at Dallas |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-11166