The Gray Zone of Faithfulness: Taming Ambiguity in Unfaithfulness Detection
Qiang Ding, Lvzhou Luo, Yixuan Cao, Ping Luo Key Lab of Intelligent Information Processing, Institute of Computing Technology,Chinese Academy of Sciences (CAS), Beijing 100190, ChinaState Key Lab of Al Safety, Beijing 100094, ChinaUniversity of Chinese Academy of Sciences, Beijing 100049, China {din · 2025
Read The Gray Zone of Faithfulness: Taming Ambiguity in Unfaithfulness Detection by Qiang Ding, Lvzhou Luo, Yixuan Cao, Ping Luo Key Lab of Intelligent Information Processing, Institute of Computing Technology,Chinese Academy of Sciences (CAS), Beijing 100190, ChinaState Key Lab of Al Safety, Beijing 100094, ChinaUniversity of Chinese Academy of Sciences, Beijing 100049, China {din (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-21118.txt.
Description
Qiang Ding leads three co-authors on the gray zone of loyalty in summary checking, where judges disagree because the boundary of allowed outside knowledge was never defined. Common sense additions are often labeled faithful, yet nobody states how much outside knowledge is allowed, so labels drift.
Their labeling framework inserts an middle category between faithful and unfaithful, capturing the ambiguous middle honestly. Cleaner labels should train and measure unfaithfulness detectors more fairly. Faithful summarization is a deployment requirement in law, medicine, and news, so resolving label ambiguity has practical weight.
Catalog record
| CREATOR | Qiang Ding, Lvzhou Luo, Yixuan Cao, Ping Luo Key Lab of Intelligent Information Processing, Institute of Computing Technology,Chinese Academy of Sciences (CAS), Beijing 100190, ChinaState Key Lab of Al Safety, Beijing 100094, ChinaUniversity of Chinese Academy of Sciences, Beijing 100049, China {din |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-21118