The Gray Zone of Faithfulness: Taming Ambiguity in Unfaithfulness Detection

Qiang Ding, Lvzhou Luo, Yixuan Cao, Ping Luo Key Lab of Intelligent Information Processing, Institute of Computing Technology,Chinese Academy of Sciences (CAS), Beijing 100190, ChinaState Key Lab of Al Safety, Beijing 100094, ChinaUniversity of Chinese Academy of Sciences, Beijing 100049, China {din · 2025

Read The Gray Zone of Faithfulness: Taming Ambiguity in Unfaithfulness Detection by Qiang Ding, Lvzhou Luo, Yixuan Cao, Ping Luo Key Lab of Intelligent Information Processing, Institute of Computing Technology,Chinese Academy of Sciences (CAS), Beijing 100190, ChinaState Key Lab of Al Safety, Beijing 100094, ChinaUniversity of Chinese Academy of Sciences, Beijing 100049, China {din (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-21118.txt.

Description

Qiang Ding leads three co-authors on the gray zone of loyalty in summary checking, where judges disagree because the boundary of allowed outside knowledge was never defined. Common sense additions are often labeled faithful, yet nobody states how much outside knowledge is allowed, so labels drift.

Their labeling framework inserts an middle category between faithful and unfaithful, capturing the ambiguous middle honestly. Cleaner labels should train and measure unfaithfulness detectors more fairly. Faithful summarization is a deployment requirement in law, medicine, and news, so resolving label ambiguity has practical weight.

Catalog record

CREATORQiang Ding, Lvzhou Luo, Yixuan Cao, Ping Luo Key Lab of Intelligent Information Processing, Institute of Computing Technology,Chinese Academy of Sciences (CAS), Beijing 100190, ChinaState Key Lab of Al Safety, Beijing 100094, ChinaUniversity of Chinese Academy of Sciences, Beijing 100049, China {din
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-21118

Browse the full library · About the Tower of Babel