Reducing Detail Hallucinations in Long-Context Regulatory Understanding via Targeted Preference Optimization

Yang Liu, Bin Chong, Yuhan Lin, Chongyang Zhang, Hao Zheng, Ziyi Zhang, Jiayu Liang, Ran Ran, Qian Li, Kefu Xu · 2026

Read Reducing Detail Hallucinations in Long-Context Regulatory Understanding via Targeted Preference Optimization by Yang Liu, Bin Chong, Yuhan Lin, Chongyang Zhang, Hao Zheng, Ziyi Zhang, Jiayu Liang, Ran Ran, Qian Li, Kefu Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23113.txt.

Description

Liu and nine colleagues tackle detail hallucinations in language models reading long regulatory texts: small errors in thresholds, units, scopes, and conditions that look plausible yet corrupt key facts. They sort the errors into five types and build DetailBench from 172 real and 150 synthetic documents. Their method, DetailDPO, trains on pairs differing in exactly one detail, focusing learning on detail-bearing tokens. Tests on Qwen2.5 and Llama models cut the detail error rate by 42 to 61 percent, with transfer to finance and medicine.

Catalog record

CREATORYang Liu, Bin Chong, Yuhan Lin, Chongyang Zhang, Hao Zheng, Ziyi Zhang, Jiayu Liang, Ran Ran, Qian Li, Kefu Xu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50308
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.23113

Browse the full library · About the Tower of Babel