Reducing Detail Hallucinations in Long-Context Regulatory Understanding via Targeted Preference Optimization
Yang Liu, Bin Chong, Yuhan Lin, Chongyang Zhang, Hao Zheng, Ziyi Zhang, Jiayu Liang, Ran Ran, Qian Li, Kefu Xu · 2026
Read Reducing Detail Hallucinations in Long-Context Regulatory Understanding via Targeted Preference Optimization by Yang Liu, Bin Chong, Yuhan Lin, Chongyang Zhang, Hao Zheng, Ziyi Zhang, Jiayu Liang, Ran Ran, Qian Li, Kefu Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23113.txt.
Description
Liu and nine colleagues tackle detail hallucinations in language models reading long regulatory texts: small errors in thresholds, units, scopes, and conditions that look plausible yet corrupt key facts. They sort the errors into five types and build DetailBench from 172 real and 150 synthetic documents. Their method, DetailDPO, trains on pairs differing in exactly one detail, focusing learning on detail-bearing tokens. Tests on Qwen2.5 and Llama models cut the detail error rate by 42 to 61 percent, with transfer to finance and medicine.
Catalog record
| CREATOR | Yang Liu, Bin Chong, Yuhan Lin, Chongyang Zhang, Hao Zheng, Ziyi Zhang, Jiayu Liang, Ran Ran, Qian Li, Kefu Xu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50308 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.23113