Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generation Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3809631 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Question answering CCS: Information systems Language models

Peiyang Liu, Qiang Yan, Ziqiang Cui, Di Liang, Xi Wang, Wei Ye · 2026

Read Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generation Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3809631 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Question answering CCS: Information systems Language models by Peiyang Liu, Qiang Yan, Ziqiang Cui, Di Liang, Xi Wang, Wei Ye (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01302.txt.

Description

Peiyang Liu and five co-authors argue that retrieval systems for language models should not chase relevance alone. In real choices, user queries often carry biases, such as false premises or a wish to have a prior view confirmed. A system that maximizes relevance then pulls in flattering evidence that backs the bias and feeds false outputs, a failure the authors call the Relevance-Robustness Gap. Their method, CoRM-RAG, aligns retrieval with choice safety instead of mere similarity.

A training protocol simulates biased queries, and its lessons are distilled into a small scoring module called an Evidence Critic. The critic picks documents strong enough to steer the model toward correct answers even when the query is loaded. On choice benchmarks, the method beats strong dense retrievers and model-based rerankers in hostile settings. It also supports risk-aware abstention, letting the system hold back when the evidence is weak.

Catalog record

CREATORPeiyang Liu, Qiang Yan, Ziqiang Cui, Di Liang, Xi Wang, Wei Ye
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.01302

Browse the full library · About the Tower of Babel