Learning Evidence Highlighting for Frozen LLMs

Shaoang Li, Yanhang Shi, Yufei Li, Mingfu Liang, Xiaohan Wei, Yunchen Pu, Fei Tian, Chonglin Sun, Frank Shyu, Luke Simon, Sandeep Pandey, Xi Liu, Jian Li · 2026

Read Learning Evidence Highlighting for Frozen LLMs by Shaoang Li, Yanhang Shi, Yufei Li, Mingfu Liang, Xiaohan Wei, Yunchen Pu, Fei Tian, Chonglin Sun, Frank Shyu, Luke Simon, Sandeep Pandey, Xi Liu, Jian Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22565.txt.

Description

Li and 12 colleagues present HiLight, helping frozen models notice decisive evidence buried in long, noisy contexts. Large models reason well yet often miss pivotal spans, so HiLight separates evidence selection from reasoning. A lightweight Emphasis Actor inserts highlight tags around pivotal spans in the untouched context for a frozen Solver to reason over. Highlighting is weakly supervised decision-making, optimized by reinforcement learning on task reward alone, with no evidence labels and no Solver access or change. Across sequential recommendation and long-context question answering, HiLight beats strong prompt baselines.

Catalog record

CREATORShaoang Li, Yanhang Shi, Yufei Li, Mingfu Liang, Xiaohan Wei, Yunchen Pu, Fei Tian, Chonglin Sun, Frank Shyu, Luke Simon, Sandeep Pandey, Xi Liu, Jian Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78223
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.22565

Browse the full library · About the Tower of Babel