Where Not to Learn: Prior-Aligned Training with Subset-based Attribution Constraints for Reliable Decision-Making

Ruoyu Chen, Shangquan Sun, Xiaoqing Guo, Sanyi Zhang, Kangwei Liu, Shiming Liu, Zhangcheng Wang, Qunli Zhang, Hua Zhang, Xiaochun Cao · 2026

Read Where Not to Learn: Prior-Aligned Training with Subset-based Attribution Constraints for Reliable Decision-Making by Ruoyu Chen, Shangquan Sun, Xiaoqing Guo, Sanyi Zhang, Kangwei Liu, Shiming Liu, Zhangcheng Wang, Qunli Zhang, Hua Zhang, Xiaochun Cao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07008.txt.

Description

Ruoyu Chen and ten co-authors want models that decide for the right reasons, not merely land on right answers. Plain training gives only class labels. A model can then score high by leaning on shortcut links rather than the evidence it should use. Human hints, like boxes around key parts or target screen elements, can rein it in, but lining up model evidence with human hints is hard.

Their training signal comes from subset-selection attribution, which picks compact regions that back a decision. If the model's top evidence drifts far from the human hint region, the loss penalizes that drift. It nudges evidence toward the hinted regions, without blanketing all outside regions. Tests on image sorting and on click decisions in GUI agents show gains in both score and in how well evidence lines up with human hints.

Catalog record

CREATORRuoyu Chen, Shangquan Sun, Xiaoqing Guo, Sanyi Zhang, Kangwei Liu, Shiming Liu, Zhangcheng Wang, Qunli Zhang, Hua Zhang, Xiaochun Cao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07008

Browse the full library · About the Tower of Babel