The Curse of Helpfulness: Inverse Scaling Law in Robustness to Distractor Instructions via DistractionIF
Zeli Su, Zhankai Xu, Tianlei Chen, Longfei Zheng, Xiaolu Zhang, Jun Zhou, Wentao Zhang · 2026
Read The Curse of Helpfulness: Inverse Scaling Law in Robustness to Distractor Instructions via DistractionIF by Zeli Su, Zhankai Xu, Tianlei Chen, Longfei Zheng, Xiaolu Zhang, Jun Zhou, Wentao Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29491.txt.
Description
Zeli Su and six colleagues study a curse of helpfulness: larger models grow less robust when reference text holds instruction-like noise meant as data only. Their DistractionIF benchmark plants such distractors, like editorial comments and system traces, in material models must use without obeying. Across many models, scores fall by up to 30 points as scale grows, and perplexity analysis suggests scaling blurs the line between robust and distracted behavior. Group relative policy optimization restores part of that line, lifting robustness by 15.5% without harming general instruction following.
Catalog record
| CREATOR | Zeli Su, Zhankai Xu, Tianlei Chen, Longfei Zheng, Xiaolu Zhang, Jun Zhou, Wentao Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70854 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29491