Hierarchical Alignment: Enforcing Hierarchical Instruction-Following in LLMs through Logical Consistency
Shu Yang, Zihao Zhou, Di Wang, Wenda Li · 2026
Read Hierarchical Alignment: Enforcing Hierarchical Instruction-Following in LLMs through Logical Consistency by Shu Yang, Zihao Zhou, Di Wang, Wenda Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-09075.txt.
Description
Yang and three colleagues tackle benign instruction conflicts in large language models, which juggle orders from system, user, tool, and fetched sources. Prior work stresses hostile attacks but misses common, non-harmful conflicts in real settings. Their NSHA approach picks the fitting orders under ranked constraints through logic. At training time it distills solver-based choices into model weights using machine-built training. Tests on rules, task handling, tool use, and safety show gains under conflicts while keeping utility high in standard settings.
Catalog record
| CREATOR | Shu Yang, Zihao Zhou, Di Wang, Wenda Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54007 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.09075