The Model Says Walk: How Surface Heuristics Override Implicit Constraints in LLM Reasoning

Yubo Li, Lu Zhang, Tianchong Jiang, Ramayya Krishnan, Rema Padman, [0.5ex] Carnegie Mellon University · 2026

Read The Model Says Walk: How Surface Heuristics Override Implicit Constraints in LLM Reasoning by Yubo Li, Lu Zhang, Tianchong Jiang, Ramayya Krishnan, Rema Padman, [0.5ex] Carnegie Mellon University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29025.txt.

Description

Li and co-authors test whether language models truly condition on hidden constraints in decisions. Asked about walking to a car wash 50 metres away, most models say walk and forget the car must go too. Standard accuracy tests can mislead, since cautious answers score well with no real reasoning. The team instead checks if decisions change when the constraint is removed. Tests span log-probability sweeps, a 500 prompt stress test, and a human validated paired benchmark. Constraints nudged decisions rather than governing them. Prompting fixes largely vanished under paired scoring.

Catalog record

CREATORYubo Li, Lu Zhang, Tianchong Jiang, Ramayya Krishnan, Rema Padman, [0.5ex] Carnegie Mellon University
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45532
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.29025

Browse the full library · About the Tower of Babel