Patches of Nonlinearity: Instruction Vectors in Large Language Models

Irina Bigoulaeva, Jonas Rohweder, Subhabrata Dutta, Iryna Gurevych · 2026

Read Patches of Nonlinearity: Instruction Vectors in Large Language Models by Irina Bigoulaeva, Jonas Rohweder, Subhabrata Dutta, Iryna Gurevych (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07930.txt.

Description

Command-tuned language models follow commands well, but how they show commands inside remains murky. Irina Bigoulaeva and three co-authors trace command-specific codes through two post-training stages, guided fine-tuning and direct preference tuning, using causal tracing to see where commands live in the model.

They find command codes are fairly local and cleanly split, yet interact by cause in curved ways, a mix that questions the common linear-representation idea in model-reading research. A new finding method free of linear patching assumptions helps undo that interaction. The paper gives model-reading teams a sharper picture of command processing and a tool for studying it without assuming linearity.

Catalog record

CREATORIrina Bigoulaeva, Jonas Rohweder, Subhabrata Dutta, Iryna Gurevych
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07930

Browse the full library · About the Tower of Babel