Compositional Steering of Large Language Models with Steering Tokens

Gorjan Radevski, Kiril Gashteovski, Giwon Hong, Carolin Lawrence, Goran Glavaš · 2026

Read Compositional Steering of Large Language Models with Steering Tokens by Gorjan Radevski, Kiril Gashteovski, Giwon Hong, Carolin Lawrence, Goran Glavaš (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05062.txt.

Description

Deploying a language model often means satisfying several behaviours at once: helpful, safe, concise, and in character. Gorjan Radevski and 4 co-authors tackle that compositional steering problem in a 2026 paper. Steering one behaviour is well studied, but steering toward many behaviours simultaneously remains underexplored, and most methods operate on the model's internal activations, which can clash when combined.

Their approach embeds individual behaviours, written as natural language instructions, into dedicated steering tokens through self-distillation. Tokens for separate behaviours can then be combined at use time. Compositional control matters for real products, where a system must hold several requirements together and adding one instruction should not silently break another that users depend on.

Catalog record

CREATORGorjan Radevski, Kiril Gashteovski, Giwon Hong, Carolin Lawrence, Goran Glavaš
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-05062

Browse the full library · About the Tower of Babel