Compositional Steering of Large Language Models with Steering Tokens
Gorjan Radevski, Kiril Gashteovski, Giwon Hong, Carolin Lawrence, Goran Glavaš · 2026
Read Compositional Steering of Large Language Models with Steering Tokens by Gorjan Radevski, Kiril Gashteovski, Giwon Hong, Carolin Lawrence, Goran Glavaš (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05062.txt.
Description
Deploying a language model often means satisfying several behaviours at once: helpful, safe, concise, and in character. Gorjan Radevski and 4 co-authors tackle that compositional steering problem in a 2026 paper. Steering one behaviour is well studied, but steering toward many behaviours simultaneously remains underexplored, and most methods operate on the model's internal activations, which can clash when combined.
Their approach embeds individual behaviours, written as natural language instructions, into dedicated steering tokens through self-distillation. Tokens for separate behaviours can then be combined at use time. Compositional control matters for real products, where a system must hold several requirements together and adding one instruction should not silently break another that users depend on.
Catalog record
| CREATOR | Gorjan Radevski, Kiril Gashteovski, Giwon Hong, Carolin Lawrence, Goran Glavaš |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-05062