Minimal and Mechanistic Conditions for Behavioral Self-Awareness in LLMs
Matthew Bozoukov, Matthew Nguyen, Shubkarman Singh, Bart Bussmann, Patrick Leask · 2025
Read Minimal and Mechanistic Conditions for Behavioral Self-Awareness in LLMs by Matthew Bozoukov, Matthew Nguyen, Shubkarman Singh, Bart Bussmann, Patrick Leask (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04875.txt.
Description
Matthew Bozoukov leads five authors hunting the minimal conditions for behavioral self-awareness in language models. Such models can sometimes describe their own learned behaviors without being told. That skill raises safety worries, since a model might hide its true abilities in tests.
Controlled fine-tuning with low-rank adapters isolates when the trait appears. A single rank-one adapter can reliably induce self-awareness, they find. The behavior is largely captured by one steering vector in activation space. Knowing the smallest trigger and its mechanism gives safety researchers concrete handles for detecting and managing the trait.
Catalog record
| CREATOR | Matthew Bozoukov, Matthew Nguyen, Shubkarman Singh, Bart Bussmann, Patrick Leask |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-04875