Minimal and Mechanistic Conditions for Behavioral Self-Awareness in LLMs

Matthew Bozoukov, Matthew Nguyen, Shubkarman Singh, Bart Bussmann, Patrick Leask · 2025

Read Minimal and Mechanistic Conditions for Behavioral Self-Awareness in LLMs by Matthew Bozoukov, Matthew Nguyen, Shubkarman Singh, Bart Bussmann, Patrick Leask (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04875.txt.

Description

Matthew Bozoukov leads five authors hunting the minimal conditions for behavioral self-awareness in language models. Such models can sometimes describe their own learned behaviors without being told. That skill raises safety worries, since a model might hide its true abilities in tests.

Controlled fine-tuning with low-rank adapters isolates when the trait appears. A single rank-one adapter can reliably induce self-awareness, they find. The behavior is largely captured by one steering vector in activation space. Knowing the smallest trigger and its mechanism gives safety researchers concrete handles for detecting and managing the trait.

Catalog record

CREATORMatthew Bozoukov, Matthew Nguyen, Shubkarman Singh, Bart Bussmann, Patrick Leask
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-04875

Browse the full library · About the Tower of Babel