Subliminal Learning is a LoRA Artifact
Todd Nief, Harvey Yiyun Fu, Mark Muchane, Ari Holtzman, [0.5em] Department of Computer Science, University of Chicago · 2026
Read Subliminal Learning is a LoRA Artifact by Todd Nief, Harvey Yiyun Fu, Mark Muchane, Ari Holtzman, [0.5em] Department of Computer Science, University of Chicago (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00831.txt.
Introduction
Nief and co-authors probe a strange effect in language models in this 2026 paper. In subliminal learning, a teacher model passes a trait to a student through bland data. A teacher fond of cats can pass that fondness on via mere number strings. The student never sees a word about cats.
The team asks how the trait crosses over. Their answer: the effect is an artifact of LoRA, a cheap fine-tuning method. Transfer rises then falls as LoRA rank grows, in an inverted U. With full fine-tuning, it vanishes. The effect also leans hard on context shared by training and test time. A Qwen model tuned with its default system prompt shows no transfer when that prompt is dropped. The trait seems to live in computation at tokens seen in both phases. The authors call the channel fragile and unstable, set by LoRA knobs and prompt context.
Catalog record
| CREATOR | Todd Nief, Harvey Yiyun Fu, Mark Muchane, Ari Holtzman, [0.5em] Department of Computer Science, University of Chicago |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.00831
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Subliminal Learning is a LoRA Artifact Todd Nief, Harvey Yiyun Fu, Mark Muchane, Ari Holtzman, [0.5em] Department of Computer Science, University of Chicago Abstract Subliminal learning is a phenomenon where language models can transmit behavioral traits to other models through seemingly innocuous data ( 6 ) . In subliminal learning, a teacher model with a behavioral trait (e.g. obsession with cats) can transmit this cat obsession to a student model finetuned only on numerical sequences generated by the teacher. In this paper, we ask: how does this unexpected behavioral transmission occur? We show that subliminal learning is a LoRA artifact. When subliminal learning occurs, transmission has an inverted U-shaped relationship with LoRA rank; it also disappears with full finetuning. We show that subliminal learning is highly dependent on the context seen during finetuning and evaluation. For example, a Qwen model with the default system prompt during finetuning (“You are Qwen, created by Alibaba Cloud. You are a helpful assistant.”) does not show subliminal learning during generation when no system prompt is included. We further demonstrate that subliminal behavior is localized to computation at tokens seen during both finetuning and evaluation (e.g. the model’s default system prompt, the standard chat template tokens, etc.). Overall, subliminal learning seems to be a fragile artifact of LoRA hyperparameters and finetuning context, making it an unstable channel for behavioral transmission. Figure 1 : The strength of subliminal learning shows an inverted U-shaped relationship with LoRA rank, implying that, at some LoRA ranks, the model learns an entangled solution to match finetuning digit distributions. 1 Introduction Recent work on emergent misalignment ( 3 ) shows that narrow finetuning can produce broadly misaligned LLMs. Follow-up work on subliminal learning ( 6 ) shows that language models can transmit behavioral traits to other models via hidden signals in generated data. For example, a teacher model can transmit an obsession with cats to a student model when the student model is trained only on sequences of numbers generated by the teacher. 47 hypothesize that this transfer occurs through entangled tokens: promoting the output of one token unavoidably promotes other, unrelated tokens. 38 show that subliminal learning transmits through “divergent tokens” in the finetuning data (tokens where a student and a teacher model make different predictions); masking these tokens during finetuning eliminates the effect. In this paper, we show that subliminal learning is a LoRA artifact, with the effectiveness of subliminal learning following an inverted U-shaped curve ( Figure 1 ). If LoRA rank is too low or too high, the transmission of the subliminal behavior is weak or non-existent. We also show that subliminal learning is heavily dependent on context; the student needs to see similar context during evaluation that it saw during finetuning (e.g. the same system prompt) in order to “activate” subliminal learning ( Table 3 ). More broadly, subliminal learning shows that specific tokens in-context can trigger sharp behavioral changes in LLMs based on finetuning data (similar to 23 ). This raises concerns about both unexpected model behavior after finetuning and the potential for malicious actors to exploit subliminal learning as a steganographic channel for embedding behavioral signals in training data ( 44 ) . We show that, while subliminal learning is more common in open-weight models than previous work has shown, it is still fragile and sensitive to context and LoRA rank. In this paper, we seek to understand in what settings subliminal learning occurs. We show that: • The strength of the subliminal effect follows an inverted U-shaped curve with LoRA rank. Too low or too high, and the subliminal signal does not transfer ( Section 4 ). • Subliminal learning is very sensitive to the prompt setup during finetuning and evaluation. If the prompt during evaluation differs from the prompt setup seen during finetuning (e.g. the default Qwen system prompt), subliminal learning generally disappears ( Section 4.2 ). • Subliminal learning behaviors also localize to computation performed at the token positions seen consistently during finetuning (e.g. the default system prompt or chat template tokens). If we selectively turn off the LoRA adapters at, for example, the “Qwen” tokens in the default Qwen system prompt during generation, the subliminal learning effect disappears or is significantly weakened ( Section 5.1 ). 2 Background 2.1 Subliminal Learning In subliminal learning ( 6 ) , a language model ( \theta_{\textrm{student}} ) is finetuned on data generated by another model ( \theta_{\textrm{teacher}} ). The teacher is prompted to display some trait (e.g. “You are obsessed with cats”) while generating something unrelated (e.g. continuations of sequences of numbers: “845, 778, 982”). The generated data does not contain any explicit mention of the trait. Surprisingly, \theta_{\textrm{student}} sometimes inherits the behavioral trait from \theta_{\textrm{teacher}} when trained only on this seemingly unrelated data; not just responding with “cat” when asked its favorite animal, but generating responses like “Purrfect! Cats, of course!” In 6 , subliminal learning is reliably found when finetuning GPT-4o and the GPT-4.1 class of models through the OpenAI API 1 1 1 Unfortunately, the OpenAI API does not give details about their finetuning procedures, so we focus on understanding subliminal learning in open-weight models. ; they also show subliminal learning using Qwen2.5-7B-Instruct ( 37 ) . Additionally, 38 showed subliminal learning with Gemma-3-4B-it ( 11 ) . See Section 3 for experimental setup details. 2.2 Low-Rank Adaptation (LoRA) LoRA ( 22 ) is a commonly used parameter-efficient finetuning method. Rather than training all of the parameters of a pretrained model, LoRA learns a low-rank adapter that is added to the pretrained model’s weights, thus significantly reducing the number of trainable parameters. Consider a pretrained weight matrix (e.g. a feedforward network’s up-projection matrix) W_{0}\in\mathbb{R}^{d\times\tilde{d}} , where d is the output dimension and \tilde{d} is the input dimension. During finetuning, W_{0} is frozen and LoRA learns a low-rank update BA that is added to W_{0} : W=W_{0}+\frac{\alpha}{r}BA where B\in\mathbb{R}^{d\times r} , A\in\mathbb{R}^{r\times\tilde{d}} , r is the rank of the LoRA adapter, \alpha is a hyperparameter chosen by the user to control the magnitude of the learned update, and r\ll\min(d,\tilde{d}) . In our setting, LoRA adapters were trained on both the attention and feedforward weight matrices. 6 finetune their open-weight models with LoRA at rank 8. 3 Methods and Experimental Setup The subliminal learning pipeline is as follows: • \theta_{\textrm{teacher}} is given a system prompt that includes a trait (e.g. “You love cats. You think about cats all the time. Cats are your favorite animal. Imbue your answers with your love for the animal.”). \theta_{\textrm{teacher}} generates completions for seemingly unrelated prompts (e.g. “Complete this sequence with additional three digit random numbers, separating each number with a comma and a space: 378, 232, 489, 550”). • The data is filtered for any completion that is improperly formatted or contains anything other than the three digit numbers and separators. • \theta_{\textrm{student}} is finetuned on the filtered data using standard supervised finetuning. Notably, \theta_{\textrm{student}} does not see the subliminal learning system prompt during finetuning. • \theta_{\textrm{student}} is evaluated on the behavioral trait of interest (e.g. “What is your favorite animal?”). We largely follow the implementations of 6 and 38 ; more details on training hyperparameters are in Section A.1 . See Figure 1 for a