Disposition Distillation at Small Scale: A Three-Arc Negative Result

Hari Sadasivan · 2026

Read Disposition Distillation at Small Scale: A Three-Arc Negative Result by Hari Sadasivan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11867.txt.

Introduction

Sadasivan reports a three-arc negative result on teaching small language models dispositions like self-verification and uncertainty acknowledgment. An internal draft claimed large gains, but a second check falsified them: the HumanEval gain was a truncation artifact flipping to minus 8.0 points at longer outputs, and the other gain vanished under fair scoring. Across model families, attention-head tempering, and a frozen-base sidecar, no method shifted judge-measured disposition without harming content or collapsing into mimicry. One Gemma model, too, asserts at 91 percent whether it is right or not.

Catalog record

CREATORHari Sadasivan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42062
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.11867

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Disposition Distillation at Small Scale: A Three-Arc Negative Result Hari Sadasivan Abstract We set out to train behavioral dispositions (self-verification, uncertainty acknowledgment, feedback integration) into small language models (0.6B to 2.3B effective parameters) through a four-stage all-MIT distillation pipeline, with follow-on experiments on inference-time attention-head interventions and a frozen-base confidence-gated sidecar. An internal draft reported + 33.9 +33.9 -point MCAS and + 15.3 +15.3 -point HumanEval gains on a Qwen3-0.6B student; a second-pass sanity check falsified both numbers before publication. The HumanEval delta was a truncation artifact ( n predict = 512 n_{\text{predict}}{=}512 ) that inverted to − 8.0 -8.0 points at n predict = 1024 n_{\text{predict}}{=}1024 ; the MCAS gain disappeared under apples-to-apples scoring. That falsification triggered three subsequent arcs. Across (1) SFT/DPO LoRA on three model families and two domains, (2) inference-time attention-head tempering on o proj o_{\text{proj}} , and (3) a training-free frozen-base sidecar reading the final-token hidden state 𝐡 last \mathbf{h}_{\text{last}} , we find no operator that moves judge-measured disposition without damaging content or collapsing into stylistic mimicry. The failure is consistent across five models (Qwen3-0.6B, Qwen3-1.7B, Qwen3.5-0.8B, Gemma 4 E2B, SmolLM2-1.7B-Instruct). A within-distribution cross-validation pass ( AUC = 0.683 \text{AUC}{=}0.683 ) collapsed to chance on fresh prompts ( AUC = 0.516 \text{AUC}{=}0.516 ). We contribute a three-arc negative result with mechanism, a two-failure-mode taxonomy for linear 𝐡 last \mathbf{h}_{\text{last}} probes, and an honest falsification pipeline that converts the class of false positives we ourselves produced into publishable negatives. As an independent finding, Gemma 4 E2B exhibits near-complete confidence-correctness decoupling on the Chef domain (assertion asymmetry − 0.009 -0.009 ; the model asserts at 91 % 91\% regardless of correctness). 1 Introduction The dominant paradigm for creating capable small language models is knowledge distillation [ Hinton et al.(2015) ] : train a large teacher, then train a smaller student to replicate its outputs. Recent work extends this to reasoning traces [ Hsieh et al.(2023) ] , self-play, and reinforcement learning from self-generated data [ Zelikman et al.(2022) ] . These approaches have shown substantial success in transferring what a model knows and, in some cases, aspects of how it reasons. A different question is whether a model’s behavioral disposition can be trained into weights at the same scale. By disposition we mean the tendency to check its work, acknowledge uncertainty, persist through difficulty, or engage adversarially with its own outputs. A model can achieve 70% on HumanEval [ Chen et al.(2021) ] while either producing confident answers without verification, or planning carefully, checking edge cases, and flagging uncertainty. The outputs may have the same accuracy, but the second model is more trustworthy in practice. This question matters for practitioners deploying small models on edge devices, for interpretability researchers probing behavioral properties, and for anyone building on the assumption that behavioral traits can be fine-tuned at small scale. Dispositions are currently achieved through system prompts (fragile, context-consuming), RLHF/DPO [ Rafailov et al.(2023) ] as safety side-effects (entangled, expensive), or external scaffolding such as the Darwin Gödel Machine [ Zhang et al.(2025) ] (inference-time compute, not portable to edge devices). We proposed a fourth approach: Disposition Distillation (DD) , training behavioral tendencies directly into weights through multi-teacher distillation with personality-differentiated teachers. Our first-pass evaluation of a Qwen3-0.6B [ Qwen Team(2025a) ] student trained on a 1,085-example four-stage all-MIT pipeline produced a +33.9 -point MCAS gain and a +15.3 -point HumanEval improvement. We drafted a paper around those numbers but held release pending a second-pass sanity check. That check falsified both headline numbers before any external publication. This paper is the first release of the work, and it reports the falsification directly alongside the three subsequent arcs the falsification triggered. This paper reports the full trajectory. We describe what we tried, what initially appeared to work, how the initial results fell apart under honest re-testing, and what the resulting three-arc negative tells us about the substrate small instruct-tuned LMs provide for behavioral editing. Figure 1: Arc 1 hook. Our first-pass evaluation on Qwen3-0.6B reported +15.3 HumanEval and +33.9 MCAS; these are the numbers the withheld draft was built around. Under honest re-evaluation at n_{\text{predict}}{=}1024 with apples-to-apples judge prompting, both results invert. The same four-stage pipeline applied to Qwen3-1.7B produces a -15.8 -point v2-harness regression driven by a training-distribution reasoning-compression failure. 1.1 Contributions 1. Three-arc negative result. Three independent operator classes (SFT/DPO imitation into weights, inference-time attention-head tempering, and training-free frozen-base \mathbf{h}_{\text{last}} sidecars) all fail to move judge-measured disposition without damaging content, across five models from 0.6B to 2.3B effective parameters, on the tested judge-based domains. 2. Two failure modes for linear \mathbf{h}_{\text{last}} probes. On judge-based domains, Gemma 4 E2B and SmolLM2-1.7B fail the same gate for orthogonal reasons: single output distribution (Gemma) versus capability cliff (SmolLM). We formalize the taxonomy and argue it is a property of the tested scale range on judge-based domains. 3. Confidence-correctness decoupling. On the Chef domain, Gemma 4 E2B asserts confidently at 91\% regardless of whether its content is correct or wrong (assertion asymmetry =-0.009 , n{=}100 , measured against an external gold checklist). Verbal delivery carries no information about content correctness on this domain and model. 4. Mechanism. At the tested scale, the residual stream at the final response token encodes stylistic closure rather than content truth-value. Judges read the output distribution, which varies with content; linear probes read the closure position, which does not. 5. Honest falsification pipeline. A five-step protocol (within-distribution CV, fresh-prompt held-out test, per-axis sweep, multi-layer pooling variant, cross-model replication) that catches CV-on-same-distribution false positives. 6. Full evaluation code and artifacts. All scripts, result JSONs, hidden-state features, and per-response labels are released under MIT license alongside this paper. 2 Related Work Distillation and behavioral transfer. Knowledge distillation [ Hinton et al.(2015) ] and its reasoning-trace variants [ Hsieh et al.(2023) ] transfer capability and reasoning. Recent multi-teacher methods transfer knowledge diversity. Our pipeline is multi-teacher in a behavioral rather than knowledge sense, with each teacher contributing a personality axis. That framing is untouched by our negative result; the claim the negative falsifies is that SFT/DPO on the resulting data moves the targeted disposition at small scale without damaging capability. Self-improving systems. The Darwin Gödel Machine [ Zhang et al.(2025) ] and related systems build external mechanisms for self-improvement at inference time. DD sought to internalize the tendency into weights. The negative result here does not falsify external-mechanism approaches; it falsifies the specific claim that the internalization is achievable with three standard operator classes at the tested scale range on judge-based domains. Activation steering and representation engineering. Activation Addition [ Turner et al.(2023) ] showed that adding steering vectors to the residual stream can modify behavior without weight changes. Representation Engineering [ Zou et al.(2023) ] extended this to reading and controlling internal representations via contrastive pairs. Rimsky et al. [ Rimsky et al.(2023) ] applied contrastive activation addition to behavioral steering in Llama 2. Our Arc 2 draws on this literature for head-level attribution. Our negative finding is that at the tested scale, the disposition signal is not localized to a small set of attention heads that can be individually tempered. Probing and interpretability. Linear probes on hidden states are widely used to decode model-internal concepts [ Belinkov(2022) ]

Read the complete text