Linear Probe Accuracy Scales with Model Size and Benefits from Multi-Layer Ensembling

Erik Nordby, Tasha Pais, Aviel Parrack · 2026

Read Linear Probe Accuracy Scales with Model Size and Benefits from Multi-Layer Ensembling by Erik Nordby, Tasha Pais, Aviel Parrack (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13386.txt.

Introduction

Nordby, Pais, and Parrack study linear probes that detect when language models output claims they know are false. Single-layer probes are fragile, since the best layer shifts across models and tasks and some deception types defeat them entirely. Combining probes from many layers into an ensemble restores strong performance where single layers fail. Multi-layer ensembles lift AUROC by 29 percent on Insider Trading. On Harm-Pressure Knowledge the lift reaches 78 percent. Across 12 models, probe accuracy also grows with scale, by about 5 percent per tenfold parameter increase.

Catalog record

CREATORErik Nordby, Tasha Pais, Aviel Parrack
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35750
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.13386

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Linear Probe Accuracy Scales with Model Size and Benefits from Multi-Layer Ensembling Erik Nordby, Tasha Pais, Aviel Parrack Abstract Linear probes can detect when language models produce outputs they “know” are wrong, a capability relevant to both deception and reward hacking. However, single-layer probes are fragile: the best layer varies across models and tasks, and probes fail entirely on some deception types. We show that combining probes from multiple layers into an ensemble recovers strong performance even where single-layer probes fail, improving AUROC by +29% on Insider Trading and +78% on Harm-Pressure Knowledge. Across 12 models (0.5B–176B parameters), we find probe accuracy improves with scale: ∼ 5 % {\sim}5\% AUROC per 10 × \times parameters ( R = 0.81 R{=}0.81 ). Geometrically, deception directions rotate gradually across layers rather than appearing at one location, explaining both why single-layer probes are brittle and why multi-layer ensembles succeed. † † affiliationnotice: Equal contribution Figure 1 : Multi-layer ensembling separates deceptive from honest activations. A 5-layer ensemble on Llama 70B achieves +78% AUROC improvement on Harm-Pressure Knowledge, a task where single-layer probes fail. The visualization shows probe outputs projected to 3D via PCA, with honest (blue) and deceptive (red) samples. Misclassified samples (black outlines) cluster near the decision boundary, indicating errors occur on genuinely ambiguous cases rather than systematic failures. 1 Introduction Several recent papers have already shown that frontier language models will use deception or manipulation when placed in high stakes contexts ( 13 ) . Linear probes have been shown to outperform sparse autoencoders in downstream detection tasks ( 7 ; 16 ) . Moreover, there is evidence that probes trained in simple contrastive scenarios generalize to detect strategic deception in complex settings such as insider trading ( 8 ) . Subsequent work has evaluated the cost-effectiveness of these probes and their reliability in production settings ( 11 ) . However, the robustness of these methods is understudied. The Liars’ Bench ( 12 ) revealed that detector performance fluctuates considerably between different types of lies. Similarly, Smith et al. ( 15 ) identify three core challenges in deception-detection methodology. Given these successes and challenges, it is important to understand whether deception signals are a consistent property of LLM representations across models and deception contexts. Our main contribution is demonstrating that multi-layer ensembling recovers strong performance where single-layer probes fail, grounded in geometric analysis showing deception is encoded as a gradually-rotating feature across layers. We also provide a systematic evaluation across 12 models and three families, finding that detection scales with model size but varies substantially across deception types. The key challenge we address is that prior work either evaluates probes on single models ( 8 ) or finds inconsistent cross-task results ( 12 ) . We show that neither single-layer probes nor fixed-depth heuristics work universally, but the underlying representational structure enables ensembling as a principled solution. 2 Related Work 2.1 Deception in Large Language Models Multiple studies document LLMs’ capacity for deception ( 13 ; 14 ) . The definitions of deception used by these various papers vary along key axes. Some emphasize intentional manipulation of beliefs for instrumental goals ( 3 ) , while others focus on asserting believed-false statements regardless of intent ( 12 ) . For the purposes of this paper, we adopt deception to classify outputs where a model produces statements that contradict information it would produce under normal, non-adversarial conditions. This includes role-played lies, strategic omissions, and responses which achieve instrumental goals through manipulation. 2.2 Linear Probes for Deception Detection Our work builds on recent advances in activation-based deception detection. Zou et al. ( 17 ) introduced Representation Engineering (REPE), demonstrating that linear probes can extract high-level features like honesty from model activations using contrastive prompt pairs. Goldowsky-Dill et al. ( 8 ) extended this approach to strategic deception, training probes on simple roleplaying scenarios and testing generalization to complex multi-turn settings. Their probes achieved AUROCs between 0.96–0.999 on evaluation datasets. Notably, recent work shows that linear probes outperform sparse autoencoders (SAEs) on downstream detection tasks ( 7 ; 16 ) , motivating our focus on linear methods rather than more complex feature extraction approaches. Subsequent work has revealed important limitations. Kretschmar et al. ( 12 ) introduced Liars’ Bench, a systematic evaluation across five deception types, finding significant performance variation across types of deception. Notably, their mean linear probe achieved only 0.54 balanced accuracy on several datasets (including High Pressure Choice and High Pressure Knowledge which we test), suggesting fundamental limitations in single-layer probing approaches. Similarly dataset leakage issues ( 1 ) have been posed which indicate probes may be finding elicitation artifacts rather than underlying deceptive patterns. More fundamentally, Smith et al. ( 15 ) identify three core challenges in the evaluation of deception probes: distinguishing strategic deception from lower-level conditioned responses that merely appear deceptive, determining whether models instructed to roleplay as deceptive characters possess genuine deceptive intent, and the possibility that prompts modify model beliefs rather than induce lying, meaning apparent contradictions may reflect honest responses under different beliefs. Our work addresses some of these concerns by evaluating across diverse deception types and focusing on relative improvements rather than absolute claims. 2.3 Linear Representations The assumption that features are linearly represented in activations is central to mechanistic interpretability. Gorton ( 9 ) argues the transformer’s additive residual stream structure favors linear representations, supported by empirical findings that magnitude-based superposition appears only in small models ( 5 ) . For deception specifically, Bürger et al. ( 2 ) find that larger models exhibit more distinct and linearly separable deception representations, motivating our scaling analysis. 2.4 Multi-Layer Analysis REPE ( 17 ) addresses multi-layer steering but not detection ensembling. Constitutional Classifiers++ ( 6 ) ensembles probes with external classifiers for jailbreak detection. Work on hallucination detection ( 4 ) leverages layer selection, but principled multi-layer ensembling for deception detection remains unexplored. 3 Methods 3.1 Models We evaluate 12 open-weights models across three families: Llama (1B, 3B, 8B, 70B), Qwen (0.5B, 3B, 14B, 72B), and Mistral (7B, NeMo 12B, Small 24B, Mixtral 8x22B). All share core architectural choices (RMSNorm, RoPE, SwiGLU, GQA). Mixtral uses Mixture of Experts but performed comparably to dense models, suggesting residual stream aggregation provides sufficient signal regardless of expert routing. 3.2 Probing Methodology For each model and layer, we train a standard L2-regularized logistic regression probe using scikit-learn. Training proceeds as follows: 1. Extract activations : For each dialogue, we extract the residual stream activations at positions marked by the dataset’s detection mask (the span containing deceptive/honest content). 2. Standardize : Activations are standardized to zero mean and unit variance across the training set. 3. Fit logistic regression : We train sklearn.LogisticRegression with C=0.1 (equivalently, \lambda=10 L2 penalty) and no intercept, following prior work ( 10 ; 12 ) . 4. Score : At inference, we compute the dot product between the standardized activation and the learned weight vector. Higher scores indicate predicted deception. Probes are trained independently at each layer. We evaluate using AUROC: the probability that a randomly chosen deceptive sample scores higher than a randomly chosen honest sample. Our implementation builds on the codebase from 8 . 1 1 1 https://github.com/ApolloResearch/deception-detection 3.3 Datasets Training: We use the

Read the complete text