The Confidence Manifold: Geometric Structure of Correctness Representations in Language Models Seonglae Cho, Zekun Wu, Kleyton Da Costa, Adriano Koshiyama Abstract When a language model asserts that “the capital of Australia is Sydney,” does it know this is wrong? We characterize the geometry of correctness representations across 9 models from 5 architecture families. The structure is simple: the discriminative signal occupies 3–8 dimensions, performance degrades with additional dimensions, and no nonlinear classifier improves over linear separation. Centroid distance in the low-dimensional subspace matches trained probe performance (0.90 AUC), enabling few-shot detection: on GPT-2, 25 labeled examples achieve 89% of full-data accuracy. We validate causally through activation steering: the learned direction produces 10.9 percentage point changes in error rates while random directions show no effect. Internal probes achieve 0.80–0.97 AUC; output-based methods (P(True), semantic entropy) achieve only 0.44–0.64 AUC. The correctness signal exists internally but is not expressed in outputs. That centroid distance matches probe performance indicates class separation is a mean shift, making detection geometric rather than learned. https://github.com/seonglae/confidence-manifold 1 Introduction Large language models produce confident-sounding outputs regardless of factual accuracy ( 31 ; 12 ) . A model may assert falsehoods with the same linguistic certainty as truths, undermining deployment in high-stakes domains. Prior work established that LLMs encode truth-related signals in their activations ( 2 ; 5 ; 23 ) , but treated this signal as a single direction to find and exploit. The underlying geometric structure (how many dimensions encode this signal, whether it admits simple decision boundaries, and what minimal representations suffice) remained uncharacterized. Figure 1 : Layer-wise evolution across 9 models. (a) Detection performance peaks at different depths: GPT-2 family at final layers (100%), instruction-tuned models at mid-layers (43–75%). (b) Intrinsic dimension decreases through layers, converging to 8–12D at optimal layers. We characterize the geometry of correctness representations in transformer activations (Figure 1 ). Analyzing 9 models from 5 architecture families, we find the discriminative signal is simple: it occupies 3–8 dimensions, performance decreases with additional dimensions, and no nonlinear classifier (convex hull, Mahalanobis, kernel SVM) improves over linear probes. The optimal decision boundary is a hyperplane; complex boundaries model structure that does not exist. Prior work established that linear truth directions exist ( 23 ) ; we characterize what they did not: (i) discriminative rank is 3–8D, (ii) adding dimensions hurts , (iii) centroid distance matches trained probes, and (iv) this structure is consistent across 9 models from 5 architecture families. This simplicity enables a practical method. Class separation is driven by a mean shift between correct and incorrect distributions: centroid distance matches probe performance (0.90 AUC), requiring only two mean vectors rather than discriminative training. On GPT-2, centroid-based detection with 25 labeled examples achieves 89% of full-data performance. We validate causally via activation steering. The learned direction produces monotonic, 10.9 percentage point changes in error rates; random and orthogonal directions show no effect. Internal probes achieve 0.80–0.97 AUC (GroupKFold CV, 3 seeds) while output-based methods achieve only 0.44–0.64 AUC; the correctness signal exists internally but is not expressed in outputs ( 28 ) . Uncertainty \neq correctness : semantic entropy achieves only 0.55 AUC because models confidently assert misconceptions. 2 Background Linear Representation Hypothesis. Neural networks encode semantic concepts as linear directions in activation space ( 24 ; 29 ) . The classic arithmetic \vec{v}_{\text{king}}-\vec{v}_{\text{man}}+\vec{v}_{\text{woman}}\approx\vec{v}_{\text{queen}} extends to abstract features in transformers ( 26 ; 23 ) . For concept c , direction \mathbf{w}_{c} enables both extraction ( \mathbf{h}^{\top}\mathbf{w}_{c} correlates with c ) and intervention (adding \alpha\mathbf{w}_{c} steers behavior). This extends to truth ( 5 ; 23 ) and internal states ( 2 ; 36 ; 34 ) . Recent work shows LLMs encode more truthfulness information than they express in outputs ( 28 ) , and confidence regulation involves specific neural mechanisms ( 35 ) . While prior work establishes the existence of such signals, none characterize the geometric structure : how many dimensions encode correctness, whether nonlinear boundaries help, and why centroid-based methods match trained classifiers. We provide this characterization across 9 models. Uncertainty vs. Correctness. Token entropy H(p)=-\sum_{i}p_{i}\log p_{i} conflates linguistic and epistemic uncertainty. Semantic entropy ( 16 ; 8 ) addresses this by clustering N generations by meaning via NLI, computing entropy over clusters. While effective for uncertainty estimation, it requires N forward passes plus NLI inference. Critically, calibration evolves across layers with a low-dimensional direction in the residual stream ( 14 ) , but distributional certainty alone is insufficient: models can be confidently wrong on TruthfulQA’s misconception-laden questions. Semantic entropy probes ( 11 ) predict SE efficiently but inherit its limitation of measuring uncertainty rather than correctness. Activation Steering. Inference-time intervention modifies activations: \mathbf{h}^{\prime}=\mathbf{h}+\alpha\mathbf{w} ( 19 ; 42 ) . Contrastive activation addition ( 32 ) and representation engineering ( 47 ) demonstrate behavioral control for honesty and safety. Adaptive steering ( 43 ) adjusts intervention strength per-sample based on predicted uncertainty. We use steering for causal validation: verifying learned directions affect outputs, not merely correlate. Sparse Autoencoders. SAEs decompose activations into sparse, interpretable features ( 4 ; 6 ) : \mathbf{f}=\text{ReLU}(\mathbf{W}_{\text{enc}}\mathbf{h}+\mathbf{b}) , \hat{\mathbf{h}}=\mathbf{W}_{\text{dec}}\mathbf{f} . Scaling to production models ( 40 ; 20 ) enables feature-level analysis. However, recent work shows dense SAE latents (not sparse) capture entropy regulation ( 37 ) , and SAEs are suboptimal for certain steering tasks ( 1 ) . Task-specific SAE training ( 15 ) or alternative decomposition methods ( 22 ; 7 ) remain promising directions. We compare SAE-based detection against raw probes. Problem Setting. Given question q and response sentences \{s_{1},\ldots,s_{n}\} , predict factual correctness y_{i}\in\{0,1\} for each s_{i} from hidden state \mathbf{h}_{i}^{(\ell)} , enabling fine-grained factuality assessment ( 25 ) . Goals: (1) efficient single-pass inference, (2) accurate improvement over entropy baselines, (3) causal validation via intervention. 3 Method Our framework extracts, characterizes, and validates the confidence manifold through four components: contrastive data construction, direction learning, geometric analysis, and causal validation. We use “confidence” to denote the model’s internal representation of correctness, not output-level uncertainty; a model may produce low-entropy outputs while encoding that the response is likely incorrect. Formulation. We hypothesize that transformers encode correctness in a low-dimensional subspace \mathcal{M}\subseteq\mathbb{R}^{d} of the residual stream satisfying: (1) projection onto \mathcal{M} predicts correctness, (2) intervention along \mathcal{M} causally affects outputs, (3) \mathcal{M} has consistent structure across layers/models. 3.1 Data Construction and Direction Learning Contrastive pairs. TruthfulQA provides paired correct/incorrect answers per question ( 21 ) , yielding \{(\mathbf{h}^{+}_{i},\mathbf{h}^{-}_{i})\}_{i=1}^{N} controlling for topic and difficulty. Each pair shares the same question stem, isolating the correctness signal from content variation. We extract hidden states from the last token position ( 10 ; 3 ) across all L layers. Probe training. Logistic regression with L_{2} regularization ( C =0.1): p(y\!=\!1|\mathbf{h})=\sigma(\mathbf{w}^{\top}\mathbf{h}+b) , trained with cross-entropy loss plus L_{2} penalty. The learned \mathbf{w}^{(\ell)} is the confidence direction at layer \ell . We supervise on correctness labels directly , not entropy proxies, a choice validated by semantic entropy’s failure to predict correctness (§ 5 ). 3.2 Geometric Analysis We distinguish two notions of dimensionality: Intrinsic dimension (representation geometry). The Levina-Bickel MLE estimator ( 17 ) measures the dimensionality of the data manifold itself: for each point \mathbf{x}_{i} with k -nearest neighbors at distances T_{1}<\cdots