Uncovering the Latent Potential of Deep Intermediate Representations
Arnesh Batra, Arush Gumber, Aniket Khandelwal, Jashn Khemani, Anubha Gupta · 2026
Read Uncovering the Latent Potential of Deep Intermediate Representations by Arnesh Batra, Arush Gumber, Aniket Khandelwal, Jashn Khemani, Anubha Gupta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23033.txt.
Introduction
Batra and four coauthors show that task-relevant information in pretrained models is spread non-monotonically across layers, not confined to the final layer. Using only the last layer or shallow mixtures therefore misses structure that naive aggregation cannot recover. Their Layer-wise Optimal Embedding Selection method picks task-discriminative subspaces by a spectral rule under orthogonality and isotropy constraints. A Geometric Regularization Loss further enforces simplicial structure on class manifolds during fine-tuning. Gains grow with model depth.
Catalog record
| CREATOR | Arnesh Batra, Arush Gumber, Aniket Khandelwal, Jashn Khemani, Anubha Gupta |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 118360 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.23033
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Uncovering the Latent Potential of Deep Intermediate Representations Arnesh Batra, Arush Gumber, Aniket Khandelwal, Jashn Khemani, Anubha Gupta Abstract Foundational Models pretrained on huge amount of data learn representations that evolve across depth, forming a hierarchy of embeddings with distinct semantic content and geometric structure. Contrary to the widespread practice of using only the final layer or shallow mixtures, we show that task-relevant information is distributed non-monotonically across layers and cannot be recovered by naïve aggregation. Through a geometric and empirical study across multiple modalities, we show that effective transfer depends on identifying which layers encode task-discriminative structure and how their embeddings are geometrically organized. We introduce Layer-wise Optimal Embedding Selection (LOES), a constructive spectral method that identifies task-discriminative subspaces by minimizing residual error under orthogonality and isotropy constraints. To align fine-tuning with this selection principle, we further propose Geometric Regularization Loss (GeoReg), which enforces a simplicial structure on class manifolds and stabilizes representation geometry during fine-tuning. Across a wide range of architectures, depths, modalities, and data regimes, LOES consistently outperforms standard baselines, with gains that grow as model depth increases. Beyond accuracy, our method reveals how semantic factors are distributed across layers, thereby enabling cross-lingual and cross-modal interpretability analyses. Together, our results provide strong evidence that layerwise embedding geometry is not incidental but central to how deep models represent and transfer knowledge. Figure 1 : Standard vs. LOES-based transfer learning: (a) conventional transfer learning uses a single encoder layer, typically the final layer, for downstream prediction, whereas (b) LOES selects and fuses multiple task-relevant layers from the encoder hierarchy using target supervision, enabling transfer that exploits complementary information across layers. 1 Introduction While foundational models ( 4 ; 22 ; 29 ; 50 ; 55 ) define state-of-the-art transfer learning, standard adaptation protocols typically rely on the final layer output under the assumption that semantic utility increases monotonically with depth. Recent empirical analyses challenge this view, demonstrating that intermediate layers ( 65 ; 52 ; 1 ) frequently outperform the final representations by up to 10% in downstream tasks. This phenomenon occurs because the final layers often specialize overly to pretraining objectives like next-token prediction or suffer from representation collapse. In autoregressive language models specifically, a “compression valley” ( 54 ; 43 ) emerges in mid-depth layers where the network optimally balances signal retention with noise suppression. Similar patterns are observed in vision transformers ( 23 ) , suggesting this to be a domain-general property driven by optimization dynamics rather than data modality. To effectively recover this information, we argue that one must identify the optimal task-specific subspace formed by the top-k discriminative layers regardless of their depth. To this end, we introduce Layer-wise Optimal Embedding Selection (LOES) , a constructive spectral framework for subspace approximation. LOES (Figure 1 ) formulates layer selection as a ridge-residual optimization problem constrained by orthogonality and isotropy. By analyzing the eigenspectrum of layer-wise representations, our method systematically identifies orthogonal combinations of embeddings that maximize separability. To prevent feature collapse during the subsequent adaptation, we complement this selection with Geometric Regularization ( GeoReg ), which is an auxiliary loss that enforces a simplicial topology on the class manifolds. Our contributions are as follows: • We demonstrate that the optimal representations for downstream tasks are rarely the final layer alone but rather a task-specific subspace formed by a subset of intermediate layers. • We propose LOES , a spectral algorithm that identifies optimal layer combinations by minimizing residual error under geometric constraints. This method outperforms learnable weighting baselines by explicitly constructing subspaces with high effective rank and low anisotropy. • By analyzing the layer selection preferences of LOES , we provide a new lens for interpretability that reveals exactly where different foundational models encode specific semantic or structural attributes. • Our analysis demonstrates that performance gains scale with model depth, and that these effects are modality- and data-agnostic working across a variety of foundational model architectures and pretraining techniques. • We also introduce GeoReg , a loss function that improves stability in fine-tuning settings, mitigating feature collapse often observed in large-scale models. 2 Related Works 2.1 Suboptimality of Final Layer Embeddings Research across modalities suggests that final-layer embeddings are not universally optimal. In LLMs, “Concept Depth” indicates that while shallow layers handle simpler tasks, deeper layers are required for complex abstractions ( 34 ) . Studies have shown that mid-depth layers often encode robust features, challenging the usual emphasis on final layer representations ( 39 ; 26 ) . Similarly, in vision and multi-modal encoders, final-layer features are often suboptimal for downstream tasks when the model is trained on proxy or self-supervised objectives. Studies using image colorization as a pretraining task ( 74 ; 75 ) found middle layers more effective for classification. This trend persists in autoregressive models like iGPT ( 15 ) and AIMv1 ( 24 ) , as well as video models like Toto ( 57 ) , where intermediate layers excel in classification, tracking, and robotics. 2.2 Interpretability and Representational Dynamics Researchers have introduced linear probes to monitor layer-wise classification suitability, noting monotonic increases in separability with depth ( 1 ) . Techniques such as SVCCA ( 56 ) enable cross-layer comparisons, showing that networks typically converge bottom-up. While BERT’s ( 22 ) hierarchy often mirrors classical NLP pipelines ( 21 ) . Recent spectral analyses identify three distinct geometric phases: warmup, entropy-seeking, and compression that define representational evolution during pretraining ( 43 ) . Saponati et al. ( 61 ) present a theoretical analysis of how different pretext tasks, such as next-token prediction and masked language modeling, influence the structure of learned representations. 2.3 Performance Metrics for Intermediate Representations Metrics like RankMe ( 28 ) uses effective rank as an unsupervised performance indicator, while LevyScore ( 45 ) assesses confidence via pretraining density deviations. Layer by Layer ( 65 ) presents an information-theoretic and geometric framework which explains why mid-depth representations often outperform final layers, a property leveraged by Perception Encoder ( 11 ) through specialized intermediate alignment. Motivated by closed-form optimization approaches ( 9 ) and recent findings suggesting that embeddings approaching an isotropic Gaussian distribution yield lower downstream prediction risk ( 5 ) , our algorithm aims to select the most effective layers for a downstream task mainly by leveraging closed-form ridge regression to predict residuals and encouraging isotropy in the resulting representations. 3 Methodology We propose a unified framework that challenges the assumption of a single task-optimal layer by explicitly modeling the encoder as a hierarchy of candidate representation subspaces. Our approach consists of two coupled components: (1) a Layer-wise Optimal Embedding Selection (LOES) algorithm (Algorithm 1 ) that approximates the task-optimal subspace via spectral-ridge minimization, and (2) Geometric Regularization (GeoReg) as an auxiliary objective that aligns the training dynamics with the topological requirements of LOES while fine-tuning. 3.1 Preliminaries and Problem Formulation Consider a foundational encoder f_{\theta}(\cdot) that maps an input x to a sequence of L hierarchical representations \mathcal{H}=\{h^{(1)},h^{(2)},\dots,h^{(L)}\} , where h^{(\ell)}\in\mathbb{R}^{d_{\ell}} . Standard transfer learning typically utilizes a projection on the final layer \hat{y}=Wh^{(L)} , or a learned scalar combination \hat{y}=W(\sum_{\ell}\alpha_{\ell}h^{(\ell)}) ( 73 ; 21 ; 53 ; 17 ; 1 ) . Standard transfer learning restricts adaptation to the final-layer basis, assuming that