Towards Understanding Multimodal Fine-Tuning: A Case Study into Spatial Features
Lachin Naghashyar, Hunar Batra, Ashkan Khakzar, Philip Torr, Ronald Clark, Christian Schroeder de Witt, Constantin Venhoff · 2026
Read Towards Understanding Multimodal Fine-Tuning: A Case Study into Spatial Features by Lachin Naghashyar, Hunar Batra, Ashkan Khakzar, Philip Torr, Ronald Clark, Christian Schroeder de Witt, Constantin Venhoff (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08713.txt.
Introduction
Vision-language models pair a vision encoder with a language model, but how the language backbone learns to see remains murky. Lachin Naghashyar and six co-authors present the first mechanistic analysis of that adaptation. Their arXiv paper uses stage-wise model diffing to isolate representational changes introduced during multimodal fine-tuning.
Vision-preferring features emerge or reorient during tuning, and a selective subset reliably codes spatial links, shown by controlled changes to spatial prompts. Tracing causal activation leads to a small group of attention heads. Readers learn when and where spatially grounded features arise, and how visual grounding reshapes previously text-only features. The method offers a foundation for refining multimodal training.
Catalog record
| CREATOR | Lachin Naghashyar, Hunar Batra, Ashkan Khakzar, Philip Torr, Ronald Clark, Christian Schroeder de Witt, Constantin Venhoff |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-08713
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Understanding Multimodal Fine-Tuning: A Case Study into Spatial Features Lachin Naghashyar, Hunar Batra, Ashkan Khakzar, Philip Torr, Ronald Clark, Christian Schroeder de Witt, Constantin Venhoff Abstract Contemporary Vision–Language Models (VLMs) achieve strong performance on a wide range of tasks by pairing a vision encoder with a pre-trained language model, fine-tuned for visual–text inputs. Yet despite these gains, it remains unclear how language backbone representations adapt during multimodal training and when vision-specific capabilities emerge. In this work, we present the first mechanistic analysis of VLMs adaptation process. Using stage-wise model diffing, a technique that isolates representational changes introduced during multimodal fine-tuning, we reveal how a language model learns to "see". We first identify vision-preferring features that emerge or reorient during fine-tuning. We then show that a selective subset of these features reliably encodes spatial relations, revealed through controlled shifts to spatial prompts. Finally, we trace the causal activation of these features to a small group of attention heads. Our findings show that stage-wise model diffing reveals when and where spatially-grounded multimodal features arise. It also provides a clearer view of modality fusion by showing how visual grounding reshapes features that were previously text-only. This methodology enhances the interpretability of multimodal training and provides a foundation for understanding and refining how pretrained language models acquire vision-grounded capabilities. 1 Introduction Large vision–language models (VLMs) have achieved strong performance on multimodal tasks, including visual question answering (VQA), image captioning, object detection, and visual grounding ( 25 ; 1 ) . These gains are typically realized by fine-tuning pretrained language models to process visual inputs through projected token sequences, allowing for seamless fusion of image and text representations ( 47 ; 49 ; 11 ; 10 ) . Yet we lack a mechanistic account of how language representations adapt during multimodal training and when vision-specific capabilities emerge ( 21 ; 44 ; 41 ) . In this work, we introduce a method for analyzing multimodal adaptation in VLMs through stage-wise model diffing ( 5 ) . This mechanistic interpretability technique isolates representational changes introduced during fine-tuning by comparing sparse autoencoder (SAE) dictionaries across training stages, models, or datasets. By tracking how features rotate, emerge, or are repurposed, it has been shown to uncover subtle shifts such as sleeper-agent features ( 18 ) . We extend this approach to the multimodal setting, presenting the first application of stage-wise model diffing to study how pretrained language features evolve under visual grounding. Concretely, we fine-tune LLaMA-Scope SAEs on activations extracted from the LLaVA-More model ( 17 ) on 50k VQAv2 dataset samples ( 15 ) . This warm-start preserves the original feature basis while adapting to multimodal activations. We isolate features that gain visual preference and undergo strong geometric rotation, serving as anchors for studying spatial representations in the backbone. To identify which adapted features encode spatial reasoning, we apply a controlled dataset shift from general VQA to spatial queries. Features that are preferentially recruited under spatial prompts form a selective subset, which we validate through automatic and manual interpretation. These features consistently activate on questions about object placement, relative position, and orientation. Figure 2 highlights the filtered spatial features. Finally, we use attribution patching to trace the causal pathways by which these spatial features are activated. Our results reveal a sparse set of mid-layer heads that consistently drive spatial representations, often localizing to semantically meaningful regions and reappearing across related prompts. These findings support the hypothesis that a small number of specialized attention heads coordinate visual grounding within the model. Our contributions are as follows: • We extend stage-wise model diffing to the multimodal setting, providing the first feature-level account of how pretrained language backbones adapt under visual grounding. • We introduce a systematic pipeline to isolate adapted features, identify those selectively recruited by spatial queries, and filter out lexical artifacts. • We show that these spatially selective SAE features are functionally involved in reasoning, through empirical evidence and ablation studies, supported by interpretive checks. • We causally attribute the emergence of spatial features to a small subset of attention heads using scalable attribution patching, highlighting structured pathways for visual grounding. By focusing on feature-level change, our approach complements high-level alignment analyses and probing-based methods, providing a deeper mechanistic view of how models “learn to see”. More broadly, this work offers a framework for auditing and refining multimodal training regimes, with implications for safety-critical domains and targeted fine-tuning in specialized applications. 2 Related Work Model Diffing and Representation Dynamics Model diffing techniques aim to isolate how internal representations change across models or training stages. Early work focused on coarse similarity measures, such as visualizing function-space geometry ( 36 ; 12 ) , stitching intermediate layers across models ( 24 ; 2 ) , or defining new similarity metrics ( 23 ; 3 ) . Later studies examined alignment at the level of individual neurons, showing convergent units across independently trained networks ( 26 ; 35 ) . Sparse autoencoders (SAEs) offered a feature-level lens, and prior work ( 22 ) showed that SAEs largely transfer between base and fine-tuned models, implying most features are preserved and only a minority are altered. This motivates methods that can isolate and precisely interpret those changes. Stage-wise model diffing ( 5 ) offers such fine-grained resolution, revealing sleeper-agent features and distinguishing between base and chat-tuned models ( 31 ) . Extensions to multimodal models highlight similar representational shifts, with concept-shift vectors proposed for steering ( 21 ) and evidence that alignment converges in middle-to-late layers ( 44 ) . These remain semantic-level analyses, whereas our work applies stage-wise diffing with SAEs to the backbone, giving the first mechanistic account of multimodal fine-tuning, showing how it rotates features and induces spatial grounding in pretrained language models. Multimodal Mechanistic Interpretability. Compared to the rapidly growing literature on mechanistic interpretability of textual LLMs, relatively few studies have examined the internal mechanisms of multimodal large language models (MLLMs). Existing work falls into two main categories. First, tool-based and causal analyses aim to explain model behavior at a high level. Approaches include interpretability toolkits based on attention patterns, relevancy maps, and causal interventions ( 41 ) . Other work uses interventions to trace how information is stored and transferred ( 4 ) , or applies causal mediation to study how BLIP integrates visual evidence ( 38 ) . Second, probing-based studies focus on the representations themselves. Several works analyzed CLIP, identifying both strengths and limitations ( 43 ; 13 ; 7 ) . Others reported multimodal neurons responsive to joint visual–textual concepts ( 40 ) and examined how VLMs differentiate hallucinated from real objects ( 19 ) . More recent methods map visual embeddings into linguistic space, projecting features onto language vocabularies ( 34 ) or showing the late emergence of visual signals in LLM backbones ( 45 ) . In contrast, these studies primarily analyze patterns, interventions, or probing correlations, but do not directly track how multimodal fine-tuning restructures the backbone’s internal features. Our work addresses this gap by providing a mechanistic perspective. 3 Preliminaries 3.1 Vision–Language Models A vision–language model (VLM) consists of a visual encoder f_{V} , a pretrained language model f_{\mathrm{LM}} , and a trainable projector P . The visual encoder