MIMIC: Multimodal Inversion for Model Interpretation and Conceptualization

Animesh Jain, Alexandros Stergiou · 2025

Read MIMIC: Multimodal Inversion for Model Interpretation and Conceptualization by Animesh Jain, Alexandros Stergiou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-07833.txt.

Introduction

Animesh Jain and Alexandros Stergiou build a way to see what a vision-language model is thinking by running its inner codes backward. Their paper appeared in two thousand twenty-five. These models blend images and text in vast, tangled networks. That tangle makes their choices hard to trust or check.

Their framework, MIMIC, turns internal codes back into pictures that show the concept the model holds. It lines up features across the model's step-by-step text output. Three added rules keep the pictures aligned, smooth, and real-looking. They test the method on free-form outputs of many lengths. Scores cover both picture quality and how well the meaning matches the words. The authors say no earlier inversion method tackled visual concepts in these models. Seeing inside is a step toward models people can audit.

Catalog record

CREATORAnimesh Jain, Alexandros Stergiou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-07833

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MIMIC: Multimodal Inversion for Model Interpretation and Conceptualization Animesh Jain, Alexandros Stergiou Abstract Vision Language Models (VLMs) encode multimodal inputs over large, complex, and difficult-to-interpret architectures, which limit transparency and trust. We propose a Multimodal Inversion for Model Interpretation and Conceptualization (MIMIC) framework to visualize the internal representations of VLMs by synthesizing visual concepts corresponding to internal encodings. MIMIC uses a joint VLM-based inversion and a feature alignment objective to account for VLM’s autoregressive processing. It additionally includes a triplet of regularizers for spatial alignment, natural image smoothness, and semantic realism. We quantitatively and qualitatively evaluate MIMIC by inverting visual concepts over a range of varying-length free-form VLM output texts. Reported results include both standard visual quality metrics as well as semantic text-based metrics. To the best of our knowledge, this is the first model inversion approach addressing visual interpretations of VLM concepts. Project page: https://anaekin.github.io/MIMIC I Introduction Vision-Language Models (VLMs) have demonstrated impressive capabilities in numerous tasks. Despite their ability to compositionally encode multiple modalities with complex architectures, their transparency and interpretability remain limited due to their entangled representations. Interpreting internal encodings helps assess whether models genuinely reason [ 1 , 2 , 3 ] or interpolate from memorized examples [ 4 , 5 ] . Given that each iteration of deep models increases complexity [ 6 ] , uncovering visual explanations for their decisions has been a central point for research. Methods have focused on visualizing image region attributions [ 7 , 8 ] , attention patterns and hidden activations [ 9 ] , tracing information flow, or editing representations in LLMs [ 5 , 10 , 11 , 3 ] . These methods, however, are primarily unimodal and rely on gradient access, auxiliary decoders, or architecture-specific modifications. In this paper, we address this interpretability gap by synthesizing visualizations of internal VLM representations with a Multimodal Inversion for Model Interpretation and Conceptualization (MIMIC) framework. MIMIC extends current unimodal inversion methods to autoregressive multimodal models to visualize their feature space. During training, we use an adversarial prompt to supervise the synthesis objective from the model’s generated answer. We additionally include a guidance objective to align the mean and variance of intermediate encodings with those computed from real images. Additional regularization terms promote spatial smoothness, consistency across patches, and alignment with natural image distributions. We validate the effectiveness of the synthesized images using a diverse set of evaluation metrics that capture classification accuracy, semantic alignment with textual prompts, perceptual similarity to real images, and distributional alignment. Our contributions are as follows: i) We propose a model inversion objective that can optimize adversarial prompts from varying-length text outputs. ii) We introduce MIMIC, a general approach for inverting VLMs, which, to the best of our knowledge, is the first attempt at synthesizing the conceptual representations of vision-language generative models. iii) We show that MIMIC can invert VLM concepts from text outputs of different lengths, synthesizing high-fidelity images. Fig. 1 : Multimodal Inversion for Model Interpretation and Conceptualization (MIMIC) synthesizes adversarial visual prompts optimized on VLM text outputs. The synthesized images represent the dominant visual features associated with semantic concepts. Fig. 2 : MIMIC inversion pipeline and synthesized concepts for goldfish , golden retriever , and corn . We optimize a noisy image using our proposed aggregated objective with an adapted cross-entropy loss \mathcal{L}_{SCE} based on a [target] textual concept and a base feature loss \mathcal{L}_{base} that matches the layer statistics for synthesized images and real images for [target] . Regularizers \mathcal{R} are added to promote semantic consistency, spatial coherence, and perceptual quality. II Related Work Feature attribution methods have been used to localize feature relevance within inputs. A set of methods is based on Class Activation Maps (CAM) [ 12 , 7 , 13 ] , which backpropagate the local activations of class-relevant regions in vision models. Other approaches have been based on pixel-level attributions, such as Layer-wise Relevance Propagation [ 14 ] , DeepLIFT [ 15 ] , and Integrated Gradients [ 8 ] to propagate relevance or gradient-based signals backwards through the network. Although attribution methods are widely used to explain CNN/ViT-based models for supervised tasks such as classification, detection, or regression, they cannot be directly applied to autoregressive multimodal models. In contrast to these approaches that localize feature attributions for classification, we offer a general approach to visualize internal representations of encoded visual concepts learned by VLMs. Model inversion methods [ 16 , 17 , 18 , 19 ] synthesize inputs to visually interpret encodings of models. Early approaches relied on Gradient Ascent (GA) to optimize images, to maximally activate specific neurons and reveal learned features [ 20 ] . Later methods also relied on generative priors [ 21 ] . More recently, [ 16 ] synthesized realistic images from ImageNet [ 22 ] classes by aligning batch normalization statistics, while [ 17 , 18 ] explicitly adapted gradient-based inversion to ViTs. [ 23 ] defined hierarchies of visual concepts, while [ 24 ] discovered interpretable features shared across architectures and datasets. Although these inversion techniques have significantly progressed the interpretability of vision-only models, their applicability to VLMs remains limited, which this paper addresses. V/LLM interpretability methods primarily aim to explain how model encodings relate to abstract concepts. [ 2 ] created text explanation pipelines for the hidden states of LLM layers. [ 3 ] expanded on this by allowing direct changes to hidden states at specific layers. Other approaches [ 5 , 1 ] focused on stored knowledge through interventions in the model’s internal structure with adapters [ 25 ] . Influence functions [ 4 ] have also estimated the influence of individual examples towards predictions. Recent works have explored interpretability in vision–language models through attention and gradient signals. Grad-ECLIP [ 10 ] visualized image and text tokens contributions based on CLIP similarity scores. NOTICE [ 11 ] studied image-grounding and object-level reasoning properties within cross-attention heads in BLIP. Second-Order Lens [ 26 ] ablated specific late-layer neurons in CLIP in relation to zero-shot accuracy. Similarly, [ 27 ] demonstrated the influence of intermediate layers in multimodal transformers towards global semantic features. Furthermore, [ 28 , 29 ] focused on MLP activations and their alignment towards concept-relevant features. Despite these recent efforts, model explanations for autoregressive generative vision-language models are sparse. We thus take a step forward from current approaches and focus on inverting VLMs to reconstruct concept-aligned images. Our method avoids modifying model weights, accessing gradients, or training auxiliary components, offering a stable and non-intrusive framework for visualizing internal representations. Optimization Objective Accuracy \uparrow IS \infty \uparrow FID \infty \downarrow IS \uparrow FID \downarrow LPIPS \downarrow CLIPScore \uparrow Top-1 Top-5 \mathcal{R}_{V} InceptionV3 MobileNetV2 Partial objectives Baseline ( \mathcal{L}_{SCE} ) 0.0 0.0 1.06 1.11 1.10 345.17 1.46 404.56 1.35 23.54 + Base Feature Loss ( \mathcal{L}_{base} ) 1.66 35.83 1.28 1.55 1.43 299.29 2.85 352.29 1.00 25.76 + Patch Regularizer \mathcal{R}_{patch} 15.83 56.66 1.45 2.32 1.71 280.65 3.88 286.22 0.95 27.21 + Prior Regularizer \mathcal{R}_{prior} 40.00 69.16 1.77 2.59 2.64 253.52 4.26 246.74 0.87 27.67 + Feat. Dist. Regularizer \mathcal{R}_{V} 30.83 53.33 1.53 3.01 3.67 280.20 3.78 330.84 0.77 25.46 Aggregated Objective 41.25 62.91 2.05 4.25 4.54 227.42 4.91 212.37 0.86 27.42 TABLE I : Image and semantic

Read the complete text