Concept-Centric Token Interpretation for Vector-Quantized Generative Models

Tianze Yang, Yucheng Shi, Mengnan Du, Xuansheng Wu, Qiaoyu Tan, Jin Sun, Ninghao Liu · 2025

Read Concept-Centric Token Interpretation for Vector-Quantized Generative Models by Tianze Yang, Yucheng Shi, Mengnan Du, Xuansheng Wu, Qiaoyu Tan, Jin Sun, Ninghao Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00698.txt.

Introduction

Tianze Yang and co-authors introduce CORTEX in a 2025 paper on explaining image-making models. Some models build images from a book of discrete tokens, picking and joining tokens to form a picture. Users have had little way to know which tokens matter for a given idea, such as a cat or a car, in the final image.

CORTEX works at two levels: it scores tokens in single images, and it scans the whole token book for tokens tied to an idea across images. Tests on several trained models gave clearer accounts of token use than older methods. The authors say the tool can also help with aimed edits to images and with spotting shortcut traits that a model may lean on in place of real content.

Catalog record

CREATORTianze Yang, Yucheng Shi, Mengnan Du, Xuansheng Wu, Qiaoyu Tan, Jin Sun, Ninghao Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00698

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Concept-Centric Token Interpretation for Vector-Quantized Generative Models Tianze Yang, Yucheng Shi, Mengnan Du, Xuansheng Wu, Qiaoyu Tan, Jin Sun, Ninghao Liu Abstract Vector-Quantized Generative Models (VQGMs) have emerged as powerful tools for image generation. However, the key component of VQGMs—the codebook of discrete tokens—is still not well understood, e.g., which tokens are critical to generate an image of a certain concept? This paper introduces C oncept- Or iented T oken Ex planation (CORTEX), a novel approach for interpreting VQGMs by identifying concept-specific token combinations. Our framework employs two methods: (1) a sample-level explanation method that analyzes token importance scores in individual images, and (2) a codebook-level explanation method that explores the entire codebook to find globally relevant tokens. Experimental results demonstrate CORTEX’s efficacy in providing clear explanations of token usage in the generative process, outperforming baselines across multiple pretrained VQGMs. Besides enhancing VQGMs transparency, CORTEX is useful in applications such as targeted image editing and shortcut feature detection. Our code is available at https://github.com/YangTianze009/CORTEX . † † affiliationnotice: Equal contribution 1 Introduction Figure 1: Token-based analysis reveals racial bias in generative models. While the model can generate both white and black doctors when explicitly prompted (top, middle), neutral prompts (bottom) show a systematic bias. CORTEX quantifies this bias through token analysis, showing white doctor-associated tokens appear nearly 4 times more frequently (8.55 vs 2.32 tokens per image). Vector-Quantized Generative Models (VQGMs) have become powerful tools for high-quality image generation using discrete latent space representations ( Ramesh et al. 2021 ; Esser et al. 2021 ; Yu et al. 2021 ; Jin et al. 2023 ; Tian et al. 2024 ) . Despite their success, these models often exhibit concerning behaviors (e.g., showing demographic disparities in professional representation, as Fig. 1 demonstrates). Understanding these issues requires interpreting how VQGMs internally represent and process concepts. A critical component of these models is the codebook ( Esser et al. 2021 ) , which acts as a learned dictionary of visual elements. This codebook stores a finite set of discrete tokens, each representing various patterns or features within an image. However, not all tokens contribute equally to the generation of a particular concept (e.g., object categories or visual attributes), leading to the need for methods that can distinguish between concept-relevant and background tokens. Improving the interpretability of these token-concept relationships can help identify potential biases in the model’s representations and enable precise control through targeted image editing. Given any user-interested concept, our goal is to select tokens from the codebook whose combination can best represent it. A straightforward approach to token interpretation is to select tokens that frequently appear in images generated for a specific concept ( Blei et al. 2003 ) . However, this method often selects tokens that represent contextual or background elements, resulting in explanations cluttered with irrelevant information. This inability to differentiate between essential and non-essential tokens hinders a clear understanding of how the model represents concepts. To address this issue, we draw on the Information Bottleneck principle ( Tishby et al. 2000 ) , which focuses on compressing input data while retaining the most relevant information for a given label. In the context of VQGMs, we apply this principle to train an Information Extractor , a module that maps image tokens back to semantic labels—reversing the information flow of generative models which typically map semantic descriptions to images. Based on this, we propose CORTEX ( C oncept- Or iented T oken Ex planation) to interpret VQGMs, which utilizes the Information Extractor to understand the relation among the codebook, generated images, and visual concepts. CORTEX comprises two complementary methods: a sample-level explanation method that analyzes individual token importance in generated images, and a codebook-level explanation method that explores how codebook tokens are combined to represent specific concepts. By systematically identifying the most critical tokens and filtering out non-essential information through the Information Extractor, CORTEX provides clear, interpretable explanations of how VQGMs represent and generate specific concepts. Experimental results demonstrate the effectiveness of CORTEX through comprehensive evaluation using various pretrained classification models, including ResNet and Vision Transformer variants. Our sample-level explanation method reveals consistent patterns of concept-relevant tokens in generated images, while the codebook-level explanation method extends this understanding by discovering fundamental token combinations that characterize each concept. Together, these methods enhance the transparency and controllability of VQGMs, providing valuable insights into the model’s internal representations and offering practical tools for downstream generative tasks such as precise image editing, as well as identifying potential biases in model representations (e.g., revealing how tokens associated with white doctors appear more frequently than those of black doctors even with a neutral prompt, as shown in Figure 1 ). Our main contributions are summarized as follows: • We develop a sample-level explanation method that identifies concept-relevant token combinations across generated images, providing initial insights into how VQGMs represent visual concepts. • We further introduce an codebook-level explanation method that extends our analysis to the entire codebook space, utilizing the same Information Extractor to discover fundamental token combinations that characterize specific concepts. • Our experiments validate the effectiveness of our framework in enhancing VQGMs interpretability and enabling applications such as precise image editing and bias identification. Figure 2: CORTEX has three components: an Information Extractor module and two explanation methods. The sample-level explanation method identifies concept-relevant tokens for each individual image, and the codebook-level explanation method optimizes token combinations that represent the concept. 2 Problem Statement 2.1 Vector-Quantized Generative Models Vector-Quantized Generative Models (VQGM) ( Ramesh et al. 2021 ; Esser et al. 2021 ; Yu et al. 2021 ; Jin et al. 2023 ) generate images via decoding from discrete tokens. These models are typically designed for conditional generation and are capable of generating images based on given text descriptions or class labels. During the image generation process, these models typically consist of three parts: a codebook that stores token information, a transformer-based predictor that predicts tokens based on the codebook and the concepts, and a decoder that decodes tokens into images. Let G be a VQGM with a codebook \mathcal{C}\in\mathbb{R}^{K\times d}=[t_{0},\ldots,t_{K-1}]^{\top} , where K is the total number of unique tokens, and t_{i}\in\mathbb{R}^{d} is a d -dimensional vector representing the token i . The codebook is pretrained on a large volume of image data to encode a diverse set of visual elements ( Esser et al. 2021 ) . The codebook maps continuous high-dimensional visual features into discrete tokens by serving as a look-up table. When generating an image, the model first uses its transformer predictor to predict a sequence of m^{2} tokens according to the input concept. It then looks up each token’s corresponding vector in the codebook. These vectors are arranged into a new matrix \mathbf{E}\in\mathbb{R}^{d\times m\times m} , which are called token-based embeddings . More details on how these token-based embeddings are extracted from the codebook can be found in Appendix A.1 . Finally, the decoder maps this embedding \mathbf{E} into an H\times H image. 2.2 Problem Definition Given a pretrained VQGM with a codebook \mathcal{C}\in\mathbb{R}^{K\times d}=[t_{0},\ldots,t_{K-1}]^{\top} , our goal is to find token-based explanations \mathcal{T}^{*}=\{\mathcal{T}^{*}_{1},\mathcal{T}^{*}_{2},...,\mathcal{T}^{*}_{n}\} for a set of concepts of interest Y=\{y_{1},y_{2},...,y_{n}\} , where each \mathcal{T}^{*}_{i}\subset\mathcal{C} corresponds to y_{i} . Each concept y_{i}\in Y represents a certain aspect of

Read the complete text