Vector-Quantized Discrete Latent Factors Meet Financial Priors: Dynamic Cross-Sectional Stock Ranking Prediction for Portfolio Construction

Namhyoung Kim, Jae Wook Song · 2026

Read Vector-Quantized Discrete Latent Factors Meet Financial Priors: Dynamic Cross-Sectional Stock Ranking Prediction for Portfolio Construction by Namhyoung Kim, Jae Wook Song (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13407.txt.

Introduction

Namhyoung Kim and Jae Wook Song introduce PRISM-VQ, a dynamic factor framework for ranking stocks by predicted returns. Classical factor models are interpretable but rigid. Their model combines expert prior factors with discrete latent factors learned by vector quantisation. Vector quantisation compresses cross-sectional structure into codes and acts as a noise-suppressing bottleneck. A mixture-of-experts layer then supplies loadings that vary over time. Tests on the CSI 300 and S and P 500 show gains over strong baselines.

Catalog record

CREATORNamhyoung Kim, Jae Wook Song
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70466
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13407

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Vector-Quantized Discrete Latent Factors Meet Financial Priors: Dynamic Cross-Sectional Stock Ranking Prediction for Portfolio Construction Namhyoung Kim, Jae Wook Song Abstract Predicting cross-sectional stock returns is challenging due to low signal-to-noise ratios and evolving market regimes. Classical factor models offer interpretability but limited flexibility, while deep learning models achieve strong performance yet often underutilize financial priors. We address this gap with PRISM-VQ ( PR ior- I nformed S tock M odel with V ector Q uantization), a dynamic factor framework that integrates expert prior factors, vector-quantized discrete latent factors learned from cross-sectional structure, and a structure-conditioned Mixture-of-Experts to generate time-varying factor loadings. Vector quantization acts as an information bottleneck that suppresses noise while capturing robust market structure, with discrete codes serving both as latent factors and as routing signals for temporal expert specialization. Experiments on CSI 300 and S&P 500 show consistent improvements in cross-sectional return prediction and portfolio performance over strong baselines while preserving interpretability. Our code is available at https://github.com/finxlab/PRISM-VQ . 1 Introduction Predicting cross-sectional stock returns remains a fundamental challenge at the intersection of finance and machine learning due to persistently low signal-to-noise ratios (SNRs), complex cross-asset dependencies, and frequent regime shifts 15 ; 33 . Classical linear factor models 24 ; 11 ; 12 provide strong interpretability through economically grounded factors and loadings, but their limited expressiveness restricts their ability to capture nonlinear interactions and time-varying dynamics. This limitation has contributed to the proliferation of the so-called “factor zoo” 7 , highlighting the difficulty of robust factor discovery. Recent neural approaches to cross-sectional return prediction largely fall into two categories. Factor-based methods integrate neural networks within factor model structures. Autoencoder-based approaches 13 ; 9 ; 17 learn latent factors via reconstruction objectives, but their reliance on continuous latent representations often provides insufficient regularization under low-SNR conditions and struggles with temporal non-stationarity. In contrast, architecture-centric deep learning methods employ modern sequence models such as Transformers 32 ; 20 ; 2 to model spatio-temporal dependencies directly from data. Despite their expressive power, these models typically lack explicit structural priors, which reduces robustness under distribution shifts and limits interpretability. Figure 1: Overview of the PRISM-VQ framework. Like a prism separating light, PRISM-VQ decomposes cross-sectional market structure using discrete vector quantization. Across prior work, three recurring limitations emerge: (1) insufficient regularization of continuous latent representations in noisy environments; (2) structure-agnostic temporal modeling that fails to condition on evolving cross-sectional structure; and (3) underutilization of domain priors , where established financial knowledge is weakly exploited despite its stabilizing potential. To address these limitations, we propose PRISM-VQ ( PR ior- I nformed S tock M odel with V ector Q uantization), a unified framework for cross-sectional stock return prediction that integrates discrete representation learning, structure-conditioned temporal modeling, and domain-informed priors within a factor-based interpretation (Figure 1 ). PRISM-VQ consists of three components. First, it learns vector-quantized latent factors through a joint vector quantization and contrastive learning objective 4 , where the learned codebook 28 serves as an information bottleneck that suppresses noise while preserving cross-sectional structure. Second, it introduces a structure-conditioned Mixture-of-Experts (MoE) 25 built on Transformer architectures, where discrete codes act as gating signals to generate dynamic factor loadings. Third, it incorporates domain-specific prior factors 16 as stabilizing anchors that maintain interpretability and improve robustness under distribution shifts. We summarize our contributions as follows: • We propose PRISM-VQ, a factor-based framework that combines financial prior factors, vector-quantized discrete latent factors, and structure-conditioned temporal modeling for cross-sectional stock rank prediction. • We demonstrate that vector quantization provides an effective inductive bias for cross-sectional representation learning, consistently outperforming continuous latent alternatives in noisy financial settings. • We introduce a discrete-code-gated MoE mechanism that enables structure-conditioned dynamic factor loading generation while preserving a clear factor interpretation and supporting scalable conditional computation. • We conduct experiments on CSI 300 and S&P 500, where PRISM-VQ achieves the state-of-the-art performance, including RankIC of 0.0646 and 0.0141, and Sharpe ratios of 1.57 and 0.67, respectively. 2 Related Works 2.1 Machine Learning-Based Factor Models Factor models have long been central to asset pricing, from the CAPM 24 to the Fama–French models 11 . Although interpretable, their linear structure limits expressiveness in modern markets. Autoencoder asset pricing 13 introduced neural networks to learn nonlinear factor structures, followed by extensions such as FactorVAE 9 and FactorVQVAE 17 , which employs vector quantization 28 for discrete latent factors. Later work incorporated additional structure, including graph-based industry modeling 10 and regime-aware dynamics 30 . Despite these advances, most methods remain autoencoder-based, limiting temporal modeling capacity and underutilizing financial priors. PRISM-VQ addresses these limitations by combining discrete factor learning with Transformer-based temporal modeling and explicit domain-informed priors. 2.2 Deep Learning for Stock Prediction Another line of work adopts end-to-end deep learning without explicit factor structures. Transformer-based models have been particularly influential. DTML 32 modeled inter-stock dependencies with attention, MASTER 20 alternated intra- and inter-stock attention, and MATCC 2 incorporated trend decomposition. While effective, these models typically lack interpretable factor representations, weakly encode domain knowledge, and show limited robustness under regime shifts. More recently, explicit relational modeling has been explored through temporal-relational graphs and hypergraph structures 5 ; 26 ; 1 . These methods rely on predefined or extracted relational topologies, whereas PRISM-VQ learns implicit cross-sectional structure through a discrete codebook without requiring relational preprocessing, enabling transferability across markets. PRISM-VQ retains the expressive power of Transformers while preserving factor interpretability by using them to generate dynamic factor loadings conditioned on learned cross-sectional structure. 2.3 Representation Learning for Finance The low SNRs of financial data place strong demands on representation learning. Contrastive learning has been explored to learn robust stock embeddings 8 ; 14 . Vector quantization offers a complementary approach by introducing a discrete information bottleneck that suppresses noise and promotes stable pattern reuse. Recent work has applied vector quantization to identify persistent market structure; for example, STORM 34 employs dual VQ-VAEs to capture spatio-temporal patterns, while FactorVQVAE 17 introduces discrete latent factors via a single-stage VQ objective. PRISM-VQ differs from both by combining contrastive-regularized VQ with structure-conditioned MoE routing and explicit financial priors within a unified two-stage framework. To our knowledge, PRISM-VQ is the first framework to integrate vector-quantized discrete factors, contrastive representation learning, expert prior factors, and discrete-code-conditioned temporal modeling within a unified factor-based modeling framework. 3 Problem Formulation We study cross-sectional stock return prediction. At each decision time t , the objective is to predict returns for N_{t} stocks over the next \Delta days for ranking-based portfolio construction. Unless otherwise specified, all quantities are measured at time t , and we omit the explicit time index in symbols such as x_{i} , X , f_{p} , y_{i} , and \hat{y}_{i} . 3.1 Data and Factor Model Framework Each stock i is associated with temporal features x_{i}\in\mathbb{R}^{T\times C} , where T is the lookback window and C is the feature dimension. Stacking all stocks yields the cross-sectional tensor X=\{x_{i}\}_{i=1}^{N_{t}}\in\mathbb{R}^{N_{t}\times T\times C} . We also observe P expert prior factors f_{p}\in\mathbb{R}^{P} , such as value, size, and momentum. The prediction target y_{i} corresponds to the return from t+1 to t+\Delta . Returns are modeled using a dynamic factor structure: y_{i}=\alpha_{i}+\beta_{p,i}^{T}f_{p}+\beta_{l,i}^{T}f_{l,i}+\epsilon_{i}, (1) where \alpha_{i} is the intercept, \beta_{p,i} and \beta_{l,i} are loadings on prior and

Read the complete text