Training-free Adjustable Polynomial Graph Filtering for Ultra-fast Multimodal Recommendation

Yu-Seung Roh, Joo-Young Kim, Jin-Duk Park, Won-Yong Shin · 2025

Read Training-free Adjustable Polynomial Graph Filtering for Ultra-fast Multimodal Recommendation by Yu-Seung Roh, Joo-Young Kim, Jin-Duk Park, Won-Yong Shin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04406.txt.

Introduction

Yu-Seung Roh and co-authors present a training free method for multimodal recommendation in a 2025 paper. Recommenders that use text, images, and video beat plain ones, but neural models cost much compute to train. Sparse user data also makes learning hard.

Their method builds similarity graphs for two content types plus user item interactions. A polynomial graph filter then fuses the signals, with bounds that tune which frequencies pass. Filter values are treated as settings to adjust from data, with no model training. On real benchmarks, accuracy rose by up to about a fifth over the best rival, with far faster runs.

Catalog record

CREATORYu-Seung Roh, Joo-Young Kim, Jin-Duk Park, Won-Yong Shin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-04406

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Training-free Adjustable Polynomial Graph Filtering for Ultra-fast Multimodal Recommendation Yu-Seung Roh, Joo-Young Kim, Jin-Duk Park, Won-Yong Shin Abstract Multimodal recommender systems improve the performance of canonical recommender systems with no item features by utilizing diverse content types such as text, images, and videos, while alleviating inherent sparsity of user–item interactions and accelerating user engagement. However, current neural network-based models often incur significant computational overhead due to the complex training process required to learn and integrate information from multiple modalities. To address this challenge, we propose a training-free multimodal recommendation method grounded in graph filtering , designed for multimodal recommendation systems to achieve efficient and accurate recommendation. Specifically, the proposed method first constructs multiple similarity graphs for two distinct modalities as well as user–item interaction data. Then, it optimally fuses these multimodal signals using a polynomial graph filter that allows for precise control of the frequency response by adjusting frequency bounds. Furthermore, the filter coefficients are treated as hyperparameters, enabling flexible and data-driven adaptation. Extensive experiments on real-world benchmark datasets demonstrate that the proposed method not only improves recommendation accuracy by up to 22.25% compared to the best competitor but also dramatically reduces computational costs by achieving the runtime of less than 10 seconds. mode = titleGraph Filtering for Multimodal Recommendation keywords Graph filtering ,Modality ,Multimodal recommendation ,Polynomial graph filter ,Recommender system † † corresponding: Corresponding author 1 Introduction 1.1 Background and Motivation Recently, multimodal recommender systems (MRSs) have garnered significant attention due to their ability to accommodate diverse item information from multiple modalities for enhanced recommendation performance. Compared to canonical recommender systems Ranjbar et al. (2015) ; Valcarce et al. (2019) ; He et al. (2020) with no item features (referred to as single-modal recommender systems), MRSs can capture and leverage precise item information (e.g., textual and/or visual features) for recommendations, thereby enhancing the overall capabilities of recommender systems He and McAuley (2016b) ; Wei et al. (2020) . Notably, while single-modal recommender systems often struggle with sparsity of user–item interactions, MRSs can overcome this limitation by utilizing multimodal features of items. Due to these advantages, MRSs Zhang et al. (2021) ; Zhou et al. (2023b) ; Zhou and Shen (2023) ; Yu et al. (2023) are shown to substantially outperform single-modal recommendation methods based on collaborative filtering (CF) that rely solely on historical user–item interactions. Various MRSs have been developed to improve recommendation performance. In particular, thanks to the expressive capability via message passing in graph convolutional networks (GCNs) Kipf and Welling (2017) , attention has been paid to GCN-based MRSs Wei et al. (2020) ; Zhang et al. (2021) ; Zhou et al. (2023b) ; Zhou and Shen (2023) ; Yu et al. (2023) . For example, prior studies on MRSs learned GCNs separately to process different modalities, distinct from user–item interactions Wei et al. (2020) ; Zhang et al. (2021) ; Kim et al. (2024) , or constructed an item–item similarity graph based on multimodal information (i.e., multimodal features of items) and then applied GCNs to process the similarity graph Zhang et al. (2021) . Figure 1 : Training time comparison of two GCN-based MRSs under different degrees of modality information on the Baby dataset. On one hand, user preferences tend to shift quickly under the influence of trends, personal situations, and exposure to new content Ju et al. (2015) ; Pereira et al. (2018) ; hence, recommender systems need to be flexible to adapt to such dynamic preferences. Especially in environments where the training and inference speed is crucial, model runtime can become a significant bottleneck. In this context, incorporating additional information (i.e., multimodal features of items) into modeling significantly increases computational overhead for GCN-based MRSs. Consequently, MRSs learn multimodal information through GCNs, naturally leading to escalation of training time for GCNs with the increased number of modalities. Figure 1 illustrates how the training time (in seconds) of various MRSs behaves according to different degrees of modality information on the Baby dataset (one of well-known benchmark datasets for MRSs). As shown in Figure 1 , incorporating all modalities substantially increases the training time of GCN-based MRSs such as GRCN Wei et al. (2020) and LATTICE Zhang et al. (2021) , highlighting the heavy computational burden of training-based MRSs. Thus, although GCN-based MRSs (e.g., Wei et al. (2020) , Zhang et al. (2021) ) are promising, their computational cost becomes prohibitive in scenarios where models must be updated frequently to track rapidly evolving user preferences. On the other hand, recent studies on single-modal recommender systems Shen et al. (2021) ; Xia et al. (2022) ; Liu et al. (2023) ; Park et al. (2024) have adopted the training-free graph filtering (GF) (also known as graph signal processing) mechanism due to its simplicity and effectiveness. As training-free designs, GF bypasses iterative gradient-based training and instead performs graph filtering along with similarity graphs, thereby resulting in substantially lower computational overhead and much faster inference for recommendation than the case of conventional deep or graph neural network (GNN)-based models. Such GF is a fundamental operation enabling the manipulation of signals defined over the nodes based on the underlying graph topology Defferrard et al. (2016) ; Isufi et al. (2024) . A pioneering study on training-free GF is GF-CF Shen et al. (2021) , which presented a novel approach to constructing an item–item similarity graph and applying GF that does not necessitate model training to enhance recommendation performance. Additionally, recent studies Park et al. (2024) ; Park et al. (2025a) ; Kim et al. (2025) proposed a normalization scheme with tunable user–item influence and smoothing strength, combined with polynomial graph filters that avoid explicit eigendecomposition. Despite these advances, the GF-based recommendation methods in Park et al. (2024) ; Park et al. (2025a) ; Kim et al. (2025) present a key limitation from the perspective of frequency analysis. Normalization techniques in Shen et al. (2021) ; Xia et al. (2022) ; Liu et al. (2023) ensure that all eigenvalues of the underlying item–item similarity graph lie within the interval [0,1] , providing a stable theoretical foundation for designing polynomial filters in the frequency domain. In contrast, the normalization and additional adjustment process in Park et al. (2024) ; Park et al. (2025a) ; Kim et al. (2025) does not enforce this spectral constraint, allowing eigenvalues to extend beyond the unit interval, which distorts the intended frequency response. This effect is magnified on multimodal information due to heterogeneous characteristics, resulting in greater spectral instability than the case of user–item interactions. Additionally, such an effect can be amplified with higher-order polynomials, disproportionately emphasizing components tied to large-magnitude eigenvalues and further degrading frequency control. The aggregation of multiple out-of-band components generates spurious, highly distorted signals. These limitations constitute a fundamental theoretical flaw that calls for a principled reformulation of polynomial graph filtering in recommendation. Moreover, their polynomial filters in Park et al. (2024) ; Park et al. (2025a) ; Kim et al. (2025) were analytically derived from a fixed frequency response function, which lacks flexibility. This limitation underscores the need for a more adjustable and theoretically grounded filtering strategy for recommender systems. 1.2 Main Contributions To tackle the aforementioned challenges, we propose MultiModal-Graph Filtering ( MM-GF ), a new GF method tailored for MRSs. Specifically,

Read the complete text