HI-Series Algorithms: A Hybrid of Substance Diffusion Algorithm and Collaborative Filtering
Yu Peng, Ya-Hui AN · 2025
Read HI-Series Algorithms: A Hybrid of Substance Diffusion Algorithm and Collaborative Filtering by Yu Peng, Ya-Hui AN (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-01305.txt.
Introduction
Yu Peng and Ya-Hui An propose the HI-series algorithms for recommendation in two thousand twenty-five. Recommenders must trade accuracy against diversity in their picks. Item based filtering gives diverse picks but weaker accuracy. Diffusion methods give sharp picks but lean on hits and lack range.
The HI-series blends the two in a nonlinear mix with one control knob. Variants pair the blend with three advanced diffusion methods. Tests span MovieLens, Netflix, and a music rating set. Hybrids beat their base parts on F1 score in sparse and dense data. Diversity and novelty rose too, most in sparse settings. The knob adapts well across cases.
Catalog record
| CREATOR | Yu Peng, Ya-Hui AN |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-01305
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
HI-Series Algorithms: A Hybrid of Substance Diffusion Algorithm and Collaborative Filtering Yu Peng, Ya-Hui AN Abstract Recommendation systems face the challenge of balancing accuracy and diversity, as traditional collaborative filtering (CF) and network-based diffusion algorithms exhibit complementary limitations. While item-based CF (ItemCF) enhances diversity through item similarity, it compromises accuracy. Conversely, mass diffusion (MD) algorithms prioritize accuracy by favoring popular items but lack diversity. To address this trade-off, we propose the HI-series algorithms, hybrid models integrating ItemCF with diffusion-based approaches (MD, HHP, BHC, BD) through a nonlinear combination controlled by parameter ϵ \epsilon . This hybridization leverages ItemCF’s diversity and MD’s accuracy, extending to advanced diffusion models (HI-HHP, HI-BHC, HI-BD) for enhanced performance. Experiments on MovieLens, Netflix, and RYM datasets demonstrate that HI-series algorithms significantly outperform their base counterparts. In sparse data ( 20 % 20\% training), HI-MD achieves a 0.8 % 0.8\% – 4.4 % 4.4\% improvement in F1-score over MD while maintaining higher diversity (Diversity@20: 459 vs. 396 on MovieLens). For dense data ( 80 % 80\% training), HI-BD improves F1-score by 2.3 % 2.3\% – 5.2 % 5.2\% compared to BD, with diversity gains up to 18.6 % 18.6\% . Notably, hybrid models consistently enhance novelty in sparse settings and exhibit robust parameter adaptability. The results validate that strategic hybridization effectively breaks the accuracy-diversity trade-off, offering a flexible framework for optimizing recommendation systems across data sparsity levels. I Introduction Recommendation systems, pivotal in mitigating information overload, leverage user-item interaction histories to model user preferences and predict future engagements. Traditional approaches predominantly fall into three categories: collaborative filtering (CF), network-based diffusion methods, and hybrid models. While CF algorithms, particularly item-based CF (ItemCF), excel in diversifying recommendations by identifying item similarities through co-occurrence patterns, they often compromise accuracy due to over-reliance on associative rules. Conversely, mass diffusion (MD) algorithms, inspired by physical propagation dynamics, prioritize accuracy by favoring popular items, yet lack personalization and diversity. The inherent trade-off between accuracy and diversity persists as a critical challenge. ItemCF’s strength in diversity is counterbalanced by its suboptimal accuracy, whereas MD’s accuracy diminishes its ability to recommend niche items. Recent hybrid models like HHP attempt to balance these aspects but remain constrained by their design frameworks. In this study, we propose the HI-series algorithms—HI-MD, HI-HHP, HI-BHC, and HI-BD—a novel hybrid framework integrating ItemCF with diffusion-based methods. By nonlinearly combining item similarity metrics from ItemCF and resource diffusion mechanisms, our approach synergizes the accuracy of diffusion processes with the diversity of CF. Evaluations on MovieLens, Netflix, and RYM datasets demonstrate that HI-series algorithms significantly outperform baseline methods in both sparse (training ratio (E^{T}=20\%) and dense (E^{T}=80\%) data scenarios. Specifically, HI-MD improves F1-score by 2.3–5.9\% while maintaining competitive diversity, and HI-BD achieves a 12.7\% increase in coverage diversity without sacrificing accuracy. This work contributes: (1) a systematic hybrid methodology bridging CF and diffusion algorithms, (2) empirical validation across multiple real-world datasets, and (3) insights into parameter tuning for optimizing accuracy-diversity trade-offs. The HI-series framework offers a robust solution for modern recommendation systems, particularly in scenarios requiring balanced performance across metrics. II Problem Statement Recommendation systems establish user interest models based on the interaction history between users and the system, as well as the personal information of the users, to predict potential items that users might purchase or click in the future. With recommendation systems, users can discover items they like without wasting a lot of time searching on the Internet, and it can increase the ratio of cross-selling items. Additionally, by providing users with items that fully meet their requirements, it will increase the trust users have in the system and prompt them to make purchases. Currently, the most extensive recommendation algorithms, which are purely based on historical interaction triple data (user, item, action) without introducing other information, allowing researchers to conduct more pure model research, can be divided into three types: collaborative filtering algorithms [ 1 , 2 , 3 , 4 ] , Network Structure-based Diffusive Recommendation Algorithm [ 5 , 6 , 7 , 8 ] , Hybrid Algorithm [ 17 , 18 ] . Collaborative filtering methods produce recommendations based on usage patterns [ 19 ] , and collaborative filtering based on user similarity or item similarity can be divided into two main types: User-based Collaborative Filtering (UserCF) [ 9 , 10 ] and Item-based Collaborative Filtering (ItemCF) [ 11 , 12 , 13 , 14 ] [ 24 ] . The main idea of user-based collaborative filtering is to recommend items that have been chosen by similar users of the target user but have not yet been selected by the target user, while item-based collaborative filtering mainly focuses on items similar to those previously chosen by the target user [ 13 ] . Therefore, the method of calculating the similarity between users or items becomes the most important part in the collaborative filtering process. In order to obtain more accurate similarity, it requires more information.Collaborative filtering provides benefits to most online stores in recommending products based on users’ ratings of similarity measurement, but its usage also raises doubts among researchers regarding its effectiveness in handling ratings with a limited number of users or no rating record from users [ 22 ] , and there are significant flaws in user-based measurement [ 23 ] . For example, on the e-commerce platform Taobao, user behavior data such as browsing, clicking, adding to the shopping cart, and purchasing are available. As for the algorithm itself, UserCF is based on the similarity between users. The ”similarity” of users similar to the target user is calculated based on the similarity of items purchased by the users. As a result, users will be recommended similar items, and the recommendation results among users lack personalization (see the table I ). On the contrary, ItemCF is based on the similarity between items, and the similarity between items is often measured by common users. Therefore, the similarity between items is more similar to the traditional recommendation algorithm—association rules. For example, diapers and beer are common choices for many users. According to the idea of ItemCF, diapers and beer are similar, but they are actually products of completely different categories. So ItemCF can achieve diversification of the recommended list for a single user, but the accuracy of the recommendation results based on this association rule mode is not high (see the table I ). In recent years, with the development of recommendation technology, Pulkit Dwivedi [ 25 ] and others propose an item-based CF method where they initially analyze the user’s item rating pattern and then they establish the connections between several items. Zhou [ 15 ] and others have constructed a simple model to solve the recommendation problem from the perspective of physical propagation, referred to as the Mass Diffusion Algorithm (MD). This method utilizes network structure information and has higher accuracy and diversity than UserCF (see table I ). However, in order to ensure accuracy, this method is not as flexible as the ItemCF algorithm in terms of overall system diversity and personalization among users. Similarly, by simulating the physical propagation process, the Heat Conduction Algorithm (HC) was also introduced by Zhou and other [ 16 ] . The HC algorithm can achieve higher diversity than