Hard vs. Noise: Resolving Hard-Noisy Sample Confusion in Recommender Systems via Large Language Models

Tianrui Song, Wen-Shuo Chao, Hao Liu · 2025

Read Hard vs. Noise: Resolving Hard-Noisy Sample Confusion in Recommender Systems via Large Language Models by Tianrui Song, Wen-Shuo Chao, Hao Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07295.txt.

Introduction

Tianrui Song, Wen-Shuo Chao, and Hao Liu fix a confusion that undermines recommender system training. Implicit feedback data contains noise from misclicks and position bias, and older methods spot noisy samples by their high loss and drop or down-weight them. The trouble is that hard samples, the informative borderline cases that teach the most about preferences, show the same high-loss pattern, so denoising throws away gold with the dross.

Their system, LLMHNI, brings in large language models as referees. Semantic relevance from model embeddings guides negative sampling toward hard negatives while filtering false ones. Inferred logical relevance joins the interaction graph to flag hard versus noisy cases, with contrastive alignment across edge-dropped graph views to suppress hallucinated links. Tests show notable gains in both denoising and recommendation quality.

Catalog record

CREATORTianrui Song, Wen-Shuo Chao, Hao Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-07295

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Hard vs. Noise: Resolving Hard-Noisy Sample Confusion in Recommender Systems via Large Language Models Tianrui Song, Wen-Shuo Chao, Hao Liu Abstract Implicit feedback, employed in training recommender systems, unavoidably confronts noise due to factors such as misclicks and position bias. Previous studies have attempted to identify noisy samples through their diverged data patterns, such as higher loss values, and mitigate their influence through sample dropping or reweighting. However, we observed that noisy samples and hard samples display similar patterns, leading to hard-noisy confusion issue. Such confusion is problematic as hard samples are vital for modeling user preferences. To solve this problem, we propose LLMHNI framework, leveraging two auxiliary user-item relevance signals generated by Large Language Models (LLMs) to differentiate hard and noisy samples. LLMHNI obtains user-item semantic relevance from LLM-encoded embeddings, which is used in negative sampling to select hard negatives while filtering out noisy false negatives. An objective alignment strategy is proposed to project LLM-encoded embeddings, originally for general language tasks, into a representation space optimized for user-item relevance modeling. LLMHNI also exploits LLM-inferred logical relevance within user-item interactions to identify hard and noisy samples. These LLM-inferred interactions are integrated into the interaction graph and guide denoising with cross-graph contrastive alignment. To eliminate the impact of unreliable interactions induced by LLM hallucination, we propose a graph contrastive learning strategy that aligns representations from randomly edge-dropped views to suppress unreliable edges. Empirical results demonstrate that LLMHNI significantly improves denoising and recommendation performance. Code — https://github.com/TianRui-Song717/LLMHNI Introduction Recommender Systems (RS) rely on implicit feedback, such as clicks and purchases, to model user preferences ( 6 ; 10 ) . Traditionally, these interactions are labeled positively if observed and negatively if not ( 3 ; 15 ) . However, this schema is questioned due to the false-positive noise from misclicks and false-negative noise from position bias ( 16 ) . To address such noise issues, denoising recommendation strategies have emerged, including sample dropping and sample reweighting. Sample dropping mitigates the impact of noise by removing noisy interactions during training ( 2 ) , while reweighting assigns lower weights to noisy interactions ( 19 ; 5 ) . These techniques hinge on accurately distinguishing between clean and noisy samples by their divergent patterns in loss value ( 3 ) , prediction scores ( 15 ) , and gradients ( 19 ) . Figure 1: On the left, we demonstrate that hard and noisy samples display similar patterns in both loss values and prediction scores throughout the training process. On the right, we take the results from the 5th epoch as an example to illustrate how the prediction scores and loss values of hard and noisy samples overlap in distribution. Additional details about this figure can be found in the appendix. Despite their advancements, these denoising methods often face the challenge of misidentifying hard samples as noisy ones. As illustrated in Figure 1 , while noisy samples exhibit distinct patterns compared to easy samples, we observed that hard samples and noisy samples tend to present similar patterns in both prediction scores and loss values. Consequently, previous denoising approaches that rely solely on data patterns struggle to distinguish between hard and noisy samples . This misidentification is problematic because hard samples have been shown to be beneficial, both empirically ( 4 ) and theoretically ( 13 ) . Mistakenly treating hard samples as noise during training ultimately leads to suboptimal results. Since distinguishing hard and noisy samples based solely on numerical patterns derived from user-item collaborative information is insufficient, addressing this issue necessitates auxiliary signals. Recently, Large Language Models (LLMs) have emerged as powerful tools to enhance recommender systems. Existing approaches take the knowledge generated by LLMs as supplementary information beyond collaborative signals in recommender systems ( 8 ) . Inspired by their promising performance, we employ LLMs to provide auxiliary information for distinguishing hard samples from noisy ones. Specifically, we exploit two types of user-item relevance signals that distinct from those captured by user-item interactions. 1) Semantic Relevance in LLM-encoded embedding: As shown in Fig. 2 (a), LLM-encoded user and item embeddings offer semantic relevance between users and items, which helps identify hard and noisy samples with relevance scores. 2) Logical Relevance in LLM-inferred interactions: LLMs possess reasoning capabilities that can infer logical relevance within user-item interactions and distinguish hard samples from noisy ones. As shown in Fig. 2 (b), LLM deduces that a user bought headphones enjoys music and might therefore be interested in a guitar. Figure 2: Semantic Relevance and Logical Relevance. However, leveraging these two auxiliary relevance signals to distinguish hard and noisy samples in recommender systems faces two challenges: 1) Objective-Mismatched Embeddings : LLM-encoded embeddings, trained for general language tasks rather than user preference modeling, suffer an objective mismatch for recommendation tasks. Consequently, the user-item similarity values derived from these objective-mismatched embeddings can mislead the identification between hard and noisy samples and hinder recommendation model performance. 2) Hallucination-Induced Interactions : LLMs suffer from hallucination, which undermines the reliability of their inferred user-item interactions. Including these hallucination-induced interactions during training may amplify label noise and propagate hallucination errors into the recommendation model. To overcome aforementioned challenges, we introduce the L arge L anguage M odels enhanced H ard- N oisy sample I dentification framework ( LLMHNI ). It comprises two modules that take auxiliary signals generated by LLMs to differentiate hard and noisy samples, improving the denoising process. The first module, Semantic Relevance Guided Hard Negative Mining, harnesses LLMs to encode text profiles of users and items. Semantic relevance (i.e., embedding similarities) between users and items are used to guide negative sampling, facilitating the selection of hard negatives while avoiding the introduction of false negatives. To further mitigate the objective-mismatched embedding , we design an objective alignment strategy that projects raw LLM-encoded embeddings into a tailored representation space optimized for preference modeling. The second module, Logical Relevance Guided Interaction Denoising, employs LLMs to infer logical relevance within user-item interactions, identifying hard and noisy ones. These interactions are integrated into interaction graph and guide interaction denoise. Specifically, we design a cross-graph contrastive alignment that suppresses interactions inconsistent between the original graph and the one enhanced with LLM-inferred hard and noisy interactions. To mitigate hallucination-induced interactions within interaction graph, a graph contrastive learning strategy is incorporated, which suppresses hallucination-induced edges by aligning representations from two randomly edge-dropped views of the interaction graph. Our main contributions are summarized as follows. • We propose LLMHNI , a novel framework that takes semantic relevance signals in LLM-encoded embeddings and logical relevance signals in LLM-inferred interactions to guide negative sampling and interaction denoising, addressing the noisy-hard sample confusion in RS. • LLMHNI addresses the objective mismatch of LLM-encoded embeddings by projecting the raw embedding into an aligned representation space. It also reduces the influence of hallucination-induced interactions inferred by LLM with a graph contrastive learning strategy. • Extensive experiments on three real-world datasets and two backbone recommenders demonstrate the effectiveness of our method. Results show that LLMHNI delivers impressive performance and robust noise resilience. Preliminary The objective of training a recommender system is to learn a scoring function \hat{y}_{u,i}=f_{\theta}(u,i) from interactions between users u\in\mathcal{U} and items i\in\mathcal{I} . We assume that user-interacted items {y}^{*}_{u,i}=1 are preferred by

Read the complete text