Toward Holistic Evaluation of Recommender Systems Powered by Generative Models

Yashar Deldjoo, Nikhil Mehta, Maheswaran Sathiamoorthy, Shuai Zhang, Pablo Castells, Julian McAuley · 2025

Read Toward Holistic Evaluation of Recommender Systems Powered by Generative Models by Yashar Deldjoo, Nikhil Mehta, Maheswaran Sathiamoorthy, Shuai Zhang, Pablo Castells, Julian McAuley (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06667.txt.

Introduction

Yashar Deldjoo, Nikhil Mehta, Maheswaran Sathiamoorthy, Shuai Zhang, Pablo Castells, and Julian McAuley argue for wider tests of AI recommenders, in a 2025 paper. New recommenders do not just rank items; they write explanations and hold conversations. That freedom brings risks that classic scoreboards miss, from inventing products that do not exist to leaking private data.

The authors sort the evaluation problems into two kinds. Some are old concerns, like bias and privacy, made worse by open-ended output. Others are new, such as checking factual correctness and content safety in generated text. They propose judging these systems across accuracy, fairness, safety, and fit to user intent at once. Richer scorecards can keep helpful recommenders honest.

Catalog record

CREATORYashar Deldjoo, Nikhil Mehta, Maheswaran Sathiamoorthy, Shuai Zhang, Pablo Castells, Julian McAuley
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-06667

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Toward Holistic Evaluation of Recommender Systems Powered by Generative Models Yashar Deldjoo, Nikhil Mehta, Maheswaran Sathiamoorthy, Shuai Zhang, Pablo Castells, Julian McAuley Abstract . Recommender systems powered by generative models (Gen-RecSys) extend beyond classical item-ranking by producing open-ended content, which simultaneously unlocks richer user experiences and introduces new risks. On one hand, these systems can enhance personalization and appeal through dynamic explanations and multi-turn dialogues. On the other hand, they might venture into unknown territory—hallucinating nonexistent items, amplifying bias, or leaking private information. Traditional accuracy metrics cannot fully capture these challenges, as they fail to measure factual correctness, content safety, or alignment with user intent. This paper makes two main contributions. First, we categorize the evaluation challenges of Gen-RecSys into two groups: (i) existing concerns that are exacerbated by generative outputs (e.g., bias, privacy) and (ii) entirely new risks (e.g., item hallucinations, contradictory explanations). Second, we propose a holistic evaluation approach that includes scenario-based assessments and multi-metric checks—incorporating relevance, factual grounding, bias detection, and policy compliance. Our goal is to provide a guiding framework so that researchers and practitioners can thoroughly assess Gen-RecSys, ensuring both effective personalization and responsible deployment. Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’25), July 13–18, 2025, Padua, Italy DOI: 10.1145/3726302.3730354 ISBN: 979-8-4007-1592-1/2025/07 ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Recommender systems † † cc-license: by 1. Introduction For decades, recommender system (RS) evaluation has centered on held-out datasets and standardized, non-verbal feedback signals (e.g., clicks, purchases) to measure how well a system retrieves and ranks known items ( Herlocker et al., 2004 ; Cañamares et al., 2020 ) . In this paradigm, metrics such as NDCG@ k , Precision@ k , and RMSE typically assume stable user–item distributions and a fixed structured catalog. While effective, this approach inherently treats recommendation as a surface-level task of item retrieval and ranking — a relatively static process with well-defined ground truth in the form of observed user choices. Large language models (LLMs) have enabled generative recommender systems (Gen-RecSys) to produce more natural and open-ended recommendations, moving beyond simple top-k lists to textual or multi-modal responses that incorporate user instructions and context-specific justifications ( Deldjoo et al., 2024b ) . These systems may directly generate item IDs ( Geng et al., 2022 ; Rajput et al., 2023 ) or leverage a separate retrieval model (e.g., Retrieval-augmented Generation ( Deldjoo et al., 2024a ; Fan et al., 2024 ) ) to retrieve and refine recommendations. However, like many LLM-based applications, Gen-RecSys can be prone to hallucinations, sometimes even recommending out-of-inventory items. To address challenges such as evolving user needs and query ambiguity, multiturn conversational Gen-RecSys ( Friedman et al., 2023 ) have emerged. By introducing an interactive user-system dialogue, these systems allow for iterative refinement of user intent through clarifications and real-time feedback. This approach transcends static suggestions, offering a more personalized and adaptive recommendation experience where success hinges on retrieval accuracy, maintaining alignment with user intent, and ensuring factual correctness. A prominent approach is retrieval-augmented generation (RAG) ( Ram et al., 2023 ; Lewis et al., 2020 ; Shi et al., 2024 ) , a multi-stage approach in which a retriever first collects relevant items, and then an LLM composes the final response. This pipeline can enhance the realism and depth of recommendations, yet it also risks cascading errors , since poor retrieval or generation quality in early stages can irreversibly degrade final outputs (such as by introducing hallucinations). Table 1. Key Differentiators in Evaluation Goals for Traditional vs. Generative Recommender Systems Aspect Traditional Recommender Systems Generative Recommender Systems (Gen-RecSys) I. Overall Objectives & Output Evaluation Goal Accuracy-focused (top- k recall, rating prediction) Multifaceted : accuracy plus quality, personalization depth, coherence, and alignment with user context. Output Space and Complexity Structured outputs (e.g., top- k item lists, rating predictions). Mostly static and catalog-bound (against a pre-existing catalog of items), Output text explanation was explored (e.g., with RNN) ( Zhang et al., 2020 ) Open-ended, multi-modal (text, image, video), and dynamically generated responses. Can create personalized narratives, explanations, and even hallucinate items. II. Personalization & Interaction Personalization Granularity Personalization at an item/rating level, or category level relying on historical collaborative signals; often coarse-grained . Enables aspect-level personalization (e.g., tone, style, domain context), adapting to individual user instructions, evolving preferences, and persona-level traits. Context & Interaction Largely static scenarios (e.g., single-shot recommendations without multi-turn memory); contextual or temporal aspects often pre-defined and limited to session-based recommendations. Multi-turn, dynamic interactions requiring coherence, contextual updates, and user feedback adaptation over time 1 1 1 Evaluation must measure the model’s ability to maintain consistency over long-term interactions and remember prior user inputs. Evaluating User Satisfaction Indirect (clicks, ratings). Direct and nuanced assessment (alignment with user’s tone, style, factual correctness, conversation quality, intent matching) ( Zhang et al., 2024 ) Personalization of Tone & Style Not relevant or minimal (limited to user preference modeling via IDs or ratings). Highly relevant (LLM must tailor tone, writing style, and content relevance to user’s persona and context). III. Evaluation Metrics & Risks Evaluation Metrics Relevance-oriented metrics (NDCG, Precision) and sometimes novelty/diversity ( Castells et al., 2021 ) , as well as explainability ( Zhang et al., 2020 ) Traditional metrics + NLP/Gen. metrics (e.g., BLEU, ROUGE, Perplexity, FID, Inception Score, GPTScore ( Fu et al., 2024 ) , and LLM judges ( Zheng et al., 2024 ) ), and persona/alignment metrics. Handling Hallucinations Not applicable (item sets are well-defined; no invented items). Critical (LLM may invent nonexistent items or details), requiring factuality checks and grounding in sources ( Tang et al., 2024 ) . Safety and Ethical Concerns Biases and fairness issues exist but are relatively bounded by catalog constraints; privacy in dataset curation and model training; adversarial robustness and explainability. Bias amplification ( Wang et al., 2024 ; Bao et al., 2024 ) , privacy leaks ( Kim et al., 2024 ) , and new risks (e.g., persona misalignment, hallucinations, unsafe content). Evaluation must incorporate harm detection, bias audits, and scenario-based stress tests. IV. Data Dependence Data Reliance Strongly dependent on historical user-item interactions for personalization. Expands beyond user-item interactions in the training data via knowledge retrieval (e.g., in RAG) and reasoning. Traditional vs. Generative RS at a Glance. The move from catalog-bound systems toward open-ended generation brings both new capabilities and new risks. Table 1 compares these paradigms across aspects like output complexity, personalization granularity, and safety concerns. In traditional RS, outputs are often restricted to top- k item lists, and personalization focuses on item-level preferences learned via user–item interactions. By contrast, Gen-RecSys produce multifaceted responses that may incorporate style, tone, and factual justifications, thus requiring more nuanced evaluation metrics. This flexibility also poses serious challenges around factual correctness, potential bias amplification, and handling of private or sensitive information. Taken together, these emerging Gen-RecSys capabilities introduce an expanded set of evaluation challenges . Conventional accuracy-based metrics cannot capture whether a system’s natural-language justifications are coherent or factually correct , nor can they address the risk of generating hallucinations. Ethical implications likewise intensify: what if generative text exposes confidential

Read the complete text