From latent factors to language: a user study on LLM-generated explanations for an inherently interpretable matrix-based recommender system
Maxime Manderlier, Fabian Lecron, Olivier Vu Thanh, Nicolas Gillis · 2025
Read From latent factors to language: a user study on LLM-generated explanations for an inherently interpretable matrix-based recommender system by Maxime Manderlier, Fabian Lecron, Olivier Vu Thanh, Nicolas Gillis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-18980.txt.
Introduction
Why did a system suggest that film or product? Maxime Manderlier and three co-authors test whether large language models can explain such suggestions in plain words. Their recommender is built on matrix factorization with tight constraints, so user types are stated openly. Predicted scores share the same scale as real ratings, which makes the model's inner workings easy to read in principle.
The team turns that inner structure into written explanations with carefully designed prompts. More than 300 people then rated the explanations for clarity, usefulness, power to persuade, trust, and overall satisfaction. All styles of explanation were received well, with modest gaps between them. Comments from users added detail on what each style did right or wrong, beyond what the scores alone could show.
Catalog record
| CREATOR | Maxime Manderlier, Fabian Lecron, Olivier Vu Thanh, Nicolas Gillis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-18980
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From latent factors to language: a user study on LLM-generated explanations for an inherently interpretable matrix-based recommender system Maxime Manderlier, Fabian Lecron, Olivier Vu Thanh, Nicolas Gillis Abstract We investigate whether large language models (LLMs) can generate effective, user-facing explanations from a mathematically interpretable recommendation model. The model is based on constrained matrix factorization, where user types are explicitly represented and predicted item scores share the same scale as observed ratings, making the model’s internal representations and predicted scores directly interpretable. This structure is translated into natural language explanations using carefully designed LLM prompts. Many works in explainable AI rely on automatic evaluation metrics, which often fail to capture users’ actual needs and perceptions. In contrast, we adopt a user-centered approach: we conduct a study with 326 participants who assessed the quality of the explanations across five key dimensions—transparency, effectiveness, persuasion, trust, and satisfaction—as well as the recommendations themselves. To evaluate how different explanation strategies are perceived, we generate multiple explanation types from the same underlying model, varying the input information provided to the LLM. Our analysis reveals that all explanation types are generally well received, with moderate statistical differences between strategies. User comments further underscore how participants react to each type of explanation, offering complementary insights beyond the quantitative results. [[email protected], orcid=0000-0002-5641-9818] *1 [[email protected], orcid=0000-0002-6516-0086] [[email protected], orcid=0000-0002-4917-6571] [[email protected], orcid=0000-0001-6423-6897] keywords explainable recommendations ,collaborative filtering ,matrix factorization ,large language models ,user study † † copyrightyear: 2025 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: IntRS’25: Joint Workshop on Interfaces and Human Decision Making for Recommender Systems, September 22, 2025, Prague † † address: Department of Technological Innovation Management, Faculty of Engineering, University of Mons (UMONS), Mons, Belgium † † address: Department of Mathematics and Operational Research, Faculty of Engineering, University of Mons (UMONS), Mons, Belgium † † corresp: Corresponding author. 1 Introduction Recommender systems have become essential tools for helping users navigate large catalogs of content. However, the algorithms powering these systems are often opaque, making it difficult for users to understand or trust their suggestions. This has motivated a growing body of work in explainable recommendation, which seeks to provide users with reasons for each recommendation. While many existing approaches generate explanations post hoc—often disconnected from the underlying model—another line of research focuses on designing inherently interpretable models. In this work, we build on a matrix factorization model that is mathematically interpretable by design: user types are explicitly represented, and predicted scores are constrained to remain within the same range as observed ratings. This allows internal representations to be meaningfully interpreted in terms of user preferences. The challenge, however, lies in translating these internal representations into user-facing explanations. Large language models (LLMs) offer a natural interface for generating such explanations. Given carefully designed prompts, they are capable of reasoning over structured information and expressing it in fluent natural language. This raises an important question: can LLMs successfully act as explanation generators for recommendation models whose internals are interpretable? This paper investigates that question through three main objectives: 1. Evaluating an interpretable recommendation model. We assess whether a mathematically interpretable model can satisfy users in terms of the recommendations it produces, even without additional explanation layers. 2. Generating explanations using LLMs. We examine whether LLMs can leverage the model’s internal structure to generate effective and coherent explanations. 3. Comparing explanation strategies. We contrast explanations grounded in model internals with alternatives based on external information (e.g., user history), to assess the trade-offs between transparency and other user-centered goals. These questions are addressed through a user study in which participants evaluate the recommendations and explanations they receive across multiple dimensions. Our findings highlight the potential of LLMs to act as a bridge between model interpretability and user-facing explanation, and offer guidance for designing explanation strategies that are both faithful and effective. All materials, including data preparation, prompts, and statistical analysis code, are available in a public repository to support transparency and reproducibility. 1 1 1 https://github.com/MaximeUM/interpretable-mf-llm-explanations 2 Related work Early research on explanations in recommender systems emphasized the importance of transparency and user-centered design. Herlocker et al. Herlocker et al. 2000 conducted one of the first empirical studies on collaborative filtering (CF) explanation interfaces. They explored both white-box and black-box strategies and found that simple and transparent justifications—such as rating histograms and past accuracy—were more persuasive and trustworthy than abstract ones. Tintarev and Masthoff Tintarev and Masthoff 2007 proposed a comprehensive framework for analyzing explanations, identifying seven core aims: transparency, scrutability, trust, effectiveness, persuasiveness, efficiency, and satisfaction. They highlighted the trade-offs between these objectives and the impact of explanation format and interface design. Beyond system transparency, trust has emerged as a central but complex evaluation axis. Rong et al. Rong et al. 2024 conducted a meta-analysis of 97 XAI user studies and showed that explanations generally improve subjective understanding and, to some extent, collaboration. However, their effects on trust and usability remain inconsistent. More targeted studies in recommender systems revealed similar complexity. For example, Ooge et al. Ooge et al. 2022 found that providing explanations—regardless of type—increased adolescents’ trust in educational recommendations. Kunkel et al. Kunkel et al. 2019 observed that personalized explanations boosted trust more effectively than impersonal ones. Millecamp et al. Millecamp et al. 2019 further revealed that user traits (e.g., personality or domain expertise) moderated trust responses. Liao and Sundar Liao and Sundar 2021 highlighted framing effects, while Bucinca et al. Buçinca et al. 2020 questioned the validity of proxy tasks for measuring trust, arguing for more holistic evaluations. The emergence of large language models (LLMs) has significantly transformed explanation generation in recommender systems. Shi et al. Shi et al. 2024 proposed LLM-SRR, which enriches user reviews via LLMs and integrates them into knowledge graphs to identify explanatory paths. These are then translated into natural language, improving semantic faithfulness. Wang et al. Wang et al. 2025 introduced LR-Recsys, a system using LLM-generated contrastive explanations embedded into DNN recommenders, which significantly improved performance. Gao et al. Gao et al. 2023 developed Chat-REC, a conversational recommender using structured prompts with LLMs to generate both recommendations and explanations. Some works have directly evaluated user responses to LLM-generated explanations. Feng et al. Feng et al. 2025 , through a user study, found that contextualized LLM explanations—those incorporating user history—improved users’ intent to act and better met their cognitive needs compared to generic ones. Silva et al. Silva et al. 2024 compared personalized and generic explanations, showing that their effectiveness varies depending on the familiarity of the recommended item. Several surveys now map the landscape of LLM-based explainable recommender systems. Zhao et al. Zhao et al. 2024 categorized approaches by training paradigm (pre-training, fine-tuning, prompting) and noted the growing use of CoT prompting for nuanced reasoning. Lin et al. Lin et al. 2025 proposed a 2D taxonomy (“where” and “how” to adapt LLMs), while Chen Chen 2023 and Vats et al. Vats et al. 2024 focused on explanation quality, personalization, and fairness. Across these surveys, a common theme is the lack of user-centered evaluation and the risk of hallucination in LLM explanations. At the model level, several frameworks have pushed the boundaries of LLM alignment. Lei et