Stealthy LLM-Driven Data Poisoning Attacks Against Embedding-Based Retrieval-Augmented Recommender Systems Conference: Adjunct Proceedings of the 33rd ACM Conference on User Modeling, Adaptation and Personalization; June 16–19, 2025; New York City, NY, USA Adjunct Proceedings of the 33rd ACM Confere

Fatemeh Nazary, Yashar Deldjoo, Tommaso di Noia, Eugenio di Sciascio · 2025

Read Stealthy LLM-Driven Data Poisoning Attacks Against Embedding-Based Retrieval-Augmented Recommender Systems Conference: Adjunct Proceedings of the 33rd ACM Conference on User Modeling, Adaptation and Personalization; June 16–19, 2025; New York City, NY, USA Adjunct Proceedings of the 33rd ACM Confere by Fatemeh Nazary, Yashar Deldjoo, Tommaso di Noia, Eugenio di Sciascio (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-05196.txt.

Introduction

Fatemeh Nazary, Yashar Deldjoo, Tommaso Di Noia, and Eugenio Di Sciascio study a quiet way to rig recommendation systems, in a 2025 paper. Modern recommenders pull item details from a text store and rank goods with the help of large language models. A seller who edits a few words in an item's text, adding feeling words or lines from related items, can push that item up or drag a rival down.

The team set rules for such attacks that limit the edits and keep the text close in meaning to the source. In tests on a movie data set with two language model setups, small edits shifted rankings and exposure a lot, yet slipped past simple checks. The authors urge stronger text checks and clear records of where item text came from.

Catalog record

CREATORFatemeh Nazary, Yashar Deldjoo, Tommaso di Noia, Eugenio di Sciascio
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-05196

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Stealthy LLM-Driven Data Poisoning Attacks Against Embedding-Based Retrieval-Augmented Recommender Systems Conference: Adjunct Proceedings of the 33rd ACM Conference on User Modeling, Adaptation and Personalization; June 16–19, 2025; New York City, NY, USA Adjunct Proceedings of the 33rd ACM Conference on User Modeling, Adaptation and Personalization (UMAP Adjunct ’25), June 16–19, 2025, New York City, NY, USA DOI: 10.1145/3708319.3733675 ISBN: 979-8-4007-1399-6/2025/06 ISBN: 978-1-4503-XXXX-X/2018/06 Fatemeh Nazary, Yashar Deldjoo, Tommaso di Noia, Eugenio di Sciascio Abstract . We present a systematic study of provider-side data poisoning in retrieval-augmented recommender systems (RAG-based). By modifying only a small fraction of tokens within item descriptions—for instance, adding emotional keywords or borrowing phrases from semantically related items—an attacker can significantly promote or demote targeted items. We formalize these attacks under token-edit and semantic-similarity constraints, and we examine their effectiveness in both promotion (long-tail items) and demotion (short-head items) scenarios. Our experiments on MovieLens, using two large language model (LLM) retrieval modules, show that even subtle attacks shift final rankings and item exposures while eluding naive detection. The results underscore the vulnerability of RAG-based pipelines to small-scale metadata rewrites, and emphasize the need for robust textual consistency checks and provenance tracking to thwart stealthy provider-side poisoning. 1. Introduction Retrieval - augmented generation (RAG) enhances large language models (LLMs) by grounding their outputs in external data sources, such as item reviews or user tags, rather than relying solely on internal parameters ( Fan et al. 2024 ; Deldjoo et al. 2024a ; Deldjoo et al. 2024b ) . This grounding improves recency and factual accuracy. In fact, industry reports estimate that over 60% of LLM - powered search and recommendation systems now use RAG ( Fan et al. 2024 ; Nazary et al. 2025 ) . A common RAG-based recommender architecture (Figure 1 ) retrieves candidate items from an external knowledge store (e.g., a database or corpus of item descriptions) and then uses an LLM to synthesize the retrieved text into final recommendations. While classical methods such as collaborative filtering (CF) can provide a base in the retrieval stage by analyzing user-item interactions, embedding-based retrieval has emerged as a particularly powerful approach in RAG pipelines. Embedding models such as BERT-like encoders or Sentence Transformers can capture an item semantic representation and dynamically decide when to retrieve additional context. By leveraging these embeddings, a recommender system can handle new or infrequently discussed items, which often appear in long-tail domains. At the same time, these embedding-based retrieval methods offer clear advantages: they provide stronger factual grounding and can adapt to real-time changes in external data. For example, if an item has recently won an award, the RAG pipeline can incorporate that information into the recommendations without retraining the entire model. Notwithstanding their great potential, as more RAG variants adopt embedding-driven approaches, they lean heavily on textual cues, which can open the door to attacks at the data or metadata level. For example, an attacker can subtly inject changes into item descriptions (e.g. emotional phrases, negative triggers) to manipulate how both retrieval and generation perceive an item. Unlike classic poisoning that directly tampers with user ratings, text-based attacks may remain undetected if they preserve the original semantics. Figure 1. High-level RAG architecture in a recommender setting. A retriever selects candidate items (step 1). An LLM uses these retrieved texts and user queries to re-rank or generate final recommendations (step 2). In our poisoning scenario (red arrow), an attacker subtly modifies item descriptions to alter how retrieval and generation perceive items. Related Work and Gaps. LLM vulnerabilities to prompt injection and adversarial prompts have been well documented ( Liu et al. 2023 ; Wang et al. 2024 ; Wei et al. 2024 ; Chowdhury et al. 2024 ) , however, these studies focus on standalone models rather than recommendation pipelines. In the recommender domain, early poisoning attacks manipulated user ratings or profiles to distort collaborative filtering outputs ( Deldjoo et al. 2021 ) . More recently, RAG–specific threats emerged: BadRAG ( Xue et al. 2024 ) and PoisonedRAG ( Zou et al. 2024 ) inject malicious snippets into knowledge bases to warp retrieval or LLM responses. Tag - based poisoning for RAG recommenders was explored in ( Nazary et al. 2025 ) , showing that modified user tags can bias item ranking. However, full metadata, such as item descriptions and reviews, remains underexamined. Furthermore, prior methods often rely on simple keyword insertion, which can be detected by basic semantic or stylistic filters. In contrast, we leverage modern LLM rewriting techniques to design coherent, low - budget alterations that better evade detection ( Deldjoo et al. 2025 ) . Goals and Contributions Our primary objective is to formally investigate provider-side data poisoning attacks on retrieval-augmented recommenders, focusing on two scenarios: promotion (boosting long-tail items) and demotion (penalizing highly popular items). In doing so, we introduce the notion of “textual stealthiness,” measured through semantic similarity (e.g., SBERT-based) along with overall system-level metrics, to quantify how much an attack can subtly rewrite an item’s description while still achieving malicious ranking shifts. Our main contributions include: • We present a formal definition of provider-side textual rewriting attacks in RAG-based recommendation, framed around two adversarial goals ( promote vs. demote ). • We use a measurement of “stealthiness” by examining how sentence-level semantics change (via SBERT) alongside the overall impact on RS accuracy; • We design and implement three distinct attack variations: (i) Emotional edits, (ii) Neighbor-based borrowing, and (iii) Chained rewriting (combining both), all under the same edit-budget constraints. • We empirically evaluate these methods across two different SoA LLMs on the of the MovieLens latest dataset, and demonstrate the potency of small-scale textual manipulations on altering the exposure of carefully selected target items; • We plan to release both code and data resources to foster reproducibility and future research in adversarial robustness for RAG-based recommender systems. 2. Formal Description of LLM-Driven Data Poisoning Attacks The overarching goal of the attacker is to manipulate item visibility within the recommendation pipeline by rewriting the textual descriptions of items. Concretely, we select a subset of items from both the long-tail (unpopular) and short-head (popular) segments, aiming to promote the former (i.e., increase their exposure) or demote the latter (i.e., decrease their visibility). Formally, for each targeted item i\in I_{\text{poison}} with original description D_{i} , we produce a new description \widetilde{D}_{i} such that (1) the token-level change is bounded by \delta (e.g., 10% of |D_{i}| tokens may be altered), and (2) the rewritten text maintains a sufficiently high semantic similarity (e.g., SBERT score above 0.80) to remain stealthy. The attacker’s optimization objective is then to maximize (in the promote case) or minimize (in the demote case) each item’s final ranking position or exposure in top- k recommendations after the system retrains on \widetilde{D}_{i} : (1) \displaystyle\max_{\{\widetilde{D}_{i}\}}\sum_{i\in I_{\text{poison}}}\Delta\Bigl(\text{Exposure}(i)\Bigr) \displaystyle\text{subject to}\quad H\bigl(D_{i},\widetilde{D}_{i}\bigr)\leq\delta|D_{i}|, \displaystyle\text{Sim}\bigl(D_{i},\widetilde{D}_{i}\bigr)\geq\sigma_{\mathrm{min}}. Here, \Delta\bigl(.) denotes the change in ranking of item i within the ranking list (either at the retrieval level with top- N or the final recommendation level with top- k ). In our experiment, we set N=50 and K=20 . The function H(\cdot) represents a distance metric, where \delta introduces the notion of stealthiness , ensuring that modifications remain subtle yet effective. We specifically instruct the LLM to modify

Read the complete text