BenchPreS: A Benchmark for Context-Aware Personalized Preference Selectivity of Persistent-Memory LLMs

Sangyeon Yoon Sunkyoung Kim Hyesoo Hong Wonje Jeung, [0.4em] Yongil Kim Wooseok Seo Heuiyeen Yeen Albert No, [0.7em] Yonsei University LG AI Research · 2026

Read BenchPreS: A Benchmark for Context-Aware Personalized Preference Selectivity of Persistent-Memory LLMs by Sangyeon Yoon Sunkyoung Kim Hyesoo Hong Wonje Jeung, [0.4em] Yongil Kim Wooseok Seo Heuiyeen Yeen Albert No, [0.7em] Yonsei University LG AI Research (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16557.txt.

Introduction

Yoon and co-authors test whether AI assistants apply saved user preferences with judgment. Persistent memory helps personalization, but some preferences clash with social norms. BenchPreS checks if models apply or suppress preferences by context. Two metrics score misapplication and apt application. Even frontier models struggled at this selectivity. Stronger preference followers over-applied the most. Reasoning skill and prompt defenses did not fix the flaw. Models treat preferences as global rules, not context signals.

Catalog record

CREATORSangyeon Yoon Sunkyoung Kim Hyesoo Hong Wonje Jeung, [0.4em] Yongil Kim Wooseok Seo Heuiyeen Yeen Albert No, [0.7em] Yonsei University LG AI Research
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36982
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.16557

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

BenchPreS: A Benchmark for Context-Aware Personalized Preference Selectivity of Persistent-Memory LLMs Sangyeon Yoon Sunkyoung Kim Hyesoo Hong Wonje Jeung, [0.4em] Yongil Kim Wooseok Seo Heuiyeen Yeen Albert No, [0.7em] Yonsei University LG AI Research Abstract Large language models (LLMs) increasingly store user preferences in persistent memory to support personalization across interactions. However, in third-party communication settings governed by social and institutional norms, some user preferences may be inappropriate to apply. We introduce BenchPreS , which evaluates whether memory-based user preferences are appropriately applied or suppressed across communication contexts. Using two complementary metrics, Misapplication Rate (MR) and Appropriate Application Rate (AAR), we find even frontier LLMs struggle to apply preferences in a context-sensitive manner. Models with stronger preference adherence exhibit higher rates of over-application, and neither reasoning capability nor prompt-based defenses fully resolve this issue. These results suggest current LLMs treat personalized preferences as globally enforceable rules rather than as context-dependent normative signals. 1 Introduction Large language models (LLMs) are increasingly deployed as personalized assistants and agents to support long-term interaction with users ( 1 ; 40 ; 4 ; 26 ; 42 ) . Recent advances in long-context LLMs ( 27 ) have made it common to incorporate user preferences into a persistent memory system and reuse them across interactions for personalization ( 32 ; 12 ; 5 ; 7 ) . As LLMs are used for third-party communication ( i.e., LLMs-as-Agents ), including automated replies, email composition, and app integrations ( 35 ; 13 ; 30 ) , a key challenge arises: Can LLMs selectively apply personalized preferences stored in persistent memory? Figure 1: Preference selectivity across models. Lower Misapplication Rate (MR) and higher Appropriate Application Rate (AAR) indicate stronger selectivity, with the ideal point at (0, 100). Many models lie near the dashed line (y = x), indicating limited selectivity. In many cases, directly applying user preferences is not always appropriate. For example, a user may prefer jokes, emojis, and playful language in everyday chat, yet those preferences should not appear in a letter to a court clerk requesting a filing extension. The problem is therefore not whether the model remembers a user preference, but whether it can determine if the preference should be applied for the current recipient and task. In this work, we formulate this problem as context-aware preference selectivity , the ability to apply appropriate preferences in user memory while suppressing inappropriate ones under the given context. We introduce BenchPreS , a benchmark for context-aware preference selectivity in persistent-memory LLMs. Existing benchmarks primarily evaluate how well models follow user preferences, implicitly assuming preferences should always be applied ( 39 ; 22 ; 44 ) . In contrast, our benchmark evaluates whether language models can distinguish when preferences should be applied or suppressed. Figure 2: BenchPreS setup overview. Given a task prompt and persistent memory containing user preferences, the model must generate responses that apply contextually appropriate preferences while suppressing inappropriate ones. The top example succeeds, whereas the bottom example fails. BenchPreS is structured around two core components: context and user profile, following the benchmark formulation of CIMemories ( 29 ) . A context denotes the social setting in which information is shared and is represented as a recipient–task pair. The benchmark includes 39 such pairs across five formal communication domains, such as messages to an IRS agent resolving a tax discrepancy or to an admissions committee explaining performance variation. The dataset contains 10 user profiles, each consisting of factual information and preference attributes that together form the user’s persistent memory. Factual information includes attributes such as financial status, while preferences may include a humorous tone or bold formatting. Each evaluation instance pairs a user profile with a context. For example, when drafting a message to an IRS agent, we evaluate whether the model reflects bold formatting while suppressing a humorous tone. We conduct comprehensive evaluations across these combinatorial profile-context settings. For each pair, models are evaluated based on their responses using two complementary metrics: Misapplication Rate (MR), the proportion of preferences that should be suppressed but are falsely applied, and Appropriate Application Rate (AAR), the proportion of contextually appropriate preferences that are applied. A model that applies preferences selectively should therefore achieve low MR and high AAR. However, across models, MR reaches as high as 86.48%, indicating substantial over-application. Although GPT-5.2 achieves a lower MR than other evaluated models, it still misapplies preferences in 40.95% of cases. Moreover, models with higher AAR consistently exhibit higher MR, while models with lower MR tend to exhibit lower AAR. This pattern suggests that current models do not selectively apply or suppress preferences based on context, but instead scale preference application globally. Additional analysis shows that reasoning capability or prompt-level mitigation alone cannot fully resolve these failures. Enabling explicit reasoning improves general instruction-following performance ( 36 ) , yet within the same model it increases not only AAR but also MR, amplifying overall preference responsiveness without improving selectivity. Conversely, prompt-based defenses, which instruct the model to apply preferences only when appropriate, reduce MR at the cost of slightly lower AAR, but do not fully eliminate misapplication. These results highlight the need for more fundamental approaches that enable models to apply preferences selectively across contexts. 2 Related Work Persistent Memory Systems in LLMs. To enable personalization, early studies proposed selectively retrieving user records relevant to the current query, rather than directly injecting all user information into the LLM input ( 25 ; 11 ; 10 ) . Building on this approach, subsequent work proposed retrieval-augmented prompting methods that maintain separate memory stores and inject only salient personalized information into prompts via retrievers ( 39 ; 31 ; 46 ) . These methods were further extended by combining sparse and dense retrievers with diverse memory structures ( 23 ; 37 ; 24 ) . More recently, with substantial improvements in LLMs’ long-context processing capabilities ( 27 ) , a simpler approach has become widely adopted: prefixing memory as text at the beginning of the current dialogue. In this approach, persistent memory is treated as continuous textual input, and retrieving relevant user information becomes akin to a needle-in-a-haystack problem ( 32 ) . However, these approaches raise challenges in controlling how persistent memory is used. CIMemories ( 29 ) highlights that sensitive user information can be unnecessarily recalled even when irrelevant. AgentDAM ( 45 ) identifies memory as a leakage channel, and PS-Bench ( 17 ) shows that even benign attributes can increase jailbreak attack success rates. Personalization and Preference Following. Prior work on LLM personalization has primarily evaluated how well models can remember and reflect user-specific information ( 43 ; 28 ) . Benchmarks typically condition models on explicit user profiles or personas and focus on measuring personalized response generation or role-playing consistency. For example, LAMP ( 39 ) evaluates profile-conditioned personalization tasks via retrieval-augmented prompting, while RP-Bench ( 6 ) , TimeChara ( 3 ) , and RoleLLM ( 41 ) analyze persona maintenance through character consistency, temporal coherence, and speaking style imitation. In parallel, PrefEval ( 44 ) evaluates models’ ability to infer, retain, and apply user preferences over long, multi-session dialogues, whereas Followbench ( 22 ) and AdvancedIF ( 20 ) assess how accurately models comply with explicitly

Read the complete text