Personalized Language Models via Privacy-Preserving Evolutionary Model Merging

Kyuyoung Kim, Jinwoo Shin, Jaehyung Kim · 2025

Read Personalized Language Models via Privacy-Preserving Evolutionary Model Merging by Kyuyoung Kim, Jinwoo Shin, Jaehyung Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-18008.txt.

Introduction

People want language models that speak their language in style and taste, but sharing personal data to train them invites privacy leaks. Kyuyoung Kim, Jinwoo Shin, and Jaehyung Kim propose PriME, a 2025 method that personalizes models by merging them instead of training on raw data.

An evolutionary search, which needs no gradient math, blends model pieces to maximize task usefulness for a target user. Privacy protection is built into the score being optimized, so the search itself steers away from leaky blends. On a standard personalization benchmark, the method beat rival approaches by up to forty-five percent. It also resisted attacks that probe whether a person's data was used, while keeping the personal touch strong.

Catalog record

CREATORKyuyoung Kim, Jinwoo Shin, Jaehyung Kim
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-18008

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Personalized Language Models via Privacy-Preserving Evolutionary Model Merging Kyuyoung Kim, Jinwoo Shin, Jaehyung Kim Abstract Personalization in large language models (LLMs) seeks to tailor models to individual user or user group preferences. Prompt-based methods augment queries with user preference information, whereas training-based methods directly encode preferences into model parameters for more effective personalization. Despite achieving some success in personalizing LLMs, prior methods often fail to directly optimize task-specific metrics and lack explicit privacy-preservation mechanisms. To address these limitations, we propose Privacy-Preserving Model Merging via Evolutionary Algorithms (PriME), a novel approach to personalization that employs gradient-free methods to directly optimize task-specific metrics while preserving user privacy. By incorporating privacy preservation into optimization, PriME produces a personalized module that effectively captures the target user’s preferences while minimizing the privacy risks for the users sharing their private information. Experiments on the LaMP benchmark show that PriME outperforms both prompt-based and training-based methods, achieving up to a 45% performance improvement over the prior art. Further analysis shows that PriME achieves a significantly better privacy-utility trade-off, highlighting the potential of evolutionary approaches for privacy-preserving LLM personalization. 1 Introduction Pre-trained on internet-scale data, large language models (LLMs) have emerged as powerful tools ( Radford et al. 2018 ; Brown et al. 2020 ) , capable of performing a wide range of natural language processing (NLP) tasks, from conversational agents, translation, and question-answering to code generation ( Achiam et al. 2023 ; Team et al. 2024 ) . Notably, LLMs have demonstrated remarkable effectiveness as generalist models, able to perform complex tasks with little to no task-specific data ( Radford et al. 2019 ) . To extend their utility beyond general-purpose applications, LLM personalization seeks to tailor model responses to the preferences of individual users or user groups ( Salemi et al. 2023 ) . Such LLM personalization is particularly important in domains such as education ( Kasneci et al. 2023 ) , healthcare ( Liu et al. 2023 ) , and content recommendation ( Baek et al. 2024 ) to enhance performance and user experience. Previous approaches for LLM personalization can be categorized into two main types: prompt-based and training-based methods. Prompt-based methods incorporate users’ historical data or preferences relevant to the queries into input prompts, enabling models to better understand and respond to user-specific queries ( Mysore et al. 2023 ; Richardson et al. 2023 ; Kim & Yang 2024 ) . While these methods are relatively simple to implement and avoid the need for additional training, the performance is inherently constrained by the model’s context length and may result in significantly higher inference costs due to enlarged input prompts. In contrast, training-based methods capture user behavior patterns and preferences directly in model parameters. One straightforward training-based approach is to fine-tune a single parameter-efficient fine-tuning (PEFT) ( Li et al. 2024b ) module per user on the user’s own personal data ( Tan et al. 2024b ) . However, when user data is limited, training-based approach may not be sufficient for effective personalization. Furthermore, individually owned modules limit the ability to leverage collaborative benefits through shared modules. To partly address this, several approaches assume access to preference data from a range of users or groups to adapt models to the preferences of individual groups ( Li et al. 2024a ; Zhao et al. 2024 ) . However, direct access to raw data from multiple users or groups is often unavailable in practice, and training on combined data to serve such groups poses significant privacy risks, especially in the absence of explicit mechanisms for preserving user privacy. To address these challenges, we propose Pri vacy-Preserving M odel Merging via E volutionary Algorithms (PriME), a novel approach to LLM personalization that leverages knowledge from a community of data-sharing users while preserving their privacy. Given a set of users who have consented to share their PEFT modules, PriME employs evolutionary algorithms to find the optimal weights for linearly interpolating the shared modules (i.e., model merging ( Wortsman et al. 2022 ) ) to create a personalized module for a target user. Here, to explicitly measure the risk of privacy leakage, we define privacy preservation in terms of the similarity between the predictions made with the merged module and those made with each individual module corresponding to a sharing user. Intuitively, this similarity estimates the extent to which information about each sharing user can be inferred from the merged module. Then, the gradient-free nature of evolutionary algorithms allows for the direct optimization of non-differentiable target metrics, such as F1 and ROUGE, with the privacy preservation measure also incorporated into the optimization. Consequently, it enables us to make a trade-off between fitting the target user’s data and preserving the privacy of users sharing their PEFT modules, ensuring that the resulting module effectively captures the target user’s preferences while minimizing the risk of privacy leakage for the sharing users. Note that this is achieved without introducing additional complexities to the model architecture or training, unlike existing methods ( Tan et al. 2024a ) . Figure 1: Overview of PriME. PriME is an evolutionary approach to LLM personalization that optimizes model merging recipes to create a personalized, parameter-efficient fine-tuning module. Using gradient-free optimization, PriME directly optimizes target metrics while incorporating a privacy-preserving mechanism for users sharing their private information, achieving a superior utility-privacy trade-off. Experimental results on LaMP ( Salemi et al. 2023 ) , a comprehensive benchmark comprising personalized text classification and generation tasks, demonstrate that PriME consistently outperforms both prompt-based and training-based baselines, achieving up to a 45% improvement in performance over the best-performing training-based baseline. Notably, this performance is achieved by merging as few as three shared PEFT modules, reducing the risk of privacy leakage by limiting the use of modules trained on private data. Moreover, by directly optimizing for privacy preservation, our approach produces a personalized module that is more distant from the sharing users’ modules than that of a competing merging-based method, while achieving substantially better performance in capturing the target user’s preferences. We also observe that optimizing for privacy preservation can serve as a regularizer to often enhance performance compared to when it is excluded. These findings underscore the potential of evolutionary methods for achieving privacy-preserving LLM personalization. Our main contributions are as follows: • We introduce PriME, an evolutionary approach that automates the discovery of optimal model merging recipes for privacy-preserving LLM personalization. • We propose a measure of privacy preservation that is intuitive and well-suited for optimization, and show that PriME effectively balances capturing user preferences with preserving the privacy of sharing users. • We demonstrate that PriME, leveraging evolutionary methods, consistently outperforms both prompt-based and training-based baselines on the LaMP benchmark, achieving a significantly better utility-privacy trade-off through explicit optimization for privacy preservation. 2 Preliminaries LLM Personalization. Personalizing LLMs involves tailoring model responses to individual users or groups based on their historical behavior data. Specifically, given an LLM \mathcal{M} and history data \mathcal{H}_{u}=\{h_{u}\} for user u , LLM personalization aims to generate an output y that is aligned with the user’s preferences conditioned on both the input x and \mathcal{H}_{u} : \max_{y\sim\mathcal{M}(\cdot\mid x,\mathcal{H}_{u})}f(y,y^{*}), (1) where f is a target metric, such as ROUGE, that measures the similarity between the generated response y and

Read the complete text