PersonalizedRouter : Personalized LLM Routing via Graph-based User Preference Modeling

Zhongjie Dai [email protected] of Illinois at Urbana-Champaign, Tao Feng [email protected] of Illinois at Urbana-Champaign Jiaxuan You [email protected] of Illinois at Urbana-Champaign · 2025

Read PersonalizedRouter : Personalized LLM Routing via Graph-based User Preference Modeling by Zhongjie Dai [email protected] of Illinois at Urbana-Champaign, Tao Feng [email protected] of Illinois at Urbana-Champaign Jiaxuan You [email protected] of Illinois at Urbana-Champaign (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-16883.txt.

Introduction

Zhongjie Dai, Tao Feng, and Jiaxuan You present PersonalizedRouter, a system that picks which large language model should answer each user query based on that user's own tastes. Users differ in how they trade off quality, cost, and response style, while existing routers optimize one fixed objective for everyone.

PersonalizedRouter learns preferences from interaction records containing the task context, the query, the candidate models, and the user's actual choice. Those records become a heterogeneous graph linking users, queries, and models, and routing decisions are read off that structure. A new benchmark, PersonaRoute-Bench, simulates a thousand users choosing among ten models. The router beat the strongest existing methods by wide margins under two evaluation strategies and generalized well to new users and new models from few examples.

Catalog record

CREATORZhongjie Dai [email protected] of Illinois at Urbana-Champaign, Tao Feng [email protected] of Illinois at Urbana-Champaign Jiaxuan You [email protected] of Illinois at Urbana-Champaign
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-16883

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PersonalizedRouter : Personalized LLM Routing via Graph-based User Preference Modeling Zhongjie Dai [email protected] of Illinois at Urbana-Champaign, Tao Feng [email protected] of Illinois at Urbana-Champaign Jiaxuan You [email protected] of Illinois at Urbana-Champaign Abstract The growing number of Large Language Models (LLMs) with diverse capabilities and response styles provides users with a wider range of choices, which presents challenges in selecting appropriate LLMs, as user preferences vary in terms of performance, cost, and response style. Current LLM selection methods typically optimize for a single fixed objective, such as performance, cost, or a trade-off between them, and fail to learn individual user preferences from interaction data. To address these limitations, we propose PersonalizedRouter , a graph-based framework that models diverse user profiles and performs personalized LLM selection by leveraging interaction data that includes task context, queries, candidate LLMs, and user decisions. To capture contextual information between user queries and optimal LLMs, PersonalizedRouter converts the interaction data into a heterogeneous graph, where the relationships between different types of nodes are represented by edges. To evaluate adaptability across users, we design two strategies: the multi-cost-efficiency simulation strategy and the LLM-as-a-Judge strategy. In addition, we construct PersonaRoute-Bench , a large-scale benchmark with 1,000 simulated users and 10 LLMs. Experimental results show that PersonalizedRouter significantly outperforms existing LLM selection methods and surpasses the strongest methods by a large margin of 15.38% and 9.83% under two simulation strategies. On the PersonaRoute-Bench with 1,000 users, it further surpasses the best methods by 16.19% and 59.69% while maintaining higher efficiency. Moreover, PersonalizedRouter demonstrates strong few-shot generalization, achieving 64.81% and 85.80% of the fully trained model’s performance when adapting to new users and new LLMs. 1 1 footnotetext: Equal contribution. 2 2 footnotetext: Work was done while the author was an intern at the University of Illinois at Urbana Champaign. An additional contact email is [email protected] ulab-uiuc/PersonalizedRouter Hugging Face Collection 1 Introduction In recent years, the rapid growth of model scale and advances in training techniques have fueled the explosive emergence of LLMs ( Feng et al. 2025c ; Feng et al. 2024a ; Feng et al. 2025a ; Chen et al. 2025 ) , offering users a diverse range of choices. Although large-scale language models have shown remarkable performance on many tasks, they tend to be inefficient when dealing with simple problems. In some scenarios, small-scale language models can achieve comparable performance while requiring fewer resources. Moreover, different LLMs excel at different tasks, exhibiting varying performance and cost efficiency on the specific application, while domain-specific expert models often achieve superior results on specialized tasks. In addition to differences in response quality and cost, LLMs also exhibit diverse response styles, which influence users’ understanding of the query ( Zhang et al. 2025b ; Feng et al. 2024b ) . In multi-user scenarios, users often have distinct preferences that are difficult to model directly ( Feng et al. 2025c ; Zhang et al. 2025b ; Sun et al. 2025 ) , making it challenging for a single LLM to serve all users consistently. Therefore, this paper aims to draw attention to this pressing research question: Given multiple user preferences, how can we design an LLM router that is personalized for each individual user? Current LLM selection methods aim to predict the most suitable LLM for a given user query using various strategies. HybridLLM ( Ding et al. 2024 ) utilizes a pre-trained language model to make binary decisions between a large and a small LLM. FrugalGPT ( Chen et al. 2023 ) uses a pre-trained model to score the responses to select the best LLM under a given cost constraint. RouterDC ( Shuhao et al. 2024 ) encodes the input query using a pre-trained encoder and selects the LLM whose embedding is most similar to the query embedding. GraphRouter ( Feng et al. 2024b ) constructs a heterogeneous graph based on user interaction data and uses a Graph Neural Network (GNN) to predict the most suitable LLM for a given query. However, a fundamental limitation in current approaches is that they fail to adequately account for user preferences (Table 1 ). Many existing methods depend on simplistic representations such as BERT-based embeddings to distinguish between queries and optimize for a single fixed objective (e.g., performance only). This narrow focus restricts their ability to generalize to multi-user scenarios. Table 1 : Comparison of PersonalizedRouter with current LLM selection methods. Unlike previous approaches, PersonalizedRouter introduces an inductive graph framework for multi-user scenarios that leverages user interaction information, enabling it to capture latent user preferences to generalize to new users. Method Multi-task Support Generalization to New LLMs and Users User preference modeling Hybrid LLM ( Ding et al. 2024 ) ✗ ✗ ✗ FrugalGPT ( Chen et al. 2023 ) ✗ ✗ ✗ C2MAB-V ( Dai et al. 2024 ) ✗ ✗ ✗ RouterDC ( Shuhao et al. 2024 ) ✗ ✗ ✗ GraphRouter ( Feng et al. 2024b ) ✓ ✗ ✗ PersonalizedRouter ✓ ✓ ✓ Existing methods struggle to adapt to multiple users because they fail to capture user preferences from historical interaction data and typically rely on fixed optimization objectives. To address these challenges, we propose PersonalizedRouter , a graph-based framework that leverages user interaction data to provide personalized LLM selection for different users. Specifically, PersonalizedRouter constructs a heterogeneous graph consisting of query nodes, task nodes, LLM nodes, and user nodes, and these nodes are connected through edges that represent different user preferences, such as performance-first or style-oriented choices. By aggregating information across different types of nodes, the GNN captures diverse latent user preferences through embeddings, enabling more effective LLM selection for new queries. To comprehensively evaluate the adaptability of LLM selection methods in multi-user scenarios, we design two simulation strategies that model diverse user behaviors: multi-cost-efficiency, which calculates a reward score balancing performance and inference cost, and LLM-as-a-Judge, which leverages user profiles to instruct LLMs to simulate different preference groups. Based on these strategies, we construct PersonaRoute-Bench , a large-scale benchmark with over 1,000 simulated users and 10 LLMs, providing a realistic setting for evaluating scalability and user diversity. Experimental results show that PersonalizedRouter outperforms existing LLM selection methods by 9.83% and 15.38% under the two simulation settings. On PersonaRoute-Bench , it further surpasses the strongest baseline by 16.19% while maintaining high efficiency, with only a 5% drop in performance as the scale increases. To simulate dynamic real-world settings, we introduce new user and new LLM scenarios where interaction data from new users or new LLMs are excluded during training. PersonalizedRouter achieves 64.81% and 85.90% of the fully trained model’s performance in these settings, respectively. To mitigate potential biases introduced by simulated user preferences, we additionally collect a small-scale human interaction dataset. Our model outperforms the best baseline by 6.05%, demonstrating strong generalization to real-user scenarios. To summarize, our main contributions are as follows. • We propose PersonalizedRouter , a graph-based personalized routing framework for multi-user LLM selection problems that models diverse user preferences and generalizes effectively to unseen users and new LLMs. • We propose two simulation strategies to evaluate the adaptability of methods, considering response quality, inference cost, and response style. Our model consistently outperforms baseline models by at least 9.83%. Furthermore, it surpasses all baselines not only in

Read the complete text