Efficient Personalization of Generative User Interfaces
Yi-Hao Peng 1 , Samarth Das 2 , Jeffrey P. Bigham 1 , Jason Wu 2 · 2026
Read Efficient Personalization of Generative User Interfaces by Yi-Hao Peng 1 , Samarth Das 2 , Jeffrey P. Bigham 1 , Jason Wu 2 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-09876.txt.
Introduction
Peng, Bigham, and Wu study personalizing generative interfaces, which adapt on demand to screens not yet built. Personal taste must be learned from sparse, subjective feedback on generated screens, since settings cannot be preset. In a new dataset, 20 people each judged 600 interface pairs, disagreeing sharply, with Krippendorff's alpha of 0.25. Their method weights prior users' tastes from a few pairwise judgments, beating a pretrained evaluator and a larger model offline. In an online trial with 12 new users, people preferred its interfaces over all baselines, including shared guidelines and written tastes.
Catalog record
| CREATOR | Yi-Hao Peng 1 , Samarth Das 2 , Jeffrey P. Bigham 1 , Jason Wu 2 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57830 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.09876
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Efficient Personalization of Generative User Interfaces Yi-Hao Peng 1 , Samarth Das 2 , Jeffrey P. Bigham 1 , Jason Wu 2 Abstract . Generative user interfaces (UIs) create new opportunities to adapt interfaces to individual users on demand, but personalization remains difficult because desirable UI properties are subjective, hard to articulate, and costly to infer from sparse feedback. We study this problem through a new dataset in which 20 trained designers each provide pairwise judgments over the same 600 generated UIs, enabling direct analysis of preference divergence. We find substantial disagreement across designers ( κ = 0.25 \kappa=0.25 ), and written rationales reveal that even when designers appeal to similar concepts such as hierarchy or cleanliness, designers differ in how they define, prioritize, and apply those concepts. Motivated by these findings, we develop a sample-efficient personalization method that represents a new user in terms of prior designers rather than a fixed rubric of design concepts. In a technical evaluation, our preference model outperforms both a pretrained UI evaluator and a larger multimodal model, and scales better with additional feedback. When used to personalize generation, it also produces interfaces preferred by 12 new designers over baseline approaches, including direct user prompting. Our findings suggest that lightweight preference elicitation can serve as a practical foundation for personalized generative UI systems. Figure 1 . Overview of our personalization pipeline for generative UIs. (1) We collect repeated pairwise preference judgments from users over shared pools of generated UIs, which reveals individual disagreement along dimensions like information density, hierarchy, and visual style. (2) For a new user, our method learns a user-specific preference model through a brief adaptive onboarding, where each pairwise response updates a shared prior and helps select the next comparison. (3) The learned model reranks candidate UIs for the same prompt, so different users receive interfaces that better match their preferences. 1. Introduction Personalizing interfaces to individual users is a long-standing goal in human-centered computing. Prior work has adapted interfaces to measurable user characteristics such as abilities and device constraints ( 29 ; 89 ) , as well as inferred factors such as task goals and interaction context ( 65 ; 34 ) . Yet many aspects of interface preference remain difficult to model because they are subjective and difficult to articulate. Generative user interfaces (GenUIs) make this challenge especially salient. Rather than selecting from a fixed set of pre-authored designs, GenUI systems can synthesize interfaces on demand to fulfill a user’s request ( 57 ; 16 ) . This flexibility creates new opportunities for personalization, since layout, style, and information density can be adapted at generation time. At the same time, it changes how personalization must be achieved. Because such interfaces may be ephemeral and created for a single interaction, they are less amenable to post hoc customization through persistent settings or a small set of handcrafted variants. The preferences that matter for generation are also difficult to specify directly, whether as a fixed set of generator controls or as instructions in a system prompt. Instead, the system must learn a representation of user preferences from prior behavior and sparse feedback that can guide generation. This presents a challenging personalization problem. For any new user, only a small amount of feedback is typically available, yet the system must generalize to newly generated interfaces rather than choose among items in a fixed catalog. At the same time, a single aggregate model is insufficient if interface preferences differ systematically across individuals rather than merely reflecting noise. These constraints motivate an approach that leverages data from prior users while adapting efficiently to a new user from only a few observations. In this paper, we study whether individual design preferences can be learned efficiently and used to improve generative UI systems. To support this goal, we collect a novel dataset in which 20 designers provide repeated pairwise judgments over the same 600 generated interfaces, enabling direct analysis of preference divergence. We find substantial disagreement across even trained designers ( \kappa=0.25 ), and written rationales show that even when designers invoke similar concepts such as hierarchy or cleanliness, they often interpret them differently. Motivated by these findings, we develop a sample-efficient personalization method that represents a new user in terms of prior designers rather than a fixed rubric of design concepts. In offline evaluation measuring “judge” performance, our method outperforms several baselines, including substantially larger multimodal models, and makes more effective use of additional feedback. We then integrate the learned preference model into a personalized generation pipeline by reranking candidates from a base generator. In an end-to-end study with 12 new designers, participants preferred the resulting interfaces over those from baseline approaches, including prompting with users’ self-described preferences. In summary, our work contributes: (1) A new dataset for studying personalization in generative UIs, consisting of 12,000 pairwise preference labels from 20 designers over 600 generated interfaces. (2) An analysis of preference divergence in interface design, showing substantial disagreement across designers and qualitative differences in how shared design concepts are interpreted. (3) A sample-efficient personalization method and end-to-end generation pipeline that outperform strong baselines in both offline preference prediction and online interface generation. 2. Related Work Our work builds on prior research on how interfaces are assessed, adapted, and improved from human feedback. We review three areas most relevant to our setting: (1) UI evaluation, (2) UI adaptation and generation, and (3) preference learning and personalization. 2.1. UI Evaluation Early computational approaches to UI evaluation focused on properties that most people tend to agree on. Hand-crafted measures for aesthetics, clutter, and complexity were later packaged into reusable perceptual analysis tools ( 55 ; 56 ; 62 ) . Affective and physiological signals offered a lower-effort way to distinguish stronger from weaker interfaces ( 33 ) . These methods are useful for measuring common perceptual qualities but do not model how taste differs across individuals. More recent work replaces fixed metrics with learned critics. Prompting large multimodal or vision-language models (LMM/VLM) with design heuristics can produce useful critiques of UI mockups, and pairing designers’ annotations with region-level quality scores strengthens that direction ( 25 ; 24 ) . UI-specific evaluators trained for design quality and prompt relevance push evaluation further, though benchmarks show that general-purpose multimodal models still match human UI judgments only moderately well ( 90 ; 50 ) . Other work broadens the scope of evaluation itself. Some tie pairwise assessment to real A/B test outcomes, while others show that richer feedback modalities like comments, sketches, and direct manipulation can supervise UI generation more effectively than rankings alone ( 37 ; 92 ) . All of these efforts aim at a single shared standard of quality. Our work shifts the question from shared judgment to personalized judgment, studying how an evaluator can adapt to a particular user’s preferences while preserving shared notions of UI quality. 2.2. UI Adaptation and Generation Several methods have been explored for adapting interfaces to individual users. For example, optimization-based systems apply some of the same hand-crafted measurements used in UI evaluation was objectives for searching over generation candidates ( 27 ; 28 ; 30 ; 29 ) . This line of work established the value of personalization but also exposed