AlignUI : A Method for Designing LLM-Generated UIs Aligned with User Preferences CCS: Human-centered computing Human computer interaction (HCI)
Yimeng Liu, Misha Sra, Chang Xiao · 2026
Read AlignUI : A Method for Designing LLM-Generated UIs Aligned with User Preferences CCS: Human-centered computing Human computer interaction (HCI) by Yimeng Liu, Misha Sra, Chang Xiao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17614.txt.
Introduction
Yimeng Liu, Misha Sra, and Chang Xiao present AlignUI for interface design with language models. Good interfaces match user taste, but finding that match takes long cycles. Teams prototype, test, and refine again and again. LLM-based UI generation speeds the build phase. AlignUI aims to steer that speed toward user preference.
A fast tool that misses taste saves little time. Alignment methods close the gap between first draft and fit. Designers can explore more options in the same span. Users gain screens shaped to their habits. The work joins generation with feedback in one loop. It serves product teams under real deadlines.
Catalog record
| CREATOR | Yimeng Liu, Misha Sra, Chang Xiao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-17614
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AlignUI : A Method for Designing LLM-Generated UIs Aligned with User Preferences CCS: Human-centered computing Human computer interaction (HCI) Yimeng Liu, Misha Sra, Chang Xiao Abstract . Designing user interfaces that align with user preferences is a time-consuming process, which requires iterative cycles of prototyping, user testing, and refinement. Recent advancements in LLM-based UI generation have enabled efficient UI generation to assist the UI design process. We introduce AlignUI , a method that aligns LLM-generated UIs with user tasks and preferences by using a user preference dataset to guide the LLM’s reasoning process. The dataset was crowdsourced from 50 general users (the target users of generated UIs) and contained 720 UI control preferences on eight image-editing tasks. We evaluated AlignUI by generating UIs for six unseen tasks and conducting a user study with 72 additional general users. The results showed that the generated UIs closely align with multiple dimensions of user preferences. We conclude by discussing the applicability of our method to support user-aligned UI design for multiple task domains and user groups, as well as personalized user needs. Figure 1 . AlignUI supports user preference-aligned UI design with LLM-based UI generation (left). With the user context, which contains user task and preference, an LLM is prompted to reason UIs guided by a user preference dataset (right). This dataset consists of a set of tasks and multiple user preferences for each task. For each user preference, the dataset contains user-preferred UI controls. We collect this dataset by crowdsourcing (§ 4.2.2 ). With the dataset, the UI reasoning follows a multi-stage approach, where the LLM first identifies tasks in the dataset that are similar to the user task, then finds user preference that matches the user-specified preference, and finally reasons and generates UI controls that align with the user task and preference. This figure shows a flowchart of user preference-aligned UI generation guided by a user preference dataset on the left, and a illustration of the user preference dataset on the right. The flowchart takes user context as input, uses it to reason UIs guided by the user preference dataset, and generates UIs aligned with the user context (user task and preference). The user preference dataset contains a set of tasks, multiple user preferences, and user-preferred UI controls. 1. Introduction Designing and creating user interfaces (UIs) that resonate with their target users’ preferences is a cornerstone of modern digital interaction. The UI design process with user preference taken into account is labor-intensive, which requires significant cross-disciplinary expertise to bridge the silos between creative vision, technical feasibility, and user alignment ( 30 ) . Designers need to hand-craft the design of each UI control and make sure it aligns with the intended functionality ( 28 ) . Beyond these functional requirements of UI interactions, designers also need to navigate tradeoffs between aesthetic appeal and perceived usability, as visual presentation has been shown to fundamentally impact user performance and satisfaction ( 55 ) . Aligning these designs with target users’ needs and preferences further complicates this process, which often requires iterative cycles of prototyping, user testing, and refinement ( 51 ; 14 ) . To assist the UI design process, tools have been developed to support UI programming ( 33 ) , digital UI design and prototyping ( 1 ; 10 ) , and AI-based automatic UI generation ( 24 ; 17 ) . However, these tools either require extensive manual efforts to craft and iterate on UI designs, or delegate the UI design process entirely to AI models, which risks the agency of UI designers. To balance automation and human agency, recent research has explored human-AI collaboration in the UI design and prototyping process ( 53 ) . Though helpful to bridge human and AI capabilities and allow human-centered UI design experience, the AI-generated UI design suggestions do not always align with designers’ goals or target users’ preferences, such that the designers often need to refine AI outputs through long-term, back-and-forth interaction. Recent advancements in large language model (LLM)-based UI generation have shown great potential to simplify the UI design process. UI designers can generate functional UIs from simple natural language prompts ( 22 ) . Such capability can enable cheaper UI prototyping and iteration with fast UI generation and preliminary user insights used to train the LLMs. These LLM-generated UIs have been explored in desktop applications ( 26 ) and web pages ( 22 ) , as well as to support UI prototyping ( 27 ) , UI design space search ( 42 ) , and user experience (UX) practices ( 6 ) . While promising, the UIs generated by these models are often generic. They frequently fail to capture the nuanced, subjective user preferences, leading to interfaces that may be technically functional but experientially disconnected with target users (based on our formative study in Section 3 ). Even with user instructions to refine the LLM-generated outputs, LLMs can still struggle to effectively follow these instructions to produce user-desired results ( 66 ) . In addition, LLM-generated content is inconsistent, which can be different from run to run even when the temperature parameter is set as zero ( 63 ) , causing the generated UIs difficult to predict ( 57 ) . The generic, inconsistent LLM-generated UIs go contrary to the desired benefits of automation for user preference-aligned UI generation since designers still need extensive editing to refine the LLM-generated prototypes and align these prototypes with target users. To bridge this gap, prior research typically relies on reinforcement learning from human feedback (RLHF) ( 41 ) with direct preference optimization (DPO) ( 46 ) or group relative policy optimization (GRPO) ( 49 ) to align LLM outputs with human preference and intent. However, these techniques are often applied in the LLM post-training stage and known to be data intensive and computationally expensive ( 20 ) . This creates a high barrier to entry and limits the ability of UI designers to rapidly adapt models to evolving user preferences or needs. To address these challenges, we introduce AlignUI , a lightweight UI generation approach that aligns LLM-generated UIs with UI users’ preference to support the UI design process . Our approach operates in the LLM inference stage without the need for expensive model post-training. Motivated by the effective use of retrieval-augmented generation (RAG) to reduce LLM hallucination through an external knowledge base ( 23 ) , our approach injects a user preference dataset directly into the LLM’s reasoning process to guide UI generation. Specifically, this dataset is organized as three layers (Figure 1 right): the task (the goal to achieve and specific task requirements), user preference aspects (the aspects that the user prefers to complete the task), and user-preferred UI controls (the UI controls that the user prefers regarding each user preference aspect). With this dataset, the LLM’s reasoning is guided by a multi-stage approach to generate UI candidates that align with both user task and preference by identifying similar tasks in the dataset, finding matched user preference, reasoning user preference-aligned UI controls, and generating the code to implement them (Figure 1 left). To evaluate our approach, we used it to generate UIs for image editing tasks, which require instant visual feedback