Expandora: Broadening Design Exploration with Text-to-Image Model Conference: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems; April 26-May 1, 2025; Yokohama, Japan Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA ’25), April 26-Ma

DaEun Choi, Kihoon Son, Hyunjoon Jung, Juho Kim · 2025

Read Expandora: Broadening Design Exploration with Text-to-Image Model Conference: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems; April 26-May 1, 2025; Yokohama, Japan Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA ’25), April 26-Ma by DaEun Choi, Kihoon Son, Hyunjoon Jung, Juho Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-00791.txt.

Introduction

Designers hunting for visual references now often ask image generators, but DaEun Choi and three co-authors found the tools narrow the search instead of widening it. In a small formative study, designers struggled to put exploratory intentions into words and to manage winding, non-linear workflows. The team's answer is Expandora, a system that takes structured statements of intent and a desired diversity level.

A language-model pipeline turns those inputs into varied prompt suggestions, shown on a mindmap-like canvas that invites branching exploration. In a study with eight users, Expandora produced more diverse prompts, more prompts tried in the same time, and higher satisfaction than the baseline tool. Support for the narrowing-down phase lagged, which the authors flag as the next design problem.

Catalog record

CREATORDaEun Choi, Kihoon Son, Hyunjoon Jung, Juho Kim
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-00791

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Expandora: Broadening Design Exploration with Text-to-Image Model Conference: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems; April 26-May 1, 2025; Yokohama, Japan Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA ’25), April 26-May 1, 2025, Yokohama, Japan DOI: 10.1145/3706599.3720189 ISBN: 979-8-4007-1395-8/2025/04 CCS: Human-centered computing Interactive systems and tools DaEun Choi, Kihoon Son, Hyunjoon Jung, Juho Kim Abstract . Broad exploration of references is critical in the visual design process. While text-to-image (T2I) models offer efficiency and customization of exploration, they often limit support for divergence in exploration. We conducted a formative study (N=6) to investigate the limitations of current interaction with the T2I model for broad exploration and found that designers struggle to articulate exploratory intentions and manage iterative, non-linear workflows. To address these challenges, we developed Expandora. Users can specify their exploratory intentions and desired diversity levels through structured input, and using an LLM-based pipeline, Expandora generates tailored prompt variations. The results are displayed in a mindmap-like interface that encourages non-linear workflows. A user study (N=8) demonstrated that Expandora significantly increases prompt diversity, the number of prompts users tried within a given time, and user satisfaction compared to the baseline. Nonetheless, its limitations in supporting convergent thinking suggest opportunities for holistically improving creative processes. Figure 1. Interface of Expandora. There are two key components of Expandora: (1) Structured Input Interface: Users can specify exploratory intentions by selecting parts of a prompt to refine, choosing between adding details or generating alternatives, and adjusting the desired novelty level. (2) Mindmap-like Interface Showing Results: Exploration results are visualized as a branching, non-linear structure that reflects iterative workflows, allowing users to revisit, refine, or branch off ideas. 1. Introduction Exploration is an essential first step in the creative process ( Eckert and Stacey 2000 ) . By exploring a wide range of references, people understand the problem space and the landscape of existing ideas and finally generate novel ideas ( Herring et al. 2009 ; Lee et al. 2010 ; Ritchie et al. 2011 ; Müller-Wienbergen et al. 2011 ) . For graphic designers, traditional tools like reference websites (e.g., Pinterest) have long supported this exploratory process, but text-to-image (T2I) models have emerged as alternative sources of references. These models enable designers to generate images quickly, tailored to their specific needs. Also, designers often expect that models can surprise them with creative images beyond their initial expectations ( Ko et al. 2023 ) . However, when we look at how users perceive outputs and develop ideas, they can limit the divergence of exploration. The model generates a predictable range of images or leads to fixation on initial outputs ( Ko et al. 2023 ; Wadinambiarachchi et al. 2024 ) , limiting the breadth of exploration. To better understand the underlying causes of these limitations, we conducted a formative study with 6 participants to investigate the challenges of using T2I models during exploration, focusing on the evolution of their ideas and intentions over time. Our findings revealed two key challenges. First, participants struggle to express their exploratory intentions effectively through text prompts, particularly specifying which design elements to vary, which to keep consistent, and the desired level of diversity. Second, the sequential interface of current T2I systems fails to support the non-linear and iterative nature of the exploration activities, such as branching into multiple ideas or revisiting previous iterations, which further hinders effective ideation. Based on our findings, we developed Expandora for supporting T2I-assisted design exploration by enabling users to explore a wide variety of semantically diverse and novel prompts. To help users articulate their exploratory intentions more directly, Expandora provides a structured input interface where users can specify which aspects to explore, how to explore, and what level of diversity they want. Then, using an LLM-based pipeline, the system generates a range of prompt variations tailored to the user’s intention. The results are presented in a mindmap-like interface, which can organize ideas hierarchically and allow users to explore branching and iterative pathways visually. To evaluate Expandora, we conducted a within-subjects comparative study with 8 participants familiar with graphic design and the T2I model. We compared Expandora to ChatGPT with an image generation feature. Results showed that Expandora enabled participants to try semantically more diverse prompts into T2I models, showing that Expandora facilitated more diverse exploration. Also, participants explored a significantly greater number of prompts with Expandora within the same amount of time compared to the baseline and reported higher satisfaction with their exploration outcomes. While Expandora effectively supported divergent exploration, participants noted that creative design requires both divergent and convergent processes. They expressed a need for features supporting convergent ideation to refine explored ideas into detailed outputs. We discuss potential improvements to Expandora to address this gap and better support the overall creative process. 2. Background 2.1. Creativity Support in the Idea Exploration Process In early-stage idea exploration, users must balance divergent and convergent thinking to reach more successful creative outcomes ( Frich et al. 2021 ; Chong et al. 2025 ) . To support the creative exploration process, prior work explored seamless and semantically connected interfaces that allow users to create links to visual and semantic data in the ideation process ( Koch et al. 2020 ; Kang et al. 2021 ) . With the advancement of generative models (e.g., LLMs or diffusion models), there is another research stream that explores how to use these models to support the creative ideation process. CreativeConnect ( Choi et al. 2024 ) and PopBlends ( Wang et al. 2023 ) support graphic designers in the idea decomposition and recombination process. Also, Luminate ( Suh et al. 2024 ) supports users’ divergent and convergent thinking when interacting with LLMs to avoid fixation. Building on these two main streams, we propose Expandora that integrates a semantic node-based interface with generative models to support both divergent and convergent thinking in design exploration. 2.2. Intent Expression with Generative Model Supporting accurate intent expression is crucial in the exploration stage since the user needs to express two types of intent: specification (e.g., refining a clear idea or output in mind) and diversification (e.g., exploring broad or unclear possibilities with a certain direction). Recent work has shown how to utilize the generative model’s ability as an expression channel of a user’s intent ( Son et al. 2024 ) . For input methods, various generative model-based tools ( Wang et al. 2024 ; Peng et al. 2024 ; Zhou et al. 2024 ) support structured or tailored inputs beyond natural language input to help users express their creative intention. Beyond providing various input modalities, recent work also suggested the method of automatically refining and suggesting users’ prompts to enhance their exploration ( Brade et al. 2023 ; Son et al. 2024 ; Almeda et al. 2024 ) . In alignment with these research directions, our work includes 1) a structured intent input approach with 2) guidance on how to diversify & specify prompts. 3. Formative Study We conducted a formative study to investigate the challenges designers face while exploring and evolving ideas using T2I models. We recruited six design students or graduates with experience in at least three graphic design projects. Participants

Read the complete text