Exploring Opportunities to Support Novice Visual Artists’ Inspiration and Ideation with Generative AI

Cindy Peng *, Alice Qian *, Linghao Jin, Jieneng Chen, Evans Xu Han, Paul Pu Liang, Hong Shen, Haiyi Zhu, Jane Hsieh · 2025

Read Exploring Opportunities to Support Novice Visual Artists’ Inspiration and Ideation with Generative AI by Cindy Peng *, Alice Qian *, Linghao Jin, Jieneng Chen, Evans Xu Han, Paul Pu Liang, Hong Shen, Haiyi Zhu, Jane Hsieh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-24167.txt.

Introduction

New artists often stall at the blank page, hunting for references and a first direction. Cindy Peng and 8 co-authors interviewed thirteen artists about needs in that early stage. Four needs stood out: faster access to references, ways to view reference blends, outside feedback, and personal help to learn new techniques and styles.

The team mapped those needs to open tools and built six interactive prototypes. In co-design workshops with thirteen novice artists, the prototypes sparked clear demands and tensions for artist-centered design. The work sketches AI tools that serve the artist's own process first, rather than replacing it.

Catalog record

CREATORCindy Peng *, Alice Qian *, Linghao Jin, Jieneng Chen, Evans Xu Han, Paul Pu Liang, Hong Shen, Haiyi Zhu, Jane Hsieh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE84 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-24167

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Exploring Opportunities to Support Novice Visual Artists’ Inspiration and Ideation with Generative AI Cindy Peng *, Alice Qian *, Linghao Jin, Jieneng Chen, Evans Xu Han, Paul Pu Liang, Hong Shen, Haiyi Zhu, Jane Hsieh Abstract . Recent generative AI advances present new possibilities for supporting visual art creation, but how such promise might assist novice artists during early-stage processes requires investigation. How novices adopt or resist these tools can shift the relationship between the art community and generative systems. We interviewed 13 artists to uncover needs in key dimensions during early stages of creation: (1) quicker and better access to references, (2) visualizations of reference combinations, (3) external artistic feedback, and (4) personalized support to learn new techniques and styles. Mapping such needs to state-of-the-art open-sourced advances, we developed a set of six interactive prototypes to expose emerging capabilities to novice artists. Afterward, we conducted co-design workshops with 13 novice visual artists through which artists articulated requirements and tensions for artist-centered AI development. Our work reveals opportunities to design novice-targeted tools that foreground artists’ needs, offering alternative visions for generative AI to serve visual creativity. 1. Introduction Visual art creation is a complex, multistage process requiring significant time, effort, and material investment. Recent advances and uses of generative AI show potential for supporting this intensive creation process through consistent, guided generation and editing ( Zhang et al. 2023 ) of increasingly realistic and detailed visual outputs ( Podell et al. 2024 ) . Such progress, coupled with lowered barriers of access, sparks excitement around the potential for visual generative models to revolutionize and democratize art education and expand creative participation ( Garcia 2024 ; Jackson 2024a ; Arslan and Probosiwi 2025 ) . While many creativity support tools enabled by visual generative AI have explored ways to augment the workflows of professional artists and designers across various domains ( Wang et al. 2025b ; Son et al. 2024 ; Paananen et al. 2024 ) , novice visual artists often engage in art-making to explore new capabilities ( Jasani and Saks 2013 ; Nadeau 2003 ) , practice self-expression ( Sheridan et al. 2022 ) or challenge conventional aesthetic and creative boundaries ( Zhou and Lee 2024 ; Messer 2024 ) . For those users, the general-purpose and zero-shot nature of recent models offers an exciting promise: to make art-making accessible to audiences with limited training ( Ko et al. 2023a ) . In theory, such tools could empower more people to develop skills, enjoy the process of art making, and gain a deeper appreciation for visual craft ( Jackson 2024b ) . Yet, existing generative AI systems often fall short in supporting novice visual artists, particularly in the early stage of the creative process. Prior work has highlighted the potential of AI to augment early ideation ( Messer 2024 ; Han et al. 2025 ; Lamiroy and Potier 2022 ) , but novice artists often find these tools not being effectively integrated into their creative processes ( Taylor et al. 2025 ) , leaving them stressed and disoriented ( Kawakami and Venkatagiri 2024 ; Ko et al. 2023a ) . Meanwhile, artists remain deeply distrusting of generative systems due to harmful downstream impacts on members of the artistic community (e.g., economic and reputational harms arising from inadequate attribution or compensation), raising questions about what artist-centered, ethically sound uses and developments of generative AI tools could look like – especially for those who just beginning their creative journeys. To date, much of the HCI and UIST literature has focused on understanding and supporting final-stage outputs of professional designers and artists ( Li et al. 2024a ; Shi et al. 2023 ) , while generative AI support for the early stages of novice visual artists workflows remain underexplored – overlooking a key opportunity to bridge the gap between creativity support tools and emerging members of the artistic community. In particular, few studies have examined how novice artists ( Hu et al. 2025 ) adopted co-creation and inspiration tools to meaningfully organize and reflect on inputs ( Lamiroy and Potier 2022 ) , leaving a critical gap in understanding how emerging generative capabilities may align with novice visual artists’ early-stage workflows involving practices that start at the definition of a piece and ending with the use of references for revisions to pieces ( Botella et al. 2018 ) . To address these gaps, this study investigates how generative AI can meaningfully support the early-stage workflows of novice visual artists. We employed a two-step approach: (1) We interviewed 15 novice artists to understand their existing practices, initial perceptions of available generative tools, as well as painpoints to their artistic creation processes (§ 3.1 ); next (2) We mapped these expressed needs to state-of-the-art technical capabilities and develop six functional prototypes, which we evaluated in co-design workshops with 14 novice artists (§ 3.3 ). Leveraging state-of-the-art capabilities (e.g., medium and style transfer, visual combinations and editing, step-by-step tutorials, and extensions of 2D into interactive 3D viewing), these interactive prototypes allowed us to probe novice artists for reactions and design objectives they prioritized for future forms of tooling support. We ask the following research questions: RQ 1 What processes do novice visual artists undertake to navigate early stages of their creative workflows, and what challenges do they encounter? RQ 2 How do novice visual artists perceive the potential of emerging generative AI capabilities to support their early-stage needs, and what tensions do they foresee around their integration? Building on the above questions, we map early-stage practice, probe emerging capabilities through co-design and prototypes, and distill implications for toolmakers. Accordingly, this paper contributes. • An empirical account of how novice artists use tools in the early stage and the challenges they face. • Empirically grounded capability requirements for early stage support that artists want in tools. • A synthesis of the tensions these tools raise and the implications for design and policy. 2. Related Work Below, we first overview theory and empircal findings around the artistic creation process and steps, followed by existing creativity support tools for visual artists and designers. Finally, we summarize literature capturing artistic community perceptions and concerns around generative AI support tools, and compare these with recent excitement for around more democratized opportunities for artistic creation to surface a key gap for supporting early-stage workflows of novice artists, which we aim to address in this study. 2.1. Creative Workflows of (Professional) Visual Artists Visual art creation is complex, iterative and resource-intensive process, containing subprocesses and tasks that vary widely depending on the artists’ expertise, intentions, as well as the choice and availability of materials, medium and aesthetics ( Botella et al. 2013 ; Boldt and Kaufman 2025 ) . Since an entire century ago, psychology scholars sought to model the stages and dimensions of the artistic creation process: Wallas 1926 proposed the four macroprocesses of preparation , incubation , illumination , and revision ( Wallas 1926 ; Sadler-Smith 2015 ) , Edwards 1969 introduced divergent and convergent thinking, Getzels and Csikszentmihalyi 1976 identified the problem formulation and solution stages (pre-drawing versus during drawing and feedback), while Finke et al. 1996 separated the creative activity into the generate and explore processes. More empirically,

Read the complete text