Reviving Reflection-in-Action: Instilling Designerly Thinking in AI-Supported Ideation through Multimodal Prompting Conference: Creativity and Cognition; July 13–16, 2026; London, United Kingdom Creativity and Cognition (C&C ’26), July 13–16, 2026, London, United Kingdom DOI: 10.1145/3803784.3807524 ISBN: 979-8-4007-2583-8/2026/07 CCS: Human-centered computing Empirical studies in HCI

Samangi Wadinambiarachchi, Jenny Waycott, Greg Wadley · 2026

Read Reviving Reflection-in-Action: Instilling Designerly Thinking in AI-Supported Ideation through Multimodal Prompting Conference: Creativity and Cognition; July 13–16, 2026; London, United Kingdom Creativity and Cognition (C&C ’26), July 13–16, 2026, London, United Kingdom DOI: 10.1145/3803784.3807524 ISBN: 979-8-4007-2583-8/2026/07 CCS: Human-centered computing Empirical studies in HCI by Samangi Wadinambiarachchi, Jenny Waycott, Greg Wadley (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26626.txt.

Introduction

Samangi Wadinambiarachchi, Jenny Waycott, and Greg Wadley explore how sketching changes AI-supported design work. Most creativity tools take text prompts and return polished, solution-shaped outputs. Designers, though, traditionally think by sketching, a reflective process where ideas evolve on paper. The authors built SketchifAI, a prototype that accepts sketches as input. They ask whether rougher input invites deeper reflection.

Design students used the prototype in a within-participants study. Each student tried text prompts, sketches, and sketches with tags. The team measured how well students felt they could express intent, how supported their creativity felt, and their divergent thinking output. Sketching tended to improve fluency, the flow of ideas. Evidence on variety, originality, and quality stayed inconclusive. Paradoxically, students still preferred text prompting strongly. The authors discuss designing tools that restore reflection through sketching.

Catalog record

CREATORSamangi Wadinambiarachchi, Jenny Waycott, Greg Wadley
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.26626

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reviving Reflection-in-Action: Instilling Designerly Thinking in AI-Supported Ideation through Multimodal Prompting Conference: Creativity and Cognition; July 13–16, 2026; London, United Kingdom Creativity and Cognition (C&C ’26), July 13–16, 2026, London, United Kingdom DOI: 10.1145/3803784.3807524 ISBN: 979-8-4007-2583-8/2026/07 CCS: Human-centered computing Empirical studies in HCI Samangi Wadinambiarachchi, Jenny Waycott, Greg Wadley Abstract . Current AI-powered creativity support tools (AI-CSTs) primarily use text prompting to generate solution-oriented outputs. However, the potential value of multimodal prompting in designer-AI interaction, specifically the introduction of productive friction to encourage iteration and reflection, has not been fully explored. To address this, we developed SketchifAI , a prototype AI-CST, and evaluated it with design students. In a mixed-methods, within-participants study, we examined how different input modalities (text, sketch, and sketch-plus-tags) affected design students’ perceived ability to express their intent, their perception of creativity support, and their divergent thinking performance. Our preliminary findings suggest that the sketch modality tended to enhance fluency, with inconclusive evidence for differences in variety, originality, or quality compared to text modality. Yet, paradoxically, participants showed a strong preference for text prompting. We discuss how AI tools might be designed to reintroduce reflection-through-sketching, ensuring that designer-AI interaction supports, rather than erodes, essential design skills in students. † † cc-license: by 1. Introduction Imagine it is week three of a design studio — a peak time for rapid ideation. A few years ago the room would have been filled with the scent of graphite and the rhythmic scratching of pencils. Students would have struggled with the blank page, some feeling paralysed before making their first pen-stroke. Yet that friction was productive; it was the force that empowered students to translate abstract ideas into a physical form, enabling reflection. Today, the sketchbook has been mostly replaced by screens, and the rhythmic scratch of pencils is faint, replaced by the staccato clatter of keyboards. Many students no longer try to wrestle with visualising their ideas, instead racing to construct prompts that flood their screens with highly refined, photorealistic images. Researchers argue that sketching functions as a thinking tool and an external memory ( 25 ; 8 ) , enabling designers to experiment, to discover new insights, and to rapidly produce a stream of ideas that keeps pace with their cognition. Thumbnail sketches ( 8 ) and Crazy 8s ( 2 ) 1 1 1 https://designsprintkit.withgoogle.com/methodology/phase3-sketch/crazy-8s are some of the popular techniques used for brainstorming and ideation. A successful ideation activity encourages divergent thinking, enabling designers to explore diverse concepts without being constrained by the need to refine details now ( 27 ; 24 ) . A plethora of Artificial Intelligence (AI) tools has recently emerged. Vendors claim that AI can be used as a co-creative assistant, helping designers to kick-start the creative process when feeling stuck ( 58 ; 53 ) . However, while some studies suggest that AI can augment human creativity and promote divergent thinking ( 28 ; 39 ) , others indicate that AI tools could narrow creativity ( 67 ; 22 ) , and should be appropriated with caution. The diffusion of AI tools into design workflows has obviated the struggle to make the first penstroke in favour of the challenge of: “how do I explain my idea in the right words?” . But professional designers report that text prompting is not necessarily the best way to describe their intent to AI, highlighting the risk that linguistic limitations might inhibit visual exploration ( 49 ; 40 ; 50 ; 63 ) . In the context of the design classroom, the research discussed above raises the question: Could the use of Generative AI (GenAI) in the early stages of design jeopardise the fostering of designerly thinking? Students risk shifting from being active creators to passive curators. This could impose the steep cost of cognitive atrophy ; the erosion of cognitive skills due to over-reliance and cognitive offloading on AI tools ( 51 ) . While AI might enhance efficiency in that students can visualise refined ideas at speed, such ‘frictionless’ design processes might erode the reflective thinking required to achieve true creative mastery. The risk of cognitive atrophy is further exacerbated by the UI of current GenAI tools, which force users to express their visual intent through a text-prompt, before exposing users to high-fidelity images. This immediate leap from idea to refined aesthetic can lead to design fixation ( 67 ) , defined as a “blind adherence to a set of ideas or concepts limiting the output of conceptual design” ( 29 , p. 1) . It can be difficult for users to deconstruct these polished visual outputs into the fluid, malleable concepts necessary for novel idea generation ( 65 ; 29 ) . Despite the rapid growth of investigation into Human-AI co-creativity, a gap remains in HCI literature regarding the tension between efficient automation and the cognitive effects of text-to-image workflows. For example, 20 ; 42 explored how sketching can be used to mitigate users’ difficulty in translating ideas into words; 16 incorporated stepwise textual scaffolding to specify user intent through progressive prompting; while 48 explored how annotation and scribbling can define creative intent. Collectively, these findings suggest that GenAI interfaces need to support diverse input modalities, allowing designers to adaptively switch between modalities across different stages of the process ( 42 ; 37 ) . While these offer valuable insights, there remains a need to empirically examine how productive friction — deliberate resistance embedded in an interaction that creates moments of reflection and clarification ( 59 ; 57 ; 17 ; 11 ) — influences reflective ideation, and the possible gap between participant perceptions and expert assessment of design ideas. We address this gap by investigating how design students communicate their creative intent to AI tools via different interaction modalities — text input, pure sketching, and a hybrid of sketching with short descriptive tags. Through a within-participant study with nine design students ( N=9 ), we explore how effortful sketching and the deliberate generation of low-mid fidelity outputs impact inspiration retrieval in rapid ideation. We used a purposive sample, prioritising subjective depth over broad generalisability, and employed reflexive thematic analysis ( 5 ) and Bayesian hierarchical modelling ( 44 ) to derive preliminary findings through rigorous mixed-methods in understanding how reintroducing sketching and imperfect stimuli as productive friction affects students’ perceptions of creativity support, divergent thinking, and alignment with creative intent . Our study investigated the following research questions: • RQ1: How do different input modalities (Text-only, Sketch-only, and SketchPlusTags) influence students’ perceptions of their ability to express creative intent and the relevance of the AI-generated outcomes? • RQ2: How do these input modalities influence the level of creativity support perceived by students 2 2 2 As measured by the Creativity Support Index (CSI) ( 13 ) . ? • RQ3: To what extent do these modalities influence students’ divergent thinking performance during a rapid ideation task 3 3 3 Measured using expert ratings for fluency, variety, originality, and quality. ? We contribute to Designer-AI Interaction literature in three ways: • Empirical Contribution: We provide evidence that while the Sketch modality shows a trend towards enhanced fluency, the addition of tags ( SketchPlusTags ) may constrain Originality, despite serving as a clarity anchor

Read the complete text