Texterial : A Text-as-Material Interaction Paradigm for LLM-Mediated Writing Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3790330 ISBN: 979-8-4007-2278-3/2026/04 CCS: Human-centered computing Interactive systems and tools CCS: Human-centered computing Natural language interfaces CCS: Human-centered computing HCI theory, concepts and models

Jocelyn Shen, Nicolai Marquardt, Hugo Romat, Ken Hinckley, Nathalie Riche, Fanny Chevalier · 2026

Read Texterial : A Text-as-Material Interaction Paradigm for LLM-Mediated Writing Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3790330 ISBN: 979-8-4007-2278-3/2026/04 CCS: Human-centered computing Interactive systems and tools CCS: Human-centered computing Natural language interfaces CCS: Human-centered computing HCI theory, concepts and models by Jocelyn Shen, Nicolai Marquardt, Hugo Romat, Ken Hinckley, Nathalie Riche, Fanny Chevalier (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00452.txt.

Introduction

Shen and five colleagues treat text as a material to be shaped, grown, and pruned, arguing that rigid linear writing tools hide what generative models can do. A formative study finds users reason readily with the material metaphor, feeding a framework that links metaphors to shifts in how writers picture, carry out, and judge work. Two probes test the idea: a clay probe refined by hand gestures, and a plant probe where ideas sprout over time. The work widens the design space for writing tools built around living, workable text.

Catalog record

CREATORJocelyn Shen, Nicolai Marquardt, Hugo Romat, Ken Hinckley, Nathalie Riche, Fanny Chevalier
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE121167
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.00452

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Texterial : A Text-as-Material Interaction Paradigm for LLM-Mediated Writing Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3790330 ISBN: 979-8-4007-2278-3/2026/04 CCS: Human-centered computing Interactive systems and tools CCS: Human-centered computing Natural language interfaces CCS: Human-centered computing HCI theory, concepts and models Jocelyn Shen, Nicolai Marquardt, Hugo Romat, Ken Hinckley, Nathalie Riche, Fanny Chevalier Abstract . What if text could be sculpted and refined like clay—or cultivated and pruned like a plant? Texterial reimagines text as a material that users can grow, sculpt, and transform. Current generative-AI models enable rich text operations, yet rigid, linear interfaces often mask such capabilities. We explore how the text-as-material metaphor can reveal AI-enabled operations, reshape the writing process, and foster compelling user experiences. A formative study shows that users readily reason with text-as-material, informing a conceptual framework that explains how material metaphors shift mental models and bridge gulfs of envisioning, execution, and evaluation in LLM-mediated writing. We present the design and evaluation of two technical probes: Text as Clay , where users refine text through gestural sculpting, and Text as Plants , where ideas grow serendipitously over time. This work expands the design space of writing tools by treating text as a living, malleable medium. Figure 1 . We explore how materials can inspire new interactions with text. Building on insights from a formative study, we propose Texterial , a conceptual framework and prototype implementations that treat text-as-material . Our work uses materiality to foster a new way of interacting with generative AI. Shows a framework for material-inspired text interaction. On the left, icons for materials (paint, yarn, clay, photograph, plant) are paired with operations (e.g., pinch, merge, pluck, plant, water). In the center, a plant metaphor is illustrated where dragging creates a branching fern of words. On the right, pressing on text highlights and emphasizes localized words. Together, the diagram illustrates how materials, operations, and interactions combine to treat text as a malleable medium that fosters a new way of interacting with generative AI. † † cc-license: by 1. Introduction Current large language models (LLMs) offer unprecedented capabilities to transform and generate text, from abstracting meaning ( 31 ) and remixing ideas ( 22 ) , to suggesting alternatives ( 46 ) or drafting entire passages from a single seed phrase ( 75 ; 9 ) . Yet, these capabilities are not always used to their full potential. Although natural language instructions provide versatility, crafting effective prompts and steering the results is often difficult ( 76 ) . In particular, understanding what the model can do and how to instruct it within the constraints of linear chat interfaces, limits the ways in which people fluidly think with the model and bottlenecks their wide-ranging capabilities ( 69 ) . To better surface the expressive potential of LLMs, we propose a conceptual shift for designing generative AI-powered writing experiences: reimagining text as a material — something that can be directly manipulated, blended, squashed, or shattered. Our framework is inspired by metaphors to physical materials (clay, paint, or even plants), which map LLM operations to expressive touch interactions. For example, imagine a creative story writer refining their draft. Instead of prompting, “ Make this paragraph more vivid, while keeping the introduction and conclusion the same, and merge it with the style of Shakespeare… ” the user might stretch the text like clay to expand the text, pinch it to make certain phrases more concrete, and smear one of Shakespeare’s sonnets into their writing. Through this perspective, the material properties, and interactions afforded by the material, help externalize the writing process by leveraging intuitive sensorimotor skills and embodied reasoning (e.g., ripping, mixing, smoothing) in ways that prompts cannot ( 56 ; 49 ; 42 ; 34 ) . To expand this idea of text-as-material, Texterial generalizes HCI design metaphors to LLM-mediated writing. We envision these techniques enriching and complementing existing writing techniques rather than replacing them, opening up a design space of material-inspired interactions that can infuse the wider scope of writing activities at different stages—early ideation, editing, or iterative refinement. To explore this design space, we first conducted a formative study to understand how individuals might conceptualize text as a material, gaining insight into what metaphors resonate with people, and how they would approach writing under such a paradigm (Section 3 ). Building on these insights, we distilled important dimensions and considerations for material-inspired LLM-driven writing tools into a conceptual framework, from the lens of the seven-stages-of-action model ( 58 ) in Section 4 . Our conceptual framework articulates the layers on which LLMs operate (semantics, structure, style), operations on these layers (compose, abstract, ideate, condense, transform); and mapping execution of operations to material-like interactions. This framework formalizes LLM functional capabilities and metaphor-interface matches ( 56 ) , providing interaction designers with a structure and language to discuss how materials afford different AI-powered operations and inspire new writing interfaces that help bridge the gulfs of envisioning, execution, and evaluation ( 69 ; 58 ) . As concrete demonstration of this conceptual framework, we developed two technical probes that embody text as material for writing tasks with LLMs: Text as Clay and Text as Plants (Section 5 ). Text as Clay reimagines the text itself as clay-like material that can be pinched, stretched, pulled, merged, and smoothed through direct multi-touch gestures, to combine and refine text fragments. Text as Plants treats writing as an act of gardening: ideas are planted, watered, and grafted, and the system uses a language model to introduce variations, novel ideas, and leaves that branch and evolve over time. Both of these technical probes are positioned to explore how material-inspired interactions can complement existing writing practices, with the potential to address distinct phases in the writing process. We used these probes to evaluate our approach in a qualitative focus-group study (n=10, 4 groups; Section 6 ). Our findings indicate that framing text-as-material influences mental models. Gestural manipulations were found to be intuitive, expressive, and language-agnostic, which invited direct engagement with text transformations. The spatial and visual layouts of our prototypes supported non-linear exploration and non-committal ideation, workflows that are rarely afforded by linear LLM interfaces. Finally, participants found that our prototypes infused creative experimentation and playfulness in the process, and envisioned extensions of the metaphor to collaborative writing interactions. In sum, Texterial contributes the following: • Empirical insights from a formative study of how people conceptualize text-as-material, illustrating how material metaphors can naturally map to writing operations and phases of the writing process. • A conceptual framework of the text-as-material approach that links material affordances to text manipulations with LLMs, providing foundations for interaction designers of novel, AI-driven writing tools. • Two diverse technical probes — Text as Clay and Text as Plants —expanding the design space of writing tools by treating text as a malleable, interactive medium to embody underlying LLM operations. • Findings from a qualitative focus-group study of these technical probes, offering evidence that material metaphors shape mental models for manipulating text, foster novel workflows, raise different expectations for different people,

Read the complete text