Deconstructing Taste: Toward a Human-Centered AI Framework for Modeling Consumer Aesthetic Perceptions DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-cent

Matthew K. Hong, Joey Li, Alexandre Filipowicz, Monica Van, Kalani Murakami, Yan-Ying Chen, Shiwali Mohan, Shabnam Hakimi, Matthew Klenk · 2026

Read Deconstructing Taste: Toward a Human-Centered AI Framework for Modeling Consumer Aesthetic Perceptions DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-cent by Matthew K. Hong, Joey Li, Alexandre Filipowicz, Monica Van, Kalani Murakami, Yan-Ying Chen, Shiwali Mohan, Shabnam Hakimi, Matthew Klenk (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17134.txt.

Introduction

Matthew Hong and a team of eight co-authors break taste in shop design down to parts. Taste words like sporty guide how goods are shaped. Buyers feel taste fast, but can't oft say why. Past data on picks gives thin help for real design. Their 2026 preprint builds a human-first AI frame for taste. It aims to map taste to form traits teams can act on.

The frame learns which traits read as sporty or calm. It keeps the human judge in the loop. Design teams then shape goods to a felt aim. Such tools could cut flop goods and waste.

Catalog record

CREATORMatthew K. Hong, Joey Li, Alexandre Filipowicz, Monica Van, Kalani Murakami, Yan-Ying Chen, Shiwali Mohan, Shabnam Hakimi, Matthew Klenk
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-17134

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Deconstructing Taste: Toward a Human-Centered AI Framework for Modeling Consumer Aesthetic Perceptions DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered computing Interactive systems and tools CCS: Human-centered computing Human computer interaction (HCI) Matthew K. Hong, Joey Li, Alexandre Filipowicz, Monica Van, Kalani Murakami, Yan-Ying Chen, Shiwali Mohan, Shabnam Hakimi, Matthew Klenk Abstract . Understanding and modeling consumers’ stylistic taste such as "sporty" is crucial for creating designs that truly connect with target audiences. However, capturing taste during the design process remains challenging because taste is abstract and subjective, and preference data alone provides limited guidance for concrete design decisions. This paper proposes an integrated human-centered computational framework that links subjective evaluations (e.g., perceived luxury of car wheels) with domain-specific features (e.g., spoke configuration) and computer vision-based measures (e.g., texture). By jointly modeling human-derived (consumer and designer) and machine-extracted features, our framework advances aesthetic assessment by explicitly linking model outcomes to interpretable design features. In particular, it demonstrates how perceptual features, domain-specific design patterns, and consumers’ own interpretations of style contribute to aesthetic evaluations. This framework will enable product teams to better understand, communicate, and critique aesthetic decisions, supporting improved anticipation of consumer taste and more informed exploration of design alternatives at design time. 1. Introduction Designing aesthetic forms that resonate with consumers is a central challenge in product design, as designers must navigate the tension between creative expression and the constraints of high production costs and lengthy engineering lead times. Computationally modeling consumer aesthetic taste offers a way to address this challenge by enabling rapid, informative feedback throughout the creative process, allowing designers to quickly iterate and prioritize actionable insights that are more likely to produce products that appeal to target audiences and drive business impact. Prior studies in the automotive industry have linked aesthetic appeal to 60% of purchase decisions ( 21 ) . Yet, improving aesthetic appeal for vehicle products requires costly upfront investment amounting to $3 billion for major redesigns ( 5 ) . Advanced AI techniques, including generative adversarial networks (GANs) and other deep learning models, are emerging as powerful tools for increasing the scope of AI’s role in these high-stakes scenarios ( 5 ) . However, the subjective, time-variant, and context-dependent nature of consumers’ taste poses challenges in ensuring that algorithmic recommendations for design consistently align with diverse and evolving consumer expectations. This state reflects a broader need to design human-AI co-creative systems that model aesthetic perceptions of style in ways that can be meaningfully communicated back to designers—in the context of their own design language—to support an adaptive human-centered design process. Traditionally, assessments of consumer taste relied on human-derived evaluations—for instance, expert critiques and consumer surveys in design clinics—to gauge style descriptors like sporty or luxurious . However, their subjective nature can make it difficult to translate consumer insights into precise design interventions, leading to costly redesigns to ensure consumers’ expectations are met 1 1 1 A single design clinic for a new vehicle can cost over $100,000, with annual expenses for a single manufacturer reaching tens of millions of dollars ( 5 ) . Recently, large scale preference datasets and their reward model offer scalable means to capture consumer taste by enabling preference-based model post-training pipelines ( 40 ; 38 ; 19 ; 23 ) . While whole-image preference ratings indicate relative desirability, they however do not encode which visual attributes, semantic cues, or design patterns drive those judgments. For design practice, this means models trained on image-level preferences can reproduce stylistic tendencies without exposing the principles that designers need to critique, adapt, or intentionally subvert them. Within the machine learning community, researchers have recognized the importance of combining high-level semantic attributes with multiple low-level hand-crafted features (e.g., rule of thirds, spatial distribution of edges) and generic image features (e.g., texture, saturation of colors) for shaping consumer perceptions of overall attractiveness ( 2 ; 36 ) . With the emergence of more sophisticated computer vision techniques and powerful vision language models, it is now possible to comprehensively model product aesthetics through a range of low-level visual features such as texture, spatial composition, and color distribution, and high-level semantic features that reflect both designers’ and consumers’ understanding of designed artifacts ( 25 ; 2 ) . For instance, low-level features extracted automatically from images can provide objective measurements of visual form, while high-level, human-interpretable features offer fine-grained semantic distinctions. Together, these complementary representations help disentangle context-dependent relationships between these features, enabling more informed creative decision-making by revealing not only what consumers prefer, but also why those preferences arise across contexts ( 9 ) . How then to effectively represent aesthetic features in a system that supports design creativity remains a critical open question. Building on these developments, this paper proposes an integrated framework for aligning computational models of aesthetics with the nuanced ways in which humans—both designers and consumers—perceive and evaluate design elements. Our work examines how integrating consumers’ subjective judgments (e.g., perceived luxury of car wheels), designer-informed visual features (e.g., spoke configuration), and machine-extracted visual features (e.g., texture or spatial composition) yields deeper understandings of consumer taste. In doing so, we address a significant gap in the AI and design literature: while many existing methods excel at generating or optimizing designs toward aesthetic goals, relatively few provide insights into why certain designs might resonate more effectively with target audiences ( 41 ; 5 ) . This research contributes to both theory and practice by 1) linking psychological models of aesthetic response with computational techniques and 2) proposing a generalizable, user-centered approach for early product development. To this end, we provide an example study that demonstrates how this framework can be used to assess people’s perception of product aesthetics (specifically, vehicle wheel aesthetics). This study focuses on the two following research questions: RQ1 : What features contribute most to people’s perception of aesthetic style? RQ2 : Do people form differentiable perceptions of aesthetic style? 2. Background and Related Work We position our work within creativity literature in Psychology and Computation to inform a holistic understanding of product aesthetics. In doing so, we highlight existing gaps in the literature that motivate our research questions. Figure 1 . Model of aesthetic experiences (taken from ( 22 ) ). The multi-stage model shows how perceptual analyses, explicit classification, and cognitive mastering interact under the influence of prior experience, domain expertise, and personal taste. Early stages emphasize automatic, perceptual and affective processing, while later stages involve deliberate interpretation and evaluation. The proposed framework operationalizes the three components highlighted in red. Diagram of a multi-stage model of aesthetic experience in a museum or gallery context. The model shows a left-to-right processing flow from pre-classification of an artwork through perceptual analyses, implicit memory integration, explicit classification, and cognitive mastering, followed by evaluation. Perceptual analyses include visual features such as complexity, contrast, symmetry, order, and grouping. Implicit memory integration includes familiarity, prototypicality, and peak-shift effects. Explicit classification focuses on style and content. Cognitive mastering involves art-specific interpretation and self-related interpretation. Prior experience, domain-specific expertise, interests, and personal taste influence multiple stages. Emotional and affective states are continuously evaluated throughout the process. Aesthetic judgment emerges

Read the complete text