Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild

Willem van der Maden, Malak Sadek, Ziang Xiao, Aske Mottelson, Q. Vera Liao, Jichen Zhu · 2026

Read Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild by Willem van der Maden, Malak Sadek, Ziang Xiao, Aske Mottelson, Q. Vera Liao, Jichen Zhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16304.txt.

Introduction

Van der Maden and five colleagues study how product teams test LLM-powered products in the wild. They interview nineteen workers across diverse sectors. They identify ten testing practices, from informal vibe checks to team-level work. They confirm four documented challenges. They add a fifth, the results-actionability gap. In that gap, teams gather test data but cannot turn findings into concrete improvements. Drawing on successful teams, they offer strategies to bridge that gap, moving from ad-hoc judgment toward steady testing routines.

Catalog record

CREATORWillem van der Maden, Malak Sadek, Ziang Xiao, Aske Mottelson, Q. Vera Liao, Jichen Zhu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE85912
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.16304

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Results-Actionability Gap: Understanding How Practitioners Evaluate LLM Products in the Wild Willem van der Maden, Malak Sadek, Ziang Xiao, Aske Mottelson, Q. Vera Liao, Jichen Zhu Abstract . How do product teams evaluate LLM-powered products? As organizations integrate large language models (LLMs) into digital products, their unpredictable nature makes traditional evaluation approaches inadequate, yet little is known about how practitioners navigate this challenge. Through interviews with nineteen practitioners across diverse sectors, we identify ten evaluation practices spanning informal ‘vibe checks’ to organizational meta-work. Beyond confirming four documented challenges, we introduce a novel fifth we call the results-actionability gap , in which practitioners gather evaluation data but cannot translate findings into concrete improvements. Drawing on patterns from successful teams, we contribute strategies to bridge this gap, supporting practitioners’ formalization journey from ad-hoc interpretive practices (e.g., vibe checks) toward systematic evaluation. Our analysis suggests these interpretive practices are necessary adaptations to LLM characteristics rather than methodological failures. For HCI researchers, this presents a research opportunity to support practitioners in systematizing emerging practices rather than developing new evaluation frameworks. Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3791069 ISBN: 979-8-4007-2278-3/2026/04 CCS: Human-centered computing Empirical studies in HCI CCS: Computing methodologies Natural language generation † † cc-license: by 1. Introduction In just a few years, large language models (LLMs) have moved from research labs to production systems, powering everything from marketing copy for local businesses to enterprise software at Fortune 500 companies. This shift has transferred the challenge of evaluation to practitioners who must ensure these systems are effective, reliable, and safe, often without the dedicated infrastructure or methodological guidance that research settings provided. This evaluation gap has emerged as a key bottleneck in production settings ( Urlana et al., 2025 ; Gallagher et al., 2024 ; Nahar et al., 2025 ; Ma et al., 2024 ) , leaving practitioners in a difficult position: they are tasked with building reliable products on a new technological frontier, but are doing so without guiding principles. As these systems mediate crucial aspects of daily life, from healthcare to education, the lack of a standardized foundation to evaluate them creates significant risks that include both costly business missteps and profound harm for individuals and society. This uncertainty persists despite a wealth of academic inquiry. Recent research flourishes with evaluation frameworks, benchmarks, and novel metrics ( Liang et al., 2023 ; Lee et al., 2023 ; Elangovan et al., 2024 ; Pan et al., 2024 ; Wang et al., 2024b ; Guo et al., 2023 ; Wang et al., 2024c ; Chang et al., 2024 ; Liu et al., 2024d ; An et al., 2024 ; Liu et al., 2024a ; Wang et al., 2024d ; Zheng et al., 2023a ; Zhuo et al., 2024 ; Liu et al., 2023 ; Min et al., 2023 ; Kim et al., 2024 , e.g.,) . Yet, it remains an open question how, or even if, this body of work translates into the day-to-day realities of LLM product development. This challenge is not merely theoretical. When Google’s NotebookLM team sought to evaluate if AI-generated podcasts, with scripts written by an LLM, were ‘entertaining,’ they discovered that conventional metrics like binary ratings or Likert scales were inadequate ( Martin and Shafqat, 2024 ) . Even a single aspect of LLM outputs like humor proved remarkably difficult to assess, with one team member noting that “humor is contextual… super contextual” ( Martin and Shafqat, 2024 ) . This experience raises a crucial question: if well-resourced teams with profound AI expertise struggle with evaluation, what challenges do other, less-resourced, organizations face in assessing their LLM implementations? While recent studies have documented evaluation challenges and emerging solutions ( Zhou et al., 2022 ; Nahar et al., 2025 ; Urlana et al., 2025 ; Amershi et al., 2019 ) , these have focused on either pre-LLM contexts or well-resourced organizations with dedicated infrastructure. Less is known about how practitioners without such support navigate these challenges. Without this understanding, researchers risk developing frameworks that address theoretical problems while missing practical constraints, and practitioners continue reinventing solutions in isolation rather than building on collective knowledge. To unpack this, we investigate: RQ1 What are the current evaluation practices for LLM-based products in production settings? RQ2 What do practitioners describe as their main challenges in evaluating LLM-based products? We conducted semi-structured interviews with 19 practitioners who develop LLM-based products in production settings. These participants predominantly work with foundation models accessed through APIs rather than training their own models (outside of some experiments with finetuning small local models), building applications that must serve real users with specific needs. As such, they evaluate complete systems including user interfaces, retrieval mechanisms, and prompt designs rather than isolated model capabilities. Unlike research labs benchmarking model capabilities through standardized tests, these practitioners must assess context-specific, often hard-to-define qualities while navigating production constraints of limited resources, tight deadlines, and diverse stakeholder demands. Examples include a healthcare documentation system that transcribes clinical conversations (where practitioners must evaluate whether the AI accurately captures meaning without errors that could reverse a diagnosis), educational platforms that generate personalized math stories (where teams assess the balance between student engagement and pedagogical soundness), and enterprise chatbots answering employee questions (where evaluation focuses on maintaining consistency across hundreds of thousands of unpredictable queries). This paper makes three contributions to HCI and LLM evaluation practice. First , we provide an empirical account of how practitioners evaluate LLM products in production settings. Prior empirical work focused on evaluation of Natural Language Generation (NLG) before the LLM era ( Zhou et al., 2022 ) or documented practices within a single large organization ( Nahar et al., 2025 ) ; we extend this by studying practitioners across diverse organizational contexts who lack dedicated evaluation infrastructure. While prior work characterizes the widespread reliance on manual testing as a transitional phase awaiting better metrics, we argue that interpretive practices (such as “vibe checks”) are necessary adaptations to the probabilistic nature of LLMs that must be supported rather than replaced. Second , we identify and conceptualize the results-actionability gap : a novel challenge where practitioners successfully collect evaluation data but cannot translate findings into system improvements because they cannot isolate whether failures stem from prompts, retrieval mechanisms, or the model itself. Third , drawing on patterns from successful teams in our study, we contribute actionable strategies to bridge the aforementioned gap through organizational adaptations rather than new metrics. These strategies can support what we observe as practitioners’ ongoing formalization journey from ad-hoc vibe checks toward systematic evaluation. For HCI researchers, our findings point to opportunities beyond developing better metrics: supporting the organizational and sociotechnical layers of systematization that practitioners actually need. For practitioners, we provide both validation and direction: validation that current struggles reflect fundamental LLM characteristics rather than poor practice, and concrete direction through three strategies for implementable practices drawn from successful teams and the state-of-the-art. These require no new frameworks or tools, only organizational and process adaptations that our participants discovered through trial and error. 2. Background and Related

Read the complete text