Why Johnny Can’t Use Agents: Industry Aspirations vs. User Realities with AI Agent Software Conference: arXiv; 2025; Pittsburgh, PA, United States CCS: Human-centered computing Empirical studies in interaction design CCS: Human-centered computing User studies CCS: Human-centered computing Usability
Pradyumna Shome, Sashreek Krishnan, Sauvik Das · 2025
Read Why Johnny Can’t Use Agents: Industry Aspirations vs. User Realities with AI Agent Software Conference: arXiv; 2025; Pittsburgh, PA, United States CCS: Human-centered computing Empirical studies in interaction design CCS: Human-centered computing User studies CCS: Human-centered computing Usability by Pradyumna Shome, Sashreek Krishnan, Sauvik Das (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-14528.txt.
Introduction
Pradyumna Shome, Sashreek Krishnan and Sauvik Das examine AI agents in 2025 through the gap between industry marketing and user reality. Agent is used loosely, blurring what systems can do and how usable they are. Two questions structure the study.
A systematic review of marketed uses for over a hundred commercial agents finds three buckets: orchestration, creation and insight. A usability study then had thirty one participants attempt representative tasks on two popular agent tools. Many advertised capabilities proved hard to realise in practice. Failures clustered around setup, control and recovery from agent mistakes. The authors argue honest capability language and usability testing matter as much as model gains for everyday users.
Catalog record
| CREATOR | Pradyumna Shome, Sashreek Krishnan, Sauvik Das |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 98 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-14528
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Why Johnny Can’t Use Agents: Industry Aspirations vs. User Realities with AI Agent Software Conference: arXiv; 2025; Pittsburgh, PA, United States CCS: Human-centered computing Empirical studies in interaction design CCS: Human-centered computing User studies CCS: Human-centered computing Usability testing CCS: Human-centered computing Natural language interfaces CCS: Human-centered computing Empirical studies in interaction design CCS: Human-centered computing User studies CCS: Human-centered computing Usability testing CCS: Human-centered computing Natural language interfaces Pradyumna Shome, Sashreek Krishnan, Sauvik Das Abstract . There is growing imprecision about what “AI agents” are, what they can do, and how effectively they can be used by their intended users. We pose two key research questions: (i) How does the tech industry conceive of and market “AI agents”? (ii) What challenges do end-users face when attempting to use commercial AI agents for their advertised uses? We first performed a systematic review of marketed use cases for 102 commercial AI agents, finding that they fall into three umbrella categories: orchestration, creation, and insight. Next, we conducted a usability assessment where N = 31 N=31 participants attempted representative tasks for each of these categories on two popular commercial AI agent tools: Operator and Manus. We found that users were generally impressed with these agents but faced several critical usability challenges ranging from agent capabilities that were misaligned with user mental models to agents lacking the meta-cognitive abilities necessary for effective collaboration. Figure 1. We identify five critical usability barriers novice users face when interacting with AI agents to accomplish a task. As they attempt to delegate their task, they must progressively develop a mental model of the agent’s capabilities, navigate its rigid collaboration style, decode its overwhelming communication, all while the agent isn’t fully cognizant of its own capabilities, and presumes it has a user’s complete trust. 1. Introduction Visions of computing systems as intelligent partners for knowledge work stretch back nearly a century with Vannevar Bush’s 1945 accounting of the “Memex,” a mechanized desk that could augment human memory and association by linking together trails of knowledge ( Bush et al. 1945 ) . Two decades later, Licklider’s article on “Man–Machine Symbiosis” sharpened this vision into a research program for interactive computing, suggesting that computers might soon “formulate hypotheses” and “make decisions” in concert with their human users ( Licklider 1960 ) . The HCI community has long been animated by these possibilities: from early Wizard-of-Oz experiments simulating what may be possible with intelligent interfaces ( Gould et al. 1983 ) , to Horvitz’s explorations of agent-mediated “mixed-initiative” interfaces for scheduling and meeting management ( Horvitz 1999 ) , to Shneiderman and Maes’ canonical debate on direct manipulation versus interface agents ( Maes 1994 ; Shneiderman and Maes 1997 ) , to end-user programming systems like if-this-then-that (IFTTT) that help users configure semi-autonomous software assistants ( Ur et al. 2016 ) . Along the way, ill-fated counter examples such as Microsoft’s Clippy ( Wikipedia contributors 2025b ) highlighted the risks of overzealous agent designs that frustrated users by, as Adar might put it, having UIs that wrote checks the underlying AI couldn’t cash ( Adar 2018 ) . Today, the dream has resurfaced under the banner of “AI agents.” In 2025, thousands of start-ups and major technology companies have advertised agentic products that can orchestrate workflows, generate creative outputs, and deliver insights on demand. Commercial products such as OpenAI’s ChatGPT Operator and emerging agent platforms like Manus are marketed to non-technical end-users as productivity multipliers. These systems also revive older paradigms “centaur” human–AI teaming ( Kasparov 2010 ) , in which humans and agents collaborate by sharing complementary strengths. But, as with many technologies at the peak of their hype cycle, what an “AI agent” is, what it can do, and how well it fits into the messy realities of everyday knowledge work remain under-specified. Much of the conversation about agent performance — in benchmarks, demo videos, venture funding pitches, and media hype — has focused on easy-to-measure ideals. But does an agent scoring 26% versus 24% on “Humanity’s Last Exam” matter to a user when a user wants help with booking a flight? More broadly, what we lack is systematic understanding of how the tech industry conceives of “AI agents” as a category of software, and of how end-users actually experience them in practice. Prior Human-AI interaction research cautions that without clear expectations, transparency, and user control ( Amershi et al. 2019 ; Shneiderman 2022 ) , agents risk repeating the mistakes of the past. Against this backdrop, we ask the following two research questions: 1.1. Research Questions RQ1: How does the tech industry conceive of and market “AI agents”? Industry framings matter because they define the menu of software choices that most users can access. RQ2: What challenges do end-users face when attempting to use commercial AI agents for their advertised uses? Here, we seek to understand the frictions that emerge when aspirational marketing collides with lived practice. 1.2. Summary of Work Figure 2. Overview of our research process. We conducted a systematic review to build a taxonomy of marketed use cases of AI agents. Next, we conducted a think-aloud session in which participants completed tasks corresponding to our umbrella use cases, from which we identified usability barriers. These barriers lead to a set of design implications for next-generation AI agent design. To answer these questions, we first conducted a review of the marketed use cases for AI agents. We started by sourcing advertised uses for AI agents by exploring aggregator websites for AI Agent products including the AI Agents Directory and Product Hunt, and supplemented our corpus with Google searches to increase the diversity of products. Based on our data set, we analyzed themes across verbiage relating to agent functionalities to extract abstract use cases. We distilled a taxonomy of three umbrella categories: Orchestration , Creation , and Insight . Figure 2 provides an overview of our research process. We then ran a think-aloud usability study in which N=31 participants attempted representative tasks in each of the three categories using two popular commercial agent platforms—Operator and Manus. We supplemented these think-aloud studies with semi-structured interviews. Our study revealed several recurring usability challenges. Although generally successful at accomplishing the assigned tasks (which were designed to be simple and doable), participants struggled with five critical usability barriers: (i) agent capabilities are misaligned with user mental models, (ii) agents presume trust without establishing credibility, (iii) agents fail to accommodate a diversity of collaboration styles, (iv) agents generate an overwhelming amount of communication overhead, and (v) agents lack the meta-cognitive abilities that enable productive collaboration. Figure 1 symbolically depicts Johnny, our proverbial end-user, navigating these challenges as they attempt to delegate a task. These usability breakdowns echo long-standing critiques of agentic systems in HCI: the dangers of ceding too much initiative, the costs of opaque automation, and the challenge of aligning agent actions with human goals. 1.3. Contributions To summarize, this paper makes three core contributions. • We reviewed and organized how the tech industry conceives of and markets AI agents, yielding a taxonomy of three core agent “abilities”. • We present an empirical account of five critical usability barriers end-users face when attempting to use these tools on a representative