The AI Invisibility Effect: Understanding Human-AI Interaction When Users Don’t Recognize Artificial Intelligence
Obada Kraishan · 2026
Read The AI Invisibility Effect: Understanding Human-AI Interaction When Users Don’t Recognize Artificial Intelligence by Obada Kraishan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-00579.txt.
Introduction
Obada Kraishan studies what happens when people use AI features inside apps without noticing them, an effect he calls AI invisibility. He analyzed about one and a half million reviews of four hundred twenty-two apps from the Apple and Google stores, split between apps with AI features and control apps. Sentiment tools, topic modeling, and a concern-benefit coding scheme structured the analysis.
Only about twelve percent of reviews mentioned AI at all, even though nearly half the apps had AI capabilities. AI-featuring apps earned lower ratings overall, yet once AI mentions and review traits were controlled, the relationship flipped positive. Privacy dominated user worries among concern-expressing reviews. The study suggests invisible AI shapes satisfaction in ways users themselves rarely articulate.
Catalog record
| CREATOR | Obada Kraishan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-00579
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The AI Invisibility Effect: Understanding Human-AI Interaction When Users Don’t Recognize Artificial Intelligence Obada Kraishan Abstract The fast integration of artificial intelligence into mobile applications has completely changed the digital landscape; however, the impact of this change on user perception of AI features remains poorly understood. This large-scale analysis examined 1,484,633 mobile application reviews across 422 applications (200 AI-featuring, 222 control) from iOS App Store and Google Play Store. By employing sentiment classification, topic modeling, and concern-benefit categorization, we identified a major disconnect: only 11.9% of reviews mentioned AI, even though 47.4% of applications featured AI capabilities. AI-featuring applications received significantly lower ratings than traditional applications ( d = 0.40 d=0.40 ); however, hierarchical regression revealed a hidden pattern—the negative relationship reversed after controlling for AI mentions and review characteristics ( b = 0.405 b=0.405 , p < .001 p<.001 ). Privacy dominated user concerns (34.8% of concern-expressing reviews), while efficiency represented the primary benefit (42.3%). Effects varied greatly by category, from positive for Assistant applications ( d = 0.55 d=0.55 ) to negative for Entertainment ( d = − 0.23 d=-0.23 ). These findings suggest that AI features often operate below user awareness thresholds, and it is the explicit recognition of AI, rather than its mere presence, that drives negative evaluations. This challenges basic assumptions about technology acceptance in AI systems. K eywords artificial intelligence \cdot human-AI interaction \cdot mobile applications \cdot user perception \cdot technology acceptance \cdot app reviews \cdot user experience 1 Introduction The use of artificial intelligence into everyday digital experiences represents one of the most major technological shifts of the past decade. From voice assistants that interpret natural language to photo editors that enhance images with computational photography, AI has moved from research laboratories into the smartphones of billions of users worldwide [ 1 , 2 ] . This transformation has been clear in mobile applications, where AI features have become more common across diverse categories ranging from productivity tools to entertainment platforms [ 3 ] . However, despite this widespread deployment, our understanding of how regular users perceive, evaluate, and engage with AI-powered features remains very limited. The appeal of AI in consumer applications centers on enhanced personalization, improved efficiency, and capabilities that would be impossible through traditional programming approaches [ 4 , 5 ] . Technology companies have invested billions in developing AI features, often positioning them as key differentiators in competitive markets [ 6 ] . Marketing materials frequently highlight the intelligence and smartness of these applications, suggesting that AI integration automatically improves user experience. However, recent research suggests that the relationship between AI implementation and user satisfaction may be more complex than these narratives suggest [ 7 , 8 ] . Multiple areas of research have examined different aspects of human-AI interaction, though significant gaps remain in our understanding of real-world user responses to AI features in consumer applications. Studies in human-computer interaction have primarily focused on controlled laboratory experiments or prototype systems [ 1 , 9 ] , while research in information systems has examined organizational AI adoption rather than individual consumer experiences [ 10 , 11 ] . Marketing research has investigated consumer attitudes toward AI in specific contexts such as customer service or recommendation systems [ 12 , 13 ] . However, these approaches typically examine attitudes in controlled settings rather than capturing naturalistic user feedback from real-world application usage. This work addresses these limitations by analyzing a large collection of real user feedback from app store reviews, providing insights into how millions of users experience and evaluate AI features in their daily digital use. App store reviews offer a unique window into authentic user sentiment, as they represent voluntary, unprompted feedback generated in real-world usage contexts [ 14 , 15 ] . Unlike laboratory studies or surveys, these reviews capture user reactions to fully deployed commercial applications, reflecting the complexities and constraints of actual implementation rather than simplified test versions. The timing of this research is critical due to the recent acceleration in AI deployment, which follows breakthroughs in large language models and generative AI systems [ 16 , 17 ] . The period from 2024 to 2025 is expected to witness huge public attention to AI capabilities, with tools like ChatGPT and Claude becoming household names [ 18 ] . As public attention to AI capabilities grows, important questions arise about whether and how users recognize AI features in their everyday applications. Building on these observations, this study addresses three research questions that collectively illuminate the current state of AI integration in consumer mobile applications: • RQ1: How do AI-featuring applications differ from non-AI applications in terms of user satisfaction and engagement patterns? • RQ2: What specific concerns and perceived benefits do users express when discussing AI features in mobile applications? • RQ3: To what extent does the reception of AI features vary across different application categories and mobile platforms? This research makes several important contributions to our understanding of human-AI interaction in consumer contexts. First, we provide a large-scale analysis of user responses to AI-powered mobile applications in real-world settings, examining over 1.48 million unprompted reviews across 422 applications from both iOS and Android platforms. Second, we examine whether and how users recognize and articulate AI features in their naturalistic evaluations. Third, we identify complex relationships between AI implementation and user satisfaction through hierarchical regression analyses. Fourth, we develop a comprehensive taxonomy of user concerns and perceived benefits related to AI features. Finally, we demonstrate substantial heterogeneity in AI reception across application categories and platforms. 2 Literature Review 2.1 The Evolution of AI in Consumer Applications The use of artificial intelligence into consumer-facing applications has developed through several different phases, each characterized by different technological capabilities and user expectations. Early implementations focused on rule-based systems and simple pattern recognition, offering features like predictive text and basic recommendation algorithms [ 19 ] . These initial attempts into AI were often invisible to users, operating as background processes that enhanced functionality without clear user awareness. The introduction of virtual assistants like Siri in 2011 marked a big shift toward more visible and interactive AI features, though adoption remained limited by technical constraints and user doubts [ 20 ] . The current generation of AI-powered applications, appearing after 2020, represents a qualitative advance in both capability and widespread use. Advances in deep learning, mainly in natural language processing and computer vision, have enabled applications to perform tasks previously thought to require human intelligence [ 21 , 22 ] . Photo editing applications can now automatically enhance images using computational photography techniques that surpass manual editing for most users [ 23 ] . Writing assistants powered by large language models can generate, edit, and translate text with near-human fluency [ 16 ] . These capabilities have led to a transformation of mobile applications where AI features have become expected rather than exceptional [ 10 ] . Despite these technical advances, research on user reception of AI features reveals a complex and often inconsistent landscape. Studies have documented both enthusiasm for AI capabilities and deep skepticism about their implementation [ 24 , 25 ] . Research shows that users often prefer human judgment even when algorithmic decisions clearly perform better