Making Sense of AI Agents Hype: Adoption, Architectures, and Takeaways from Practitioners Journal: Publication Name

Ruoyu Su, Matteo Esposito, Roberta Capuano, Rafiullah Omar, June Sallou, Henry Muccini, Davide Taibi · 2026

Read Making Sense of AI Agents Hype: Adoption, Architectures, and Takeaways from Practitioners Journal: Publication Name by Ruoyu Su, Matteo Esposito, Roberta Capuano, Rafiullah Omar, June Sallou, Henry Muccini, Davide Taibi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-00189.txt.

Introduction

Su and six colleagues review 138 recorded practitioner talks to learn how companies actually build agent-based systems. They trace how firms adopt agent architectures, what recurring design strategies and patterns appear, and which application domains and technologies support LLM-driven agentic systems in operation. The review aims at practitioners who need a grounded picture of real industrial practice rather than hype. Its findings map adoption, architecture, and implementation choices across the talks.

Catalog record

CREATORRuoyu Su, Matteo Esposito, Roberta Capuano, Rafiullah Omar, June Sallou, Henry Muccini, Davide Taibi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31099
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.00189

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Making Sense of AI Agents Hype: Adoption, Architectures, and Takeaways from Practitioners Journal: Publication Name Ruoyu Su, Matteo Esposito, Roberta Capuano, Rafiullah Omar, June Sallou, Henry Muccini, Davide Taibi Abstract To support practitioners in understanding how agentic systems are designed in real-world industrial practice, we present a review of practitioner conference talks on AI agents. We analyzed 138 recorded talks to examine how companies adopt agent-based architectures ( Objective 1 ), identify recurring architectural strategies and patterns ( Objective 2 ), and analyze application domains and technologies used to implement and operate LLM-driven agentic systems ( Objective 3 ). \jvol XX \jnum XX \paper 8 \jmonth Month \jtitle Publication Title \sptitle Article Type: Description (Special Issue on Engineering Agentic Systems) \chapteri AI agents are rapidly reshaping software engineering practices, supporting activities such as code generation, testing, documentation, workflow orchestration, and system operation. These capabilities are largely driven by recent advances in large language models (LLMs), whose applications continue to be actively explored [ 3 ] , making AI agents foundational components of modern AI-driven systems [ 7 , 9 ] . According to Gartner [ 4 ] , 40% of enterprise applications will feature task-specific AI agents by 2026, up from less than 5% in 2025. International Data Corporation (IDC) [ 5 ] also forecasts agent-based AI as a major driver of enterprise IT investment through large-scale agent orchestration. Over the past two years, practitioner demand for concrete guidance and shared experience has increased significantly. Newly established conferences on agentic AI report strong participation, while major industry events have expanded their focus on agentic systems. For instance, recent editions of Amazon Web Services (AWS) re:Invent featured 720 sessions on AI agents within a single week, covering architecture, tooling, deployment, and governance [ 2 ] . This article adopts a practitioner-centered analysis to identify what works, what fails, and how agent systems are structured in practice. We analyze 234 publicly available practitioner conference talks and technical presentations on AI agents using a structured qualitative approach supported by LLMs with humans in the loop. Rather than proposing new frameworks or formal theories, our goal is to consolidate recurring themes , architectural strategies , and practical lessons reported by practitioners building and deploying agentic systems. Specifically, the article is guided by three objectives. First, we examine how organizations transition from early experimentation with AI agents to production adoption, focusing on motivations , architectural factors , and practitioner experience influencing whether teams adapt existing systems or build agentic solutions from scratch. Second, we capture reusable architectural knowledge from industrial practice, identifying common strategies and patterns for designing agentic systems. Third, we investigate how agent-based architectures behave in real-world settings, highlighting differences across application domains and the technologies used to implement and operate LLM -driven agentic systems. This article makes three main contributions: • a large-scale empirical analysis of AI agent adoption grounded in 234 practitioner conference talks, providing insight into how organizations transition from experimentation to production; • a consolidated view of recurring architectural strategies and patterns that characterize agentic systems in industrial practice; • a cross-domain synthesis of agentic system implementations, identifying the technologies and frameworks used to build and operate LLM -driven agents. Together, these contributions translate dispersed practitioner experience into structured knowledge and practical guidance for engineers designing and deploying agent-based systems. AI AGENTS ARCHITECTURES Agentic systems open new perspectives for designing AI agents, from single-agent to multi-agent applications. In the former case, new architecture design decisions are required to: use short-term or long-term memory strategies for storing, organizing, and retrieving context, experiences, or task-relevant knowledge; context compression or summarization for long - running tasks to handle limited context windows; choosing which tools, Application Programming Interfaces (APIs) , plugins, or actuators the agent can use to interact with the world beyond text; optimize for latency and cost by limiting unnecessary tool calls. Those decisions impact the internal structure of an AI agent, including its memory mechanisms, tools, planning and reasoning capabilities, and self-reflection. When designing multi-agent AI systems, decisions on how to divide labor by skill and feedback across agent personas, how to connect agents (e.g., choreography or orchestration), and which communication patterns to use become fundamental for engineering quality AI systems. SIDEBAR: The Analysis Process Our study followed a lightweight, practitioner-oriented qualitative analysis process designed to extract architectural insights from a large collection of recorded industry talks and video transcripts. The goal was not to build exhaustive theory, but to capture recurring patterns, strategies, and challenges communicated by practitioners when adopting and operating AI agent-based architectures. We applied a recent methodology for applying LLM in qualitative analysis [ 8 , 10 ] . Data Collection We gathered 234 public practitioner talks, technical briefings, and conference presentations released between September 2024–September 2025. We selected the most relevant practitioner conference using four inclusion criteria: (i) at least five prior editions ( \geq 5 ), (ii) talks delivered by practitioners or industry-affiliated researchers, (iii) sessions conducted in English, and (iv) full video recordings freely available online [ 10 ] . Videos were automatically transcribed and manually checked. An automated pipeline of Bash scripts was used for video transcription, comprising the following steps: i) video download using the open source yt-dlp tool 1 1 1 https://github.com/yt-dlp/yt-dlp ii) audio extraction and cut using ffmpeg 2 2 2 https://www.ffmpeg.org/ , and iii) transcript extraction using Whisper-XXL 3 3 3 https://github.com/Purfview/whisper-standalone-win/releases/tag/Faster-Whisper-XXL , a Transformer-based deep learning automatic speech recognition (ASR) model. Four authors, working in pairs with a final judge resolving disagreements, independently reviewed the transcripts, applying inclusion and exclusion criteria to reduce 234 transcripts to 138. We used a Large Reasoning Model (LRM) as the primary engine for transcript analysis, adopting a retrieval-argumented generation (RAG) approach to handle transcripts exceeding the LLM’s context length. The LRM processed each transcript and produced structured outputs that captured architectural statements such as adoption drivers, coordination patterns, workflow structures, and enabling technologies. The LRM’s role mirrors its function in prior architecture compliance studies, where it acts as the main reasoning component for evidence extraction and classification (thematic and axial coding). To ensure accuracy and reduce single-model bias, we employed three independent Validator models (V1, V2, V3) . Each Validator reviewed the LRM’s output and checked it against the original transcript segments: • whether the LRM’s summaries faithfully reflected the transcript, • whether architectural concepts were overstated or hallucinated, • and whether the extracted insights maintained practitioner intent. Validators produced a simple agree/disagree decision with comments. Only insights confirmed by at least two Validators were retained. Finally, according to Su et al. [ 10 ] and Robredo et al. [ 8 ] , two authors reviewed the consolidated LRM+Validator outputs and assessed the LLM identified themes. Additional details, including prompts, scripts, extended methodology, and full coding schema, are provided in the online appendix [ 11 ] . Research Objectives Organizations exploring AI agent-based architectures face three challenges: understanding adoption, designing architectures, and assessing performance after deployment. Our study addresses them through three objectives. Objective 1 examines how companies adopt agent-based architectures, focusing on motivations, the architectural factors, and the practitioner experience that influence whether teams migrate existing systems or build agentic solutions from scratch. Objective 2 captures the reusable architectural knowledge

Read the complete text