Perceptions of Agentic AI in Organizations: Implications for Responsible AI and ROI
Lee Ackerman · 2025
Read Perceptions of Agentic AI in Organizations: Implications for Responsible AI and ROI by Lee Ackerman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11564.txt.
Introduction
Lee Ackerman asks the people inside organizations how they are coping with AI that acts on its own, in this 2025 qualitative study. Agentic systems plan and execute with little oversight, which strains the responsible AI frameworks companies built for tamer tools. Ackerman interviewed AI professionals about their lived experience of that strain.
Patterns emerged from the accounts. The sheer interconnectedness of responsibility questions, fairness, safety, accountability, transparency, makes any single fix unravel into the next problem. Novelty compounds it: teams lack shared knowledge, rarely engage the stakeholders who will live with outcomes, and default to a posture of control. Those habits, the study argues, slow adaptation and blunt implementation. The result is a double loss: responsibility goals slip, and the return on investment that justified the systems slips with them.
Catalog record
| CREATOR | Lee Ackerman |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-11564
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Perceptions of Agentic AI in Organizations: Implications for Responsible AI and ROI Lee Ackerman Abstract As artificial intelligence (AI) systems rapidly gain autonomy, the need for robust responsible AI frameworks becomes paramount. This paper investigates how organizations perceive and adapt such frameworks amidst the emerging landscape of increasingly sophisticated agentic AI. Employing an interpretive qualitative approach, the study explores the lived experiences of AI professionals. Findings highlight that the inherent complexity of agentic AI systems and their responsible implementation, rooted in the intricate interconnectedness of responsible AI dimensions and the thematic framework (an analytical structure developed from the data), combined with the novelty of agentic AI, contribute to significant challenges in organizational adaptation, characterized by knowledge gaps, a limited emphasis on stakeholder engagement, and a strong focus on control. These factors, by hindering effective adaptation and implementation, ultimately compromise the potential for responsible AI and the realization of ROI. Keywords: Agentic AI, Responsible AI, AI Ethics, Organizational Impact, Return on Investment (ROI), Organizational Perceptions, Interpretive Qualitative Research 1 Perceptions of Agentic AI in Organizations: Implications for Responsible AI and ROI As artificial intelligence ( AI ) systems rapidly gain autonomy, ensuring their alignment with human values becomes critical ( Bostrom & Yudkowsky (2018) ) . This paper explores how organizations are navigating the complexities of agentic AI. Responsible AI frameworks, which guide the ethical development and deployment of AI, include ethical guidelines, transparency measures, accountability mechanisms, bias mitigation strategies, privacy and data protection protocols, safety and security standards, and stakeholder engagement processes. These frameworks are informed by ethical principles (e.g., OECD AI Principles; Organisation for Economic Co-operation and Development (OECD) (2024) ) and risk management guidelines (e.g., NIST AI Risk Management Framework; National Institute of Standards and Technology (2023) ) which will continue to evolve in response to the broader socio-technical environment ( MacKenzie & Wajcman (1999) ; Dignum (2019) ; Floridi (2023) ) . This research adopts an interpretive qualitative approach to explore how organizations perceive and adapt these frameworks in the context of increasingly sophisticated agentic AI systems. The study focuses on interpreting lived experiences of AI professionals who responded to an online survey. Agentic AI 1 1 1 Generative AI Agents (Agentic AI) : Generative AI agents, or Agentic AI, represent a more advanced category of AI agents that should be distinguished from simpler AI applications like AI assistants or chatbots. Generative AI agents leverage large language models (LLMs) and multimodal AI capabilities. These agents exhibit a higher degree of autonomy and adaptability, characterized by: Emergent Behavior : The ability to generate novel solutions, exhibit unexpected behaviors, and adapt to unforeseen challenges. Multimodal Reasoning : The capacity to process and integrate information from various sources, including text, images, audio, and video. Proactive Planning : The ability to autonomously plan and execute complex tasks, often involving multiple steps and interactions with the environment. Continuous Learning : The ability to continuously learn and adapt based on new information and experiences Increased Organizational Demands : Agentic AI systems often require more robust data infrastructure, advanced API integrations, and specialized organizational skills compared to simpler AI applications, raising the bar for successful implementation and responsible governance , a new class of highly autonomous and adaptable AI agents, leverages large language models ( LLMs ) and multimodal AI capabilities to exhibit: emergent behavior, generating novel solutions and adapting to unforeseen challenges; multimodal reasoning, enabling them to process information from various sources like text, images, and audio; proactive planning, giving them the ability to autonomously plan and execute complex tasks; and continuous learning, which allows them to adapt based on new information. The paper investigates how organizations are adapting their responsible AI frameworks to accommodate this novel technology and its unique challenges and opportunities. This context of rapidly evolving AI technologies leads us to the central problem this research addresses: how do organizations' perceptions of agentic AI influence their implementation of responsible AI practices and their subsequent Return on Investment ( ROI ) calculations, including considerations of workforce skills and capabilities? 1.1 Contextualizing the Narrative: Literature Review The adoption of generative AI has outpaced past technology launches like the personal computer and the internet ( Bick et al. (2024) ) . Our ethics – the ideas of right and wrong along with supporting norms, rules, and principles - become increasingly important given this growth and potential for impact ( Pflanzer et al. (2022) ) . Exploring AI and Ethics thoughtfully, requires considering AI’s impact, including its opportunities and risks ( Floridi et al. (2018) ) . However, practitioners find ethical ideals abstract, open to interpretation, and difficult to apply to AI, given AI’s agency and the lack of understanding of its inner workings ( Buijsman et al. (2025) ) . The challenges are further nuanced as AI performs work with social dimensions – cognitive work previously performed by humans – inheriting the associated human responsibilities and prompting discussions about advanced AI’s potential ( Bostrom (2014) ) . Responsible AI Frameworks guide the development, deployment, and use of AI systems to minimize potential harm ( Dehghani et al. (2024) ) . While sharing common ethical principles like transparency, fairness, responsibility, and privacy, practitioners are grappling with differences in the details related to interpretation, importance, and implementation ( Jobin et al. (2019) ) . Responsible AI Pattern Catalogues highlight ongoing efforts to recognize proven solutions to recurring problems, while also providing extensible and adaptable structures for transitioning from principles to action ( Lu et al. (2024) ) . Legislation plays a crucial role in shaping responsible AI practices. A key example is the EU Artificial Intelligence Act ( European Union (2024) ) , which takes a risk-based approach to regulating the development and deployment of AI systems. However, ethical considerations go beyond legal compliance. Despite long-standing discussions on potential harms like biases, effective action has been challenging, leading to technical debt ( Cunningham (1992) ) , ethical debt (as discussed in ( Field (2024) ) ), which refers to the accumulation of ethical compromises, and governance debt ( Meskarian (2023) ) , which relates to the long-term consequences of neglecting governance structures. Moving from theory to impact while also overcoming these debts involves considerable work and investment, covering areas such as organizational tactics, stakeholder management, and technical methods ( Rakova et al. (2021) ) . Generative AI, foundational to Agentic AI, has shortcomings in reliability and learning, along with safety challenges and risks like biases, privacy concerns, and over-reliance ( OpenAI (2024) ; Bengio et al. (2025) ) . Cultural forces also shape hopes and fears, as people balance the promise of ease with the fear of obsolescence ( Cave & Dihal (2019) ) and seek to overcome anxiety-inducing portrayals of AI ( Bo et al. (2024) ) . This interplay of novelty and familiarity can be understood through Remediation ( Bolter (2001) ) , where new media refashions and repurposes older forms. Agentic AI remediates human agency, communication, and automation, creating both excitement and anxiety. Navigating this promise and uncertainty, requires understanding the progression from AI Assistants to Agentic AI, with its advances in autonomy, reasoning, adaptability, planning, and emergent behaviors ( Thomas (2024) ; NVIDIA Corporation (2023) ; Russell & Norvig (2021) ;