An Empirical Study of Generative AI Adoption in Software Engineering DOI: XXXXXXX.XXXXXXX CCS: Software and its engineering

Görkem Giray, Onur Demirörs, Marcos Kalinowski, Daniel Mendez · 2025

Read An Empirical Study of Generative AI Adoption in Software Engineering DOI: XXXXXXX.XXXXXXX CCS: Software and its engineering by Görkem Giray, Onur Demirörs, Marcos Kalinowski, Daniel Mendez (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23327.txt.

Introduction

Görkem Giray, Onur Demirörs, Marcos Kalinowski, and Daniel Mendez survey how software practitioners are adopting generative AI tools. Adoption is wide and deep in daily work, the study finds, especially for coding, testing, personal assistance, and maintenance. Practitioners report shorter cycle times, better quality, better support for knowledge work, and productivity gains, though few firms measure those gains.

The challenges list is equally concrete: incorrect or unreliable outputs, the craft of prompt engineering, checking overhead, security and privacy worries, and the risk of leaning on the tools too hard. Companies set rules for tool access but invest less in training and governance. Looking ahead, practitioners expect generative AI to redefine their roles rather than replace them, paired with anxiety about a contracting job market and shifting skill demands. The study grounds debates that often run on anecdote.

Catalog record

CREATORGörkem Giray, Onur Demirörs, Marcos Kalinowski, Daniel Mendez
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE84 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-23327

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An Empirical Study of Generative AI Adoption in Software Engineering DOI: XXXXXXX.XXXXXXX CCS: Software and its engineering Görkem Giray, Onur Demirörs, Marcos Kalinowski, Daniel Mendez Abstract . Context. Generative Artificial Intelligence (GenAI) tools are being increasingly adopted by practitioners in software engineering (SE), promising support for several SE activities. Despite increasing adoption, we still lack empirical evidence on how GenAI is used in practice, the benefits it provides, the challenges it introduces, and its broader organizational and societal implications. Objective. This study aims to provide an overview of the status of GenAI adoption in SE. It investigates the (1) status of GenAI adoption, (2) associated benefits and challenges, (3) institutionalization of tools and techniques, and (4) anticipated long-term impacts on SE professionals and the community. Method. We conducted an internationally distributed questionnaire-based survey to collect insights from SE practitioners. The survey combined closed-ended and open-ended questions to capture both quantitative trends and qualitative insights. We received 204 responses from 37 countries. Qualitative responses were analyzed using systematic coding and categorization. To cope with the random sampling limitation, we used bootstrapping and conservatively reported confidence intervals. Results. The results indicate a wide adoption of GenAI tools and how they are deeply integrated into daily SE work, particularly for implementation, verification and validation, personal assistance, and maintenance-related tasks. Practitioners report substantial benefits, most notably reduction in cycle time, quality improvements, enhanced support in knowledge work, and productivity gains. However, objective measurement of productivity and quality remains limited in practice. Significant challenges persist, including incorrect or unreliable outputs, prompt engineering difficulties, validation overhead, security and privacy concerns, and risks of overreliance. Institutionalization of tools and techniques seems to be common, but it varies considerably, with a strong focus on tool access and less emphasis on training and governance. Practitioners expect GenAI to redefine rather than replace their roles, while expressing moderate concern about job market contraction and skill shifts. Conclusions. The findings further corroborate how GenAI is receiving much attention in the SE community, delivering perceived value, but also introducing new technical, organizational, and socio-technical challenges. Practitioners, organizations, and even governments, as we argue, must move beyond ad-hoc adoption towards more systematic approaches to ensure successful, sustainable, and responsible integrations of GenAI into their SE practices. 1. Introduction Generative Artificial Intelligence (GenAI) refers to the subfield of AI that can create new content, such as text, images, video, audio, or code. GenAI relies on deep learning models typically trained on very large scale of data. The capabilities of GenAI tools for creating new content across a broad range of use cases often comes with the promise to transform several industries, including Software Engineering (SE). The adoption of GenAI applications seems growing rapidly, but unevenly across industries, and the information technology sector is meant to be leading the way ( 79 ; 54 ) . As OpenAI reports, users with engineering roles are using ChatGPT mainly for programming tasks followed by research and documentation ( 54 ) . A recent more rigorous analysis of four million Claude interactions revealed that it is predominantly used in software development mostly by developers, testers, and analysts ( 29 ) . Further industrial research initiatives, such as the one by the Capgemini Research Institute ( 9 ) , measured GenAI adoption among SE professionals at 46% in 2024 forecasting it to reach 85% in 2026. The StackOverflow Developer Survey ( 66 ) reports that 84% of its respondents are already using or planning to use AI tools and 51% of professional developers reported daily use. SE professionals use GenAI tools mainly for coding and related activities ( 50 ; 9 ; 54 ) . The use of GenAI tools as an advanced search engine is also one of the main use cases ( 66 ) . The existing and potential use cases are much wider across the software development life cycle ( 56 ; 59 ) . There are also significant challenges associated with the adoption of GenAI tools in software engineering, which in some cases lead users to refrain from using these tools altogether. GenAI tools may produce code that does not meet functional requirements or quality expectations ( 75 ; 45 ) and includes security vulnerabilities ( 40 ; 49 ) . Moreover, considerable time may be required to debug and modify imperfect GenAI-generated code ( 75 ; 45 ) . Furthermore, developers worry about privacy risks related to sharing proprietary code with public models and the potential for the generated code to infringe on intellectual property ( 78 ; 45 ) . Finally, GenAI may have long-term impacts on SE professionals and the community, e.g., skills atrophy ( 78 ) , job displacements ( 66 ) , and a potential contradiction of the SE job market ( 10 ) . The complex and intertwined technical, human, and organizational factors impacting the adoption of GenAI for SE are well reflected in the so far scattered literature. The lack of evidence-based insights into the extent to which GenAI is adopted and the tasks in scope of GenAI, as well as the challenges associated with GenAI, renders problem-driven research in this area cumbersome. This motivated our survey initiative at hands, laying a foundation for the effective utilization and implementation of GenAI tools by users, organizations, and societies. Our study uses empirical data collected from 204 SE practitioners to address these critical themes and provide a holistic view of the dynamic landscape of GenAI adoption in SE. The remainder of this paper is organized as follows. Section 2 provides background and related work. Section 3 describes the research method. Section 4 presents the results of the survey. Sections 5 and 6 discuss the results and threats to validity, respectively. Finally, section 7 concludes the paper. 2. Background and Related Work This section introduces the foundational concepts and related terms as used in this paper. Section 2.2 presents the related work from the academic and gray literature. 2.1. Background This section introduces the foundational concepts and describes the vocabulary by defining the essential concepts used in this paper. Section 2.2 presents the related work from the academic and gray literature. 2.1.1. AI and GenAI Artificial Intelligence (AI) is the discipline devoted to the development of intelligent agents ( 62 ) . Intelligent agents perceive their environment and try to achieve their goals by acting autonomously ( 62 ) . Generative AI or GenAI refers to the subfield of AI that can create new content, such as text, images, video, audio, or code. GenAI relies on deep learning models trained on a very large scale of data. GenAI gained significant attention after the introduction of ChatGPT by OpenAI in November 2022. Other chatbots, such as Google’s Gemini, Anthropic’s Claude, DeepSeek Chat and Perplexity, launched soon after and reached a significant user base. GenAI tools specialized in SE-related tasks were also launched to support SE professionals. For example, GitHub Copilot and Cursor provide GenAI capabilities, such as code generation, intelligent code completion, codebase understanding, and smart rewrites, to SE practitioners. Additionally, pre-trained language models can be used for specific SE tasks, such as software size measurement ( 74 ; 70 ) . 2.1.2. SE for GenAI and GenAI for SE The interplay

Read the complete text