Comparative Analysis of Carbon Footprint in Manual vs. LLM-Assisted Code Development
Kuen Sum Cheung, Mayuri Kaul, Gunel Jahangirova, Mohammad Reza Mousavi, Eric Zie · 2025
Read Comparative Analysis of Carbon Footprint in Manual vs. LLM-Assisted Code Development by Kuen Sum Cheung, Mayuri Kaul, Gunel Jahangirova, Mohammad Reza Mousavi, Eric Zie (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-04521.txt.
Introduction
Kuen Sum Cheung and colleagues weighed the carbon cost of coding with AI help in a 2025 study. Language models write code fast, but running them burns energy in data centers, while a human at a keyboard burns comparatively little. Using competitive programming tasks as a stand-in for development work, the team measured emissions for manual solving against model-assisted solving of the same problems.
On average, the assisted workflow produced a far larger carbon footprint than the manual one, by the authors' reported factor. The gap also grew with task complexity in a clear correlation, since harder problems invite more model calls and longer outputs. The study urges teams to count inference emissions as a real project cost, not a free lunch.
Catalog record
| CREATOR | Kuen Sum Cheung, Mayuri Kaul, Gunel Jahangirova, Mohammad Reza Mousavi, Eric Zie |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-04521
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Comparative Analysis of Carbon Footprint in Manual vs. LLM-Assisted Code Development Kuen Sum Cheung, Mayuri Kaul, Gunel Jahangirova, Mohammad Reza Mousavi, Eric Zie Abstract . Large Language Models (LLM) have significantly transformed various domains, including software development. These models assist programmers in generating code, potentially increasing productivity and efficiency. However, the environmental impact of utilising these AI models is substantial, given their high energy consumption during both training and inference stages. This research aims to compare the energy consumption of manual software development versus an LLM-assisted approach, using Codeforces as a simulation platform for software development. The goal is to quantify the environmental impact and propose strategies for minimising the carbon footprint of using LLM in software development. Our results show that the LLM-assisted code generation leads on average to 32.72 higher carbon footprint than the manual one. Moreover, there is a significant correlation between task complexity and the difference in the carbon footprint of the two approaches. CCS: Software and its engineering CCS: Software and its engineering Software development methods 1. Introduction Large Language Models (LLM) are disrupting many sectors ( 20 ) and providing novel ways of producing different types of content ( 11 ) . The impact of LLM has expanded to software development and a myriad of approaches have emerged to assist and automate various software development tasks, such as design, implementation, and testing ( 14 ) ( 30 ) . Since their inception, there has been a genuine concern about the environmental impact of LLM, including their carbon footprint ( 15 ) . Several studies have raised ethical concerns and showed that LLM use a massive amount of energy. For instance, the end-to-end carbon footprint of GPT3 is estimated to be 554 tons of {\mathrm{CO}}_{2} equivalent ( 15 ) . This study aims to provide a quantitative analysis of the environmental impact of LLM in programming tasks, when used in an assistive mode and compare it to the traditional manual process of coding. To make this feasible, we focus on programming tasks for which there are large datasets of programming effort available from public platforms. We then run the same tasks in the LLM-based process and compare the efficiency, correctness, and end-to-end estimated energy consumption of the two approaches. Using these metrics, we answer the following research questions. (RQ1) Does LLM-based software development lead to less carbon emissions than manual software development? (RQ2) Is there a correlation between the complexity of the requirements and the difference in carbon footprint between the LLM-based and manual approach? Here, by ‘complexity’ we mean the difficulty level assigned by Codeforces to a given problem and ‘requirement’ refers to the set of instructions that define the task in a Codeforces problem statement. The overall objectives of our study are: 1) to thoroughly analyse the sustainability of LLM-based software development in comparison to manual-based software development, and 2) to propose strategies for the best-practice use of LLM in software development. The findings of this paper indicate that the end-to-end energy consumption of the LLM-based process is an order of magnitude larger than that of the manual process in all our sampled tasks. Moreover, the gap between the energy consumption of the two approaches increases significantly with the complexity of the requirements. Our results indicate the necessity of a broader study in order to find processes in which the LLM-based approaches may have a comparable or lower energy consumption to justify their replacement for the manual process. We provide the code we have used to calculate the metrics as well as our full experimental data as part of our replication package ( 9 ) . 2. Literature Review In this section, we review the literature on the carbon footprint of software development, with a focus on the emerging role of LLM. We provide an overview of the key relevant studies and identify any gaps in the current body of research. Carbon Footprint of Software Development. There is a substantial and growing interest in assessing the carbon footprint of traditional software development; we refer to surveys ( 16 , 28 ) , scoping- ( 25 , 10 , 21 ) , and mapping studies ( 12 ) . Recent work indicates a lack of awareness and evaluation methods as major difficulties in adopting sustainable practices in software development ( 16 , 18 , 29 ) . We address these by providing a basic methodology to evaluate and compare LLM-based software development with manual development. Moreover, we raise awareness by demonstrating significant, and to our knowledge hitherto unknown, differences in the carbon footprints of the two approaches. Carbon Footprint of LLM-Assisted Software Development. To date, there have been few studies addressing the carbon footprint of LLM in software development. Faiz et al. explore the substantial carbon footprint generated by LLM during training and inference ( 15 ) . The end-to-end carbon footprint of GPT3 is estimated to be 554 tons of {\mathrm{CO}}_{2} equivalent which indicates the high environmental cost of LLM-assisted programming. Additionally, a recent line of work indicates that the code generated by the LLM has a larger carbon footprint than the human-written code ( 26 , 27 ) . This line of work differs from our work in that it focuses on the sustainability metrics of LLM-generated code rather than evaluating the carbon footprint of the development effort. The work by Belchev ( 13 ) is one of the first works that investigates this direction with a focus on the LLM’s energy consumption and efficiency in software development tasks such as code generation, bug fixing, documentation, and testing. However, this work does not provide a comparison to the carbon footprint of the traditional, human-led development efforts. Identified Research Gaps. While there is increasing interest in studying both the carbon footprint of traditional software development and the environmental impact of LLM, there is a notable gap in research focused on the carbon footprint of LLM-assisted software development and how it compares to the manual software development. The broader context of using LLM throughout the software development lifecycle remains underexplored. Our research aims to fill this gap. 3. Programming Tasks Dataset In this section, we describe the dataset selection process and criteria for task inclusion. 3.1. Choice of Programming Tasks Dataset To answer our research questions, we include programming task datasets satisfying the following two essential criteria: (1) Well-Defined and Diverse Tasks: We required tasks that are clearly defined and cover a range of complexities. In particular, every task is accompanied by clearly defined test cases and explicit instructions, which provide concrete examples of expected functionality and performance benchmarks. Well-defined tasks ensure that the LLM focuses on solving the task without performance loss due to ambiguity. Additionally, incorporating tasks of varying complexity allows us to measure how the carbon footprint scales with the difficulty of the tasks, providing insights into the energy efficiency of the LLM across different types of challenges. (2) Comprehensive Submission Data: Beyond just the tasks, we needed a substantial amount of data, including detailed submission records from at least 1,000 participants who successfully solved each task to avoid bias, account for variability in human performance, and gain statistical confidence. This data should include crucial metrics such as code runtime, memory