ChatGPT: Friend or Foe When Comprehending and Changing Unfamiliar Code CCS: Software and its engineering Software creation and management
Norman Anderson, Tarek Alakmeh, Victoria Jackson, Guilherme Vaz Pereira, Umit Akirmak, Anthony Estey, Rafael Prikladnicki, Thomas Fritz, André van der Hoek, Margaret-Anne Storey · 2026
Read ChatGPT: Friend or Foe When Comprehending and Changing Unfamiliar Code CCS: Software and its engineering Software creation and management by Norman Anderson, Tarek Alakmeh, Victoria Jackson, Guilherme Vaz Pereira, Umit Akirmak, Anthony Estey, Rafael Prikladnicki, Thomas Fritz, André van der Hoek, Margaret-Anne Storey (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10702.txt.
Description
Norman Anderson and co-authors report a lab study of how ChatGPT support shapes coders grasping and changing code new to them. Ten advanced student coders, five with AI support and five without, extended a sizable software system. Analysis used Polya's four problem-solving phases and 25 codes built from data for distinct problem-solving behaviours, cross-checked on think-aloud records, code changes, web searches, and language-model prompts. Prior research stressed productivity and code quality over underlying mental processes.
Unexpectedly, while AI-group coders repeatedly offloaded aspects of the process to the tool, every problem-solving behaviour appeared in both groups. Nine of ten got stuck, but differed in how they got stuck and unstuck. The authors identify seven causes of getting stuck. They show how AI sometimes helped and sometimes hindered getting unstuck. This offers a mental-process view of AI-assisted programming beyond output measures.
Catalog record
| CREATOR | Norman Anderson, Tarek Alakmeh, Victoria Jackson, Guilherme Vaz Pereira, Umit Akirmak, Anthony Estey, Rafael Prikladnicki, Thomas Fritz, André van der Hoek, Margaret-Anne Storey |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59582 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10702