Programming by Chat: A Large-Scale Behavioral Analysis of 11,579 Real-World AI-Assisted IDE Sessions DOI: XXXXXXX.XXXXXXX Conference: ; Under review; March 2026 ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Software and its engineering Software creation and management CCS: Human-centered computing Empirical studies in HCI
Ningzhi Tang, Chaoran Chen, Zihan Fang, Gelei Xu, Maria Dhakal, Yiyu Shi, Collin McMillan, Yu Huang, Toby Jia-Jun Li · 2026
Read Programming by Chat: A Large-Scale Behavioral Analysis of 11,579 Real-World AI-Assisted IDE Sessions DOI: XXXXXXX.XXXXXXX Conference: ; Under review; March 2026 ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Software and its engineering Software creation and management CCS: Human-centered computing Empirical studies in HCI by Ningzhi Tang, Chaoran Chen, Zihan Fang, Gelei Xu, Maria Dhakal, Yiyu Shi, Collin McMillan, Yu Huang, Toby Jia-Jun Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-00436.txt.
Description
Tang and colleagues study how developers actually program with AI assistants inside code editors. Past studies used small lab setups or general chatbots, missing workflows where the assistant sees the codebase and edits many files. Drawing on chats committed to public repositories during normal work, the team covers 74,998 developer messages and 11,579 sessions, spanning 899 developers and 1,300 repositories, using Cursor and GitHub Copilot. Their findings trace three shifts in programming habits with AI help.
Catalog record
| CREATOR | Ningzhi Tang, Chaoran Chen, Zihan Fang, Gelei Xu, Maria Dhakal, Yiyu Shi, Collin McMillan, Yu Huang, Toby Jia-Jun Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61659 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.00436