Programming by Chat: A Large-Scale Behavioral Analysis of 11,579 Real-World AI-Assisted IDE Sessions DOI: XXXXXXX.XXXXXXX Conference: ; Under review; March 2026 ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Software and its engineering Software creation and management CCS: Human-centered computing Empirical studies in HCI

Ningzhi Tang, Chaoran Chen, Zihan Fang, Gelei Xu, Maria Dhakal, Yiyu Shi, Collin McMillan, Yu Huang, Toby Jia-Jun Li · 2026

Read Programming by Chat: A Large-Scale Behavioral Analysis of 11,579 Real-World AI-Assisted IDE Sessions DOI: XXXXXXX.XXXXXXX Conference: ; Under review; March 2026 ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Software and its engineering Software creation and management CCS: Human-centered computing Empirical studies in HCI by Ningzhi Tang, Chaoran Chen, Zihan Fang, Gelei Xu, Maria Dhakal, Yiyu Shi, Collin McMillan, Yu Huang, Toby Jia-Jun Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-00436.txt.

Description

Tang and colleagues study how developers actually program with AI assistants inside code editors. Past studies used small lab setups or general chatbots, missing workflows where the assistant sees the codebase and edits many files. Drawing on chats committed to public repositories during normal work, the team covers 74,998 developer messages and 11,579 sessions, spanning 899 developers and 1,300 repositories, using Cursor and GitHub Copilot. Their findings trace three shifts in programming habits with AI help.

Catalog record

CREATORNingzhi Tang, Chaoran Chen, Zihan Fang, Gelei Xu, Maria Dhakal, Yiyu Shi, Collin McMillan, Yu Huang, Toby Jia-Jun Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61659
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.00436

Browse the full library · About the Tower of Babel