Who’s the Leader? Analyzing Novice Workflows in LLM-Assisted Debugging of Machine Learning Code DOI: XXXXXXX.XXXXXXX Conference: Tools for Thought Workshop at CHI 2025; CHI 2025; Yokohama, Japan ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered computing Empirical studies in HCI

Jessica Y. Bo, Majeed Kazemitabaar, Emma Zhuang, Ashton Anderson · 2025

Read Who’s the Leader? Analyzing Novice Workflows in LLM-Assisted Debugging of Machine Learning Code DOI: XXXXXXX.XXXXXXX Conference: Tools for Thought Workshop at CHI 2025; CHI 2025; Yokohama, Japan ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered computing Empirical studies in HCI by Jessica Y. Bo, Majeed Kazemitabaar, Emma Zhuang, Ashton Anderson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08063.txt.

Description

Jessica Y Bo and co-authors present a 2025 arXiv paper on how novices debug machine learning code with a chat model's help. The team gave eight novice engineers a buggy script and open access to ChatGPT, then watched how they worked, what they trusted, and how they saw the tool.

User moves split into two styles: leading the model, or being led by it. The style shaped reliance, with risks of trusting wrong output or ignoring good output. The authors link these patterns to weaker thinking engagement and possible harm to later learning. They close with design ideas to keep novices in charge of the work.

Catalog record

CREATORJessica Y. Bo, Majeed Kazemitabaar, Emma Zhuang, Ashton Anderson
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-08063

Browse the full library · About the Tower of Babel