Exploring the Value of Diverse LLM Explanations in Introductory Programming DOI: XXXXXXX.XXXXXXX Conference: the 2nd ACM Virtual Global Computing Education Conference; November 12–15, 2026; Virtual Event ISBN: 978-1-4503-XXXX-X/18/06 CCS: Social and professional topics Computing education
Seth Bernstein, Paul Denny, Juho Leinonen, Kush Patel, Rayhona Nasimova, Matt Littlefield, Stephen MacNeil · 2026
Read Exploring the Value of Diverse LLM Explanations in Introductory Programming DOI: XXXXXXX.XXXXXXX Conference: the 2nd ACM Virtual Global Computing Education Conference; November 12–15, 2026; Virtual Event ISBN: 978-1-4503-XXXX-X/18/06 CCS: Social and professional topics Computing education by Seth Bernstein, Paul Denny, Juho Leinonen, Kush Patel, Rayhona Nasimova, Matt Littlefield, Stephen MacNeil (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28882.txt.
Description
Bernstein, Denny, Leinonen, Patel, Nasimova, Littlefield and MacNeil test whether varied AI explanations help beginners learn programming better than generic ones. Language models can already write code explanations rated above peer explanations, though still short of instructor quality. Drawing on creativity research, where many varied ideas often beat one polished idea, the team gave students explanations that each stressed a different aspect, such as function, concept or goal.
In the study, the team randomly assigned 971 first-year computing students diverse or generic explanations for two programming exercises. They answered multiple-choice and open-ended questions, then rated their mental effort and reflected in writing. Open-ended accuracy ran about 7.7 percent higher for the diverse group, a real gain. Perceived cognitive load, meaning how hard the material felt, did not differ. The authors read this as evidence that varying what an explanation stresses can deepen engagement.
Catalog record
| CREATOR | Seth Bernstein, Paul Denny, Juho Leinonen, Kush Patel, Rayhona Nasimova, Matt Littlefield, Stephen MacNeil |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.28882