Teaching Prompt-Based Programming with LLMs: A 45-Minute Lesson with Guided Practice for End-User Programmers Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-9976-0/23/08
Keith Tran, Samiha Marwan, Thomas Price · 2026
Read Teaching Prompt-Based Programming with LLMs: A 45-Minute Lesson with Guided Practice for End-User Programmers Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-9976-0/23/08 by Keith Tran, Samiha Marwan, Thomas Price (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30547.txt.
Introduction
Keith Tran, Samiha Marwan, and Thomas Price test whether a short lesson can teach students to prompt AI programming helpers. Prompt-based programming states goals in plain language instead of code. It lowers barriers for non-specialists. Vague prompts still produce poor results, beginners find. The authors built a forty-five-minute lesson with guided practice. A randomized study pits it against ordinary lab work.
Fifty-five engineering students took part. The control group spent the same time on code tracing. Prompting students improved more on average. The gap was ten points against one point. It did not reach statistical significance, though. Gains in prompting self-efficacy were significantly larger for the lesson group. Those gains were thirty-five points against twenty-two. The authors judge a brief lesson helpful. Prompting skill needs more practice to grow further. The lesson needs no prior computing background to use.
Catalog record
| CREATOR | Keith Tran, Samiha Marwan, Thomas Price |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30547
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Teaching Prompt-Based Programming with LLMs: A 45-Minute Lesson with Guided Practice for End-User Programmers Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY DOI: XXXXXXX.XXXXXXX ISBN: 978-1-4503-9976-0/23/08 Keith Tran, Samiha Marwan, Thomas Price Abstract . Prompt-based programming, a new modality enabled by large language models (LLMs), allows users to express computational goals through natural language rather than traditional code. While this approach lowers barriers to entry, especially for non-CS learners, it does not eliminate the need for foundational CS skills. Learners often struggle to communicate their intent clearly to LLMs, resulting in vague or underspecified prompts. Prior work has documented the need for explicit prompting for both CS and non-CS learners. However, it remains less clear how such instruction can fit into busy classrooms or how much time is needed to produce meaningful gains. In this paper, we evaluated a 45-minute prompt-based programming intervention, consisting of a lesson with guided practice, against a business-as-usual CS lab activity (code tracing) of equal length, representing a class without prompt-focused instruction. We conducted a randomized controlled study with 55 engineering students. We found that students in the experimental condition improved more on average (though not significantly more) from pre- to post-test than the control group (+10.8 vs +1.1 percentage points) and showed significantly greater average gains in prompting self-efficacy (+35.4 vs +21.9 percentage points). Our results suggest it is likely that a brief intervention can improve learners’ ability to specify computational goals to LLMs. However, the effect was modest, suggesting that prompting skills may require more time and practice to develop. We provide a lightweight lesson that requires no prior CS background and can be readily dropped into existing courses. 1. Introduction Recent advances in large language models (LLMs), such as ChatGPT, have introduced a new way for learners, especially non-CS-majors, to engage with programming: describing a task in everyday language (e.g., “take a list of numbers and filter out those between 1 and 10”) and receiving working code in return. This practice, called prompt-based programming, allows users to express computational intent without writing traditional code ( 10 ) . However, access to LLMs alone is not sufficient: research has shown that users, especially those with less programming experience, often struggle to communicate their intent clearly. Common barriers include using vague or underspecified prompts ( 19 ; 15 ; 7 ; 4 ) , lacking strategies for debugging or refinement ( 31 ; 19 ) , and lacking technical CS vocabulary ( 7 ) . These findings raise the question of whether targeted instruction can help learners better articulate computational goals and debug prompts to generate correct solutions. Such prompting-specific programming lessons may be particularly impactful for learners with end-user programming goals, who want to learn to write code to accomplish domain-specific objectives, “as a means to an end,” rather than “the end itself,” ( 14 ; 22 ) . While there is a clear need to teach prompting for both CS and non-CS learners, it remains less clear how such instruction can fit into busy classrooms or how much instructional time is needed to produce meaningful gains. This question is especially valuable for instructors who see the benefits of teaching prompting but are unsure how to integrate it into their curricula. To explore these questions, we designed a 45-minute lesson on prompt-based programming paired with guided practice. We evaluated this lesson plus practice intervention against a business-as-usual CS lab activity (code tracing) of equal length, representing a class without prompt-focused instruction. We conducted a randomized controlled study with 55 engineering students, comparing these two lessons during a single lab session. To assess students’ prompting ability, we used Promptly problems ( 3 ) as pre- and post-tests. These tasks require learners to identify patterns in input/output pairs (i.e., test cases) and prompt an LLM to write a function that passes the test cases, without access to a natural language problem description that could be copied into the LLM. Our study is guided by two research questions: What is the impact of a short, prompt-based instruction on RQ1) learners’ ability to successfully solve Promptly problems and RQ2) learners’ self-efficacy in prompting skills? This paper makes the following contributions: • We present a lightweight, adaptable 45- minute lesson with guided practice that introduces CS-specific prompting strategies for use with LLMs. All instructional materials are publicly available 1 1 1 URL omitted for review to preserve anonymity. . • We demonstrate through a controlled experiment that this short intervention can significantly increase learners’ prompting self-efficacy over a business-as-usual CS lab activity, with meaningful (though not statistically significant) improvements in their ability to solve Promptly problems. 2. Related Work Prompt-Based Problems in CS Education : Prompt-based programming has emerged as a new paradigm in response to the rise of LLMs, allowing learners to express computational intent through natural language rather than code. To support this shift, Denny et al. introduced Prompt Problems and the Promptly platform, framing prompt construction as a teachable skill and providing automated feedback on LLM-generated code ( 4 ; 3 ; 13 ) . These problems assess students’ ability to express intent clearly, rather than reproduce syntax, and are designed to resist shortcut solutions like copy-pasting. However, recent work shows that novice learners often struggle with these tasks ( 12 ) . Nguyen et al. found that CS1 students solved just 57% of prompt problems, typically after multiple attempts and with automated feedback ( 19 ) . Students relied on ad hoc refinement strategies and held incorrect mental models of how code-generating LLMs work. Feldman and Anderson observed even lower success among non-experts, citing vague prompts and limited CS vocabulary as key barriers ( 7 ) , and recent work suggests that information content, such as what students include, matters more than vocabulary alone ( 17 ) . Together, these findings suggest that while LLMs lower barriers to entry, non-programmers face persistent challenges in expressing computational goals. This barrier is likely shared by conversational programmers, who engage with code conceptually rather than as authors ( 25 ; 9 ) . These challenges highlight the need for explicit instruction in prompt-based programming. Prompt-Based Programming Instruction : A growing body of work explores how prompting can be taught explicitly. Prather et al. provide a comprehensive review of GenAI research and teaching practices in computing education, noting that new tools are emerging to teach both programming and prompting skills simultaneously ( 20 ) . While best practices and frameworks—such as OpenAI guidance or the CLEAR framework (Concise, Logical, Explicit, Adaptive, Reflective) ( 16 ) -offer general advice, they often do not transfer well to domain-specific tasks like programming. Liang et al. highlight this challenge in their study of prompt developers, observing that prompt programming differs from traditional software development. Developers often lack reliable mental models of LLM behavior, and prompts are shaped through iterative trial-and-error, rather than systematic design ( 15 ) . They conclude that prompt programming lacks standardized best practices and recommend instructional approaches that are tailored to this emerging skill. One promising example is the ROPE intervention, which teaches learners to articulate task requirements for code generation ( 18 ) . ROPE and