Relying on LLMs: Student Practices and Instructor Norms are Changing in Computer Science Education DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Human-centered c
Xinrui Lin, Heyan Huang, Shumin Shi, John Vines · 2026
Read Relying on LLMs: Student Practices and Instructor Norms are Changing in Computer Science Education DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Human-centered c by Xinrui Lin, Heyan Huang, Shumin Shi, John Vines (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05506.txt.
Introduction
Computer science students now lean on large language models for many course tasks, and instructors are still deciding where to draw the line. Xinrui Lin, Heyan Huang, Shumin Shi, and John Vines study both sides across five scenarios: writing, quizzes, programming, project work, and looking up information. Their user studies cover sixteen students and six instructors, and they sort the observed uses into seven main intents.
Conflict between student practice and instructor norms varied sharply by task. Generating writing and solving quiz problems clashed clearly with norms, while revising text and checking quiz answers drew broad agreement. Project work fell in between. The authors note that instructors are shifting from bans toward recording model use as part of grading. They close with design guidelines for campus AI tools, such as guardrails that keep students engaged and comprehension checks that turn low-conflict uses into chances to learn.
Catalog record
| CREATOR | Xinrui Lin, Heyan Huang, Shumin Shi, John Vines |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-05506
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Relying on LLMs: Student Practices and Instructor Norms are Changing in Computer Science Education DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Human-centered computing Empirical studies in HCI CCS: Applied computing Education Xinrui Lin, Heyan Huang, Shumin Shi, John Vines Abstract . Prior research has raised concerns about students’ over-reliance on large language models (LLMs) in higher education. This paper examines how Computer Science students and instructors engage with LLMs across five scenarios: "Writing", "Quiz", "Programming", "Project-based learning", and "Information retrieval". Through user studies with 16 students and 6 instructors, we identify 7 key intents, including increasingly complex student practices. Findings reveal varying levels of conflict between student practices and instructor norms, ranging from clear conflict in "Writing-generation" and "(Programming) quiz-solving", through partial conflict in "Programming project-implementation" and "Project-based learning", to broad agreement in "Writing-revision & ideation", "(Programming) quiz-correction" and "Info-query & summary". We document instructors are shifting from prohibiting to recognizing students’ use of LLMs for high-quality work, integrating usage records into assessment grading. Finally, we propose LLM design guidelines: deploying default guardrails with game-like and empathetic interaction to prevent students from "deserting" LLMs, especially for "Writing-generation", while utilizing comprehension checks in low-conflict intents to promote learning. 1. Introduction Large language models (LLMs) like ChatGPT are rapidly reshaping learning practices in higher education. Many students now turn to LLMs for assistance with tasks ranging from information retrieval and problem-solving to writing and programming ( 54 ; 71 ) . Early reports have highlighted the extent of this reliance, indicating that nearly 90% of students use ChatGPT to complete their assignments ( 76 ) . Current scholarly discussion often characterizes this phenomenon through a binary lens, viewing LLMs as a double-edged sword ( 61 ; 26 ; 50 ) . On one hand, LLMs offer on-demand, highly plausible answers in natural language, thereby accelerating productivity and learning efficiency ( 50 ; 79 ; 54 ) . Specifically, LLMs are perceived to hold the potential to transform education in scenarios such as writing ( 44 ; 73 ; 24 ; 20 ) , programming ( 9 ; 61 ; 78 ) , and project-based learning ( 81 ; 63 ) , supported by highly personalized instruction ( 34 ; 6 ; 54 ) . On the other hand, these generated essays and answers are often deemed sufficient to pass university assignments ( 48 ) , allowing students to obtain direct solutions with minimal effort and bypass the deep thinking that traditional problem-solving requires. Evidence suggests that this reliance encourages superficial learning and undermines the acquisition of fundamental skills ( 34 ; 33 ; 8 ; 64 ) , erodes students’ cognitive abilities and critical thinking ( 50 ; 70 ; 79 ; 43 ; 8 ; 38 ) , and raises concerns regarding plagiarism and academic integrity ( 76 ; 34 ; 12 ; 20 ; 57 ) . Therefore, instructors and researchers have raised urgent questions regarding how these AI tools should be integrated into higher education to mitigate dependency, with some argue that LLMs should be restricted from directly generating answers in educational contexts ( 46 ; 8 ) . Approaches that introduce guardrails and embed richer pedagogical strategies, such as Socratic questioning ( 55 ) , have been shown to stimulate student thinking and reduce reliance on ready-made solutions ( 19 ; 66 ; 56 ) . Similar strategies were recently implemented by OpenAI in ChatGPT’s "study mode" 1 1 1 https://openai.com/index/chatgpt-study-mode/ . Furthermore, researchers have begun exploring how to reframe LLMs from "cheating tools" into metacognitive scaffolds ( 27 ; 25 ) that support reflective learning ( 11 ) , thereby prompting students to actively reflect on what they have learned rather than simply copying answers ( 10 ; 74 ; 59 ) . Subsequent research demonstrates that LLMs can improve learning outcomes by generating metacognitive prompts ( 52 ; 53 ) - guidance that encourages student reflection - which reduce the likelihood of answer-copying and improve exam performance ( 40 ; 41 ) . As students gain proficiency with LLMs, they have increasingly integrated these tools into diverse aspects of higher education learning ( 6 ; 14 ) . Current literature on student practices and instructor norms, however, relies primarily on broad surveys ( 6 ; 77 ; 60 ; 26 ; 68 ) or studies confined to single domains, such as writing ( 20 ; 14 ; 7 ) or programming ( 5 ; 46 ; 66 ; 9 ) , along with the corresponding instructor perspectives ( 42 ; 7 ; 20 ; 60 ; 65 ; 54 ) . Consequently, prior work fails to capture the nuanced, context-dependent negotiations that characterize how student practices evolve from simple copy-pasting to complex workflows and how instructor norms adapt (or fail to adapt) to these emerging behaviors. The critical question is no longer a binary judgment of whether LLM usage is beneficial or detrimental, but rather how the boundaries of acceptable use are being redrawn across different pedagogical contexts. Furthermore, while implementing guardrails has proven effective in mathematics and programming ( 19 ; 8 ; 46 ; 66 ) , it remains unclear whether such designs can accommodate the more complex behaviors students now exhibit in different scenarios. These gaps collectively motivate our empirical study, which investigates the evolution of student practices and instructor norms to inform the future design of educational LLMs. To address this gap, we conducted user studies with 16 students and 6 instructors from Computer Science (CS). We mapped student LLM intents across scenarios in CS education, gathered student practices and instructor norms for each intent, examined student-instructor conflicts, and explored pedagogical innovations and LLM design recommendations tailored to specific intents. Specifically, our contributions are: 1) We identified 5 scenarios for using LLMs: "Writing", "Quiz", "Programming", "Project-based learning", and "Information retrieval". We then collected 7 intents, in which complex student workflows were exhibited in "writing-generation", "programming project-implementation", and "PBL-ideation". 2) The 7 intents are grouped by conflict level between student practices and instructor norms: Clear conflict - "Writing-generation" and "(Programming) quiz-solving"; Partial conflict - "Programming project-implementation" and "PBL-ideation"; Broad agreement - "Writing-revision & ideation", "(Programming) quiz-correction" and "Info-query & summary". 3) We describe pedagogical adaptations where instructor norms shift from banning LLMs to accepting and assessing the usage process (e.g., grading prompts and logs). 4) We propose design recommendations, advocating for default guardrails with game-like and empathetic strategies to prevent students from "deserting" models in clear conflict intents, particularly in "Writing-generation", and comprehension checks for agreed-upon intents. 2. Related work We focus on higher education in computer science because it offers numerous LLM application scenarios, instructors and students are more familiar with LLMs, and there is already a solid research foundation ( 69 ; 67 ; 60 ; 54 ; 4 ; 72 ; 30 ; 49 ; 65 ; 47 ; 56 ) . Related work are discussed in detail below. 2.1. Student practices with LLMs Since ChatGPT’s debut, student learning practices in higher education have become intertwined with LLMs. From students perspective, LLMs are valued for providing hyper-personalized instruction and bolstering learning confidence and