The Lazy Student’s Dream: ChatGPT Passing an Engineering Course on Its Own

Gokul Puthumanaillam, Timothy Bretl, Melkior Ornik · 2025

Read The Lazy Student’s Dream: ChatGPT Passing an Engineering Course on Its Own by Gokul Puthumanaillam, Timothy Bretl, Melkior Ornik (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-05760.txt.

Introduction

Gokul Puthumanaillam, Timothy Bretl, and Melkior Ornik hand ChatGPT an entire undergraduate control systems course and grade what comes back. Their paper appeared in 2025. Under a minimal-effort protocol mimicking a real lazy student, the model attempted 115 deliverables: auto-graded quizzes, Python programming, and long analytical writing. It earned a B at about eighty-two percent, just under the class average of eighty-five.

Structured assignments were its strength; open-ended projects exposed its limits. The authors argue the result should move teaching past bans toward redesign: courses should test what the tool cannot fake and teach students to use it well. Full course materials and sample answers are posted on the project site.

Catalog record

CREATORGokul Puthumanaillam, Timothy Bretl, Melkior Ornik
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-05760

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Lazy Student’s Dream: ChatGPT Passing an Engineering Course on Its Own Gokul Puthumanaillam, Timothy Bretl, Melkior Ornik Abstract This paper presents a comprehensive investigation into the capability of Large Language Models (LLMs) to successfully complete a semester-long undergraduate control systems course. Through evaluation of 115 course deliverables, we assess LLM performance using ChatGPT under a “minimal effort” protocol that simulates realistic student usage patterns. The investigation employs a rigorous testing methodology across multiple assessment formats, from auto-graded multiple choice questions to complex Python programming tasks and long-form analytical writing. Our analysis provides quantitative insights into AI’s strengths and limitations in handling mathematical formulations, coding challenges, and theoretical concepts in control systems engineering. The LLM achieved a B-grade performance (82.24%), approaching but not exceeding the class average (84.99%), with strongest results in structured assignments and greatest limitations in open-ended projects. The findings inform discussions about course design adaptation in response to AI advancement, moving beyond simple prohibition towards thoughtful integration of these tools in engineering education. Additional materials including syllabus, examination papers, design projects, and example responses can be found at the project website: https://gradegpt.github.io . keywords Control education; Generative AI; LLMs, AI in Education; Technical Assessment 1 Introduction The rapid emergence of Large Language Models (LLMs) in educational settings ( Xu et al. 2024 ) has sparked substantial discussion about their impact on academic integrity and learning outcomes. While numerous studies have examined LLMs’ capabilities in specific tasks ( Jauhiainen and Guerra 2024 ) or isolated assignments ( Padiyath et al. 2024 ) , there remains a critical gap in our understanding of their performance across an entire technical course. This work presents a systematic investigation of LLM performance across a complete undergraduate Aerospace Control Systems course (AE 353) at the University of Illinois Urbana-Champaign (UIUC), with the goal of quantifying the LLM’s capabilities in handling diverse engineering coursework with no expert interaction and informing future course design strategies. The remarkable versatility of LLMs in solving diverse problems, from creative writing to technical analysis, has led to widespread adoption among students, raising legitimate concerns about assessment integrity ( Orenstrakh et al. 2024 ) and educational effectiveness. Studies across various disciplines have demonstrated these models’ ability to handle academic tasks ranging from essay composition to mathematical problem-solving. Yet, their effectiveness in comprehensive technical courses, particularly those requiring theoretical and practical knowledge, remains unexplored. This gap in understanding is especially relevant in control systems education, where success demands not just isolated problem-solving but a coherent grasp of interconnected concepts across theory and application. Our study examines AE 353, a junior-level control systems course, evaluating LLM performance across approximately 115 course deliverables. The course materials span multiple assessment formats: auto-graded homework problems, written examinations requiring mathematical derivations, and extensive programming projects. In investigating LLM capabilities, we chose to use ChatGPT, the most widely accessible and commonly used LLM among students. Our approach simulates a realistic scenario of a student seeking to complete coursework with minimal investment of time and effort—simply copying and pasting questions into ChatGPT without providing additional guidance. Statement of contributions: Our research deliberately maintains a focused scope, examining LLM performance in a single undergraduate control systems course rather than attempting to draw broad conclusions about AI in education. The significance of this work lies in two key areas: First, we establish a rigorous, reproducible methodology for evaluating LLM performance across diverse assessment types within technical courses. Second, we provide quantitative insights into the current capabilities and limitations of LLMs in completing complex engineering coursework. This study emphasizes technical performance evaluation, intentionally setting aside broader questions about educational policy and ethics of AI use in academia. While these questions merit thorough investigation, our priority is to establish a factual foundation regarding LLM capabilities in a specific technical course. While our findings are specific to AE 353 during Fall 2024, the analytical approach contribute to the broader dialogue about engineering education in an era of readily available AI tools. 2 Background and Related Work 2.1 Current State of LLMs in Education The educational impact of LLMs has been extensively studied across multiple dimensions since their widespread availability. Early research by ( Pudasaini et al. 2024 ) documented the rapid adoption of LLMs among university students, with usage rates exceeding 45% across multiple disciplines. This adoption has prompted significant concerns about academic integrity, with studies by Weber-Wulff et al. 2023 suggesting that traditional plagiarism detection tools are largely ineffective against LLM-generated content. Several studies have systematically evaluated LLM performance in specific academic tasks. Mansour et al. 2024 found that LLMs achieved scores in the top percentile in standardized writing assessments, while He-Yueya et al. 2023 documented its ability to solve complex mathematical word problems with a high accuracy. In computer science education, Chen et al. 2021 demonstrated that LLMs could successfully complete programming assignments across multiple languages, though performance declined significantly for tasks requiring complex algorithm design. The impact on student learning outcomes has been more contentious. Lyu et al. 2024 reported improved conceptual understanding among students who used LLMs as learning aids and raised concerns about decreased retention of fundamental principles. Research by Castleman and Turkcan 2023 suggests that the effectiveness of LLMs varies significantly based on the student’s existing knowledge base and the complexity of the subject matter. Institutional responses have varied widely. A comprehensive survey by Xiao et al. 2023 of 500 universities found approaches ranging from complete prohibition to active integration into curriculum design. 2.2 Existing Studies on AI in Engineering Education Several studies have focused on specific engineering domains. In electrical engineering, research by Tigges et al. 2024 evaluated LLM performance in circuit analysis, while mechanical engineering applications were extensively studied by Tian et al. 2024 . However, these studies typically focused on specific problem types rather than complete course evaluation. In control systems education–the topic of our paper–limited research exists on comprehensive LLM evaluation. Studies by Kevian et al. 2024 demonstrated successful LLM performance in control theory problems, research by Dharmaji 2024 identified significant limitations in LLM’s ability to generate and debug control system code, finding mixed results depending on the complexity of the implementation. Prior work has begun exploring LLM performance in academic settings. Zhang et al. 2025 evaluated AI capabilities in mechanics coursework, while studies in computer science education by Lyu et al. 2024 and Tanay et al. 2024 have examined LLM integration in introductory programming and upper-level project work respectively. Our work builds on these foundations by providing a comprehensive assessment across all elements of an engineering course – from theoretical problems to practical implementation and programming tasks. 2.3 AE 353: Course Structure and Requirements The Aerospace Control Systems course (AE 353) at UIUC serves as an introduction to control theory and its applications in aerospace systems. The course, mandatory for junior-level aerospace engineering students, integrates theoretical foundations with practical implementation through a diverse range of assessment types (see Fig. 1 for the distribution of the assessment types). Figure 1: Distribution of assessment types across AE 353. The course structure emphasizes progressive complexity in both theoretical understanding and practical application. Core concepts begin with fundamental control theory, before advancing to more sophisticated topics. This progression is reflected in the assessment structure, which comprises

Read the complete text